U:RDoc::AnyMethod[iI"
tokenize:ETI"Crass::Tokenizer#tokenize;TF:publico:RDoc::Markup::Document:@parts[o:RDoc::Markup::Paragraph;	[I"?Tokenizes the input stream and returns an array of tokens.;T:
@fileI"lib/crass/tokenizer.rb;T:0@omit_headings_from_table_of_contents_below000[I"();T@FI"Tokenizer;TcRDoc::NormalClass00