Trait muse_lang::compiler::syntax::TokenizeRanged
source · pub trait TokenizeRanged {
// Required method
fn tokenize_ranged(
&self,
range: SourceRange,
tokens: &mut VecDeque<Ranged<Token>>,
);
}Expand description
Converts a value into a series of Tokens with the provided enclosing
range.
Required Methods§
sourcefn tokenize_ranged(
&self,
range: SourceRange,
tokens: &mut VecDeque<Ranged<Token>>,
)
fn tokenize_ranged( &self, range: SourceRange, tokens: &mut VecDeque<Ranged<Token>>, )
Tokenize self into tokens within the enclosing range.