Struct CustomToken 

pub struct CustomToken {
    pub type_name: CompactString,
    pub value: CompactString,
    pub start_pos: Option<u32>,
    pub end_pos: Option<u32>,
    pub line: Option<u32>,
    pub end_line: Option<u32>,
    pub column: Option<u32>,
    pub end_column: Option<u32>,
}

A token produced by a TokenSource, typed by terminal NAME — exactly the seam Lark exposes (a custom lexer yields Token(type: str, value)); the engine resolves the name through the parse table per token. Positions are the caller’s verbatim (the engines never recompute them; $END borrows them as-is).

Fields

type_name: CompactString

value: CompactString

start_pos: Option<u32>

end_pos: Option<u32>

line: Option<u32>

end_line: Option<u32>

column: Option<u32>

end_column: Option<u32>

Implementations

impl CustomToken

pub fn new( type_name: impl Into<CompactString>, value: impl Into<CompactString>, ) -> Self

A position-less token (Lark permits Token(type, value) bare).

Trait Implementations

impl Clone for CustomToken

fn clone(&self) -> CustomToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CustomToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for CustomToken

impl PartialEq for CustomToken

fn eq(&self, other: &CustomToken) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CustomToken