Should a Lexer be able to distinguish between Syntax Tokens contained in a “variable” and actual Syntax Tokens

Question

I am writing a lexer for a simple language(Gherkin). While some of the lexer is done, I am struggling with a design decision. Currently, the lexer has an examples and a step mod