EdgeNGramTokeniser.Enumerator
- Namespace
- Rowles.LeanCorpus.Analysis.Tokenisers
- Assembly
- Rowles.LeanCorpus.dll
Stack-only edge n-gram enumerator. Each call to MoveNext() advances to the next edge n-gram. Current exposes the yielded token.
public ref struct EdgeNGramTokeniser.Enumerator
Current
Gets the current token.
GetEnumerator()
Returns this for foreach support.
MoveNext()
Advances to the next edge n-gram token.