Section navigation

Public struct NGramTokeniser.Enumerator

Namespace
Rowles.LeanCorpus.Analysis.Tokenisers
Assembly
Rowles.LeanCorpus.dll

Stack-only n-gram enumerator. Each call to MoveNext() yields the next n-gram in increasing start-offset order.

public ref struct NGramTokeniser.Enumerator

Public property Current

Gets the current token.

Public method GetEnumerator()

Returns this for foreach support.

Public method MoveNext()

Advances to the next n-gram token.

Edit this page