ISpanTokenSink
- Namespace
- Rowles.LeanCorpus.Analysis
- Assembly
- Rowles.LeanCorpus.dll
Consumes span-backed tokens synchronously without requiring token text strings.
public interface ISpanTokenSink
Add(ReadOnlySpan<char>, int, int, string, int, byte[]?)
Adds a token to the sink.
Add(ReadOnlySpan<char>, int, int, string, int, int, byte[]?)
Adds a token edge with an explicit position length.