SimpleAnalyser

Namespace

Rowles.LeanCorpus.Analysis.Analysers

Assembly

Rowles.LeanCorpus.dll

Analyser that splits text into letter-only tokens and lowercases them without stop-word removal.

public sealed class SimpleAnalyser : IAnalyser

Inheritance

object

SimpleAnalyser

Implements

IAnalyser

SimpleAnalyser(int)

Initialises a new SimpleAnalyser.

Analyse(ReadOnlySpan<char>, ISpanTokenSink)

Analyses the input text and emits tokens synchronously into sink. Callers that require a materialised List<T> should use CountingTokenSink as the sink argument.