StemmedAnalyser

Namespace

Rowles.LeanCorpus.Analysis.Analysers

Assembly

Rowles.LeanCorpus.dll

Extends the standard analysis pipeline with Porter stemming for improved recall. Pipeline: tokenise → lowercase → stop-word removal → Porter stem. Uses the composable Analyser pipeline for zero-allocation streaming.

public sealed class StemmedAnalyser : IAnalyser

Inheritance

object

StemmedAnalyser

Implements

IAnalyser

StemmedAnalyser()

Initialises a new StemmedAnalyser.

StemmedAnalyser(KeywordMarkerFilter?)

Initialises a new StemmedAnalyser with optional keyword marker support.

Analyse(ReadOnlySpan<char>, ISpanTokenSink)

Analyses the input text and emits tokens synchronously into sink. Callers that require a materialised List<T> should use CountingTokenSink as the sink argument.