TokenBudgetPolicy

Namespace

Rowles.LeanCorpus.Analysis

Assembly

Rowles.LeanCorpus.dll

Determines what happens when a document exceeds its configured token limit.

public enum TokenBudgetPolicy

Fields

Reject = 2

Throw an TokenBudgetExceededException to reject the offending document without making the index writer unusable.

Truncate = 0

Silently discard tokens beyond the limit.

Warn = 1

Log a warning and continue indexing with all tokens.