Interface ChatContextOptions

Controls the context snippets sent to the LLM.

Hierarchy

  • ChatContextOptions

Properties

Properties

snippetSize?: number

The maximum context snippet size. Default is 2048 tokens. Minimum is 512 tokens. Maximum is 8192 tokens.

topK?: number

The maximum number of context snippets to use. Default is 16. Maximum is 64.