Documentation Index
Fetch the complete documentation index at: https://dev.docs.inworld.ai/llms.txt
Use this file to discover all available pages before exploring further.
Properties
Properties
max_new_tokens
max_new_tokens?: string | number
Maximum number of tokens to generate
max_prompt_length
max_prompt_length?: string | number
Maximum length of the prompt in tokens
temperature
temperature?: string | number
Controls randomness of generated text
top_p
Probability for most probable tokens sampling
repetition_penalty
repetition_penalty?: string | number
Repetition penalty
frequency_penalty
frequency_penalty?: string | number
Frequency penalty
presence_penalty
presence_penalty?: string | number
Presence penalty
stop_sequences
stop_sequences?: string[]
List of sequences to stop generation
seed
Random seed for controlling the randomness of text generation
logit_bias
Logit bias to modify token likelihood