Optionalfields: WriterInputWriter API key
Model to use
Writer organization ID
OptionalbestGenerates this many completions server-side and returns the "best"."
OptionalfrequencyPenalizes repeated tokens according to frequency.
OptionallogprobsWhether to return log probabilities.
OptionalmaxMaximum number of tokens to generate in the completion.
OptionalminMinimum number of tokens to generate.
OptionalnNumber of completions to generate.
OptionalpresencePenalizes repeated tokens regardless of frequency.
OptionaltemperatureSampling temperature to use
OptionaltopPTotal probability mass of tokens to consider at each step.
Class representing a Writer Large Language Model (LLM). It interacts with the Writer API to generate text completions.