Interface GenerationConfig (1.3.1)

Configuration options for model generation and outputs.

Package

@google-cloud/vertexai

Properties

candidateCount

candidateCount?: number;

Optional. Number of candidates to generate.

maxOutputTokens

maxOutputTokens?: number;

Optional. The maximum number of output tokens to generate per message.

stopSequences

stopSequences?: string[];

Optional. Stop sequences.

temperature

temperature?: number;

Optional. Controls the randomness of predictions.

topK

topK?: number;

Optional. If specified, topK sampling will be used.

topP

topP?: number;

Optional. If specified, nucleus sampling will be used.