bedrock/aws.sdk.kotlin.services.bedrock.model/InferenceConfiguration

InferenceConfiguration

class InferenceConfiguration

Base inference parameters to pass to a model. For more information, see Inference parameters for foundation models.

Types

Builder

class Builder

Companion

object Companion

Properties

maxTokens

val maxTokens: Int?

The maximum number of tokens to allow in the generated response. The default value is the maximum allowed value for the model that you are using.

stopSequences

val stopSequences: List<String>?

A list of stop sequences. A stop sequence is a sequence of characters that causes the model to stop generating the response.

temperature

val temperature: Float?

The likelihood of the model selecting higher-probability options while generating a response. A lower value makes the model more likely to choose higher-probability options, while a higher value makes the model more likely to choose lower-probability options.

topP

val topP: Float?

The percentage of most-likely candidates that the model considers for the next token. For example, if you choose a value of 0.8 for topP, the model selects from the top 80% of the probability distribution of tokens that could be next in the sequence.

Functions

copy

inline fun copy(block: InferenceConfiguration.Builder.() -> Unit = {}): InferenceConfiguration

equals

open operator override fun equals(other: Any?): Boolean

hashCode

open override fun hashCode(): Int

toString

open override fun toString(): String