bedrock/aws.sdk.kotlin.services.bedrock.model/InferenceConfiguration

InferenceConfiguration

class InferenceConfiguration

Inference configuration for a model.

Types

object Companion

Properties

val maxTokens: Int?

The maximum number of tokens to generate.

val stopSequences: List<String>?

Stop sequences that end generation.

val temperature: Float?

The temperature for sampling.

val topP: Float?

The top-p value for nucleus sampling.

Functions

inline fun copy(block: InferenceConfiguration.Builder.() -> Unit = {}): InferenceConfiguration

open operator override fun equals(other: Any?): Boolean

open override fun hashCode(): Int

open override fun toString(): String