inferenceConfig
The inference configuration for the model, including parameters such as maximum tokens, temperature, and top-p.
The inference configuration for the model, including parameters such as maximum tokens, temperature, and top-p.