InferenceComponentSchedulingConfig
The scheduling configuration that determines how inference component copies are placed across available instances when copies are added or removed.
Types
Properties
Link copied to clipboard
Configuration for balancing inference component copies across Availability Zones.
Link copied to clipboard
The strategy for placing inference component copies across available instances. If you also set AvailabilityZoneBalance, this strategy applies to placement within each Availability Zone.
Functions
Link copied to clipboard
inline fun copy(block: InferenceComponentSchedulingConfig.Builder.() -> Unit = {}): InferenceComponentSchedulingConfig