The tokens used in a message API inference call.
In this article ▶
Inheritance Hierarchy
Namespace: Amazon.BedrockRuntime.Model
Assembly: AWSSDK.BedrockRuntime.dll
Version: 3.x.y.z
Syntax
public class TokenUsage
The TokenUsage type exposes the following members
Constructors
| Name | Description | |
|---|---|---|
|
TokenUsage() |
Properties
| Name | Type | Description | |
|---|---|---|---|
|
|
CacheDetails | System.Collections.Generic.List<Amazon.BedrockRuntime.Model.CacheDetail> |
Gets and sets the property CacheDetails. Detailed breakdown of cache writes by TTL. Empty if no cache creation occurred. Sorted by TTL duration (1h before 5m). Starting with version 4 of the SDK this property will default to null. If no data for this property is returned from the service the property will also be null. This was changed to improve performance and allow the SDK and caller to distinguish between a property not set or a property being empty to clear out a value. To retain the previous SDK behavior set the AWSConfigs.InitializeCollections static property to true. |
|
|
CacheReadInputTokens | System.Nullable<System.Int32> |
Gets and sets the property CacheReadInputTokens. The number of input tokens read from the cache for the request. |
|
|
CacheWriteInputTokens | System.Nullable<System.Int32> |
Gets and sets the property CacheWriteInputTokens. The number of input tokens written to the cache for the request. |
|
|
InputTokens | System.Nullable<System.Int32> |
Gets and sets the property InputTokens. The number of tokens sent in the request to the model. |
|
|
OutputTokens | System.Nullable<System.Int32> |
Gets and sets the property OutputTokens. The number of tokens that the model generated for the request. |
|
|
TotalTokens | System.Nullable<System.Int32> |
Gets and sets the property TotalTokens. The total of input tokens and tokens generated by the model. |
Version Information
.NET:
Supported in: 8.0 and newer, Core 3.1
.NET Standard:
Supported in: 2.0
.NET Framework:
Supported in: 4.7.2 and newer