InvokeModelTokensRequest
class InvokeModelTokensRequest
The body of an InvokeModel
API request for token counting. This structure mirrors the input format for the InvokeModel
operation, allowing you to count tokens for raw text inference requests.
Types
Properties
Link copied to clipboard
The request body to count tokens for, formatted according to the model's expected input format. To learn about the input format for different models, see Model inference parameters and responses.