batchStrategy

Specifies the number of records to include in a mini-batch for an HTTP inference request. A record* is a single unit of input data that inference can be made on. For example, a single line in a CSV file is a record. *

*To enable the batch strategy, you must set SplitType to Line, RecordIO, or TFRecord.