GpuDeviceInfo¶
Structure Class¶
GpuDeviceInfo
dataclass
¶
Bases: _SerdeShape
Describes the GPU accelerators for the instance type.
Attributes¶
count
class-attribute
instance-attribute
¶
count: int | None = ...
The number of GPUs for the instance type.
gpu_partition_size
class-attribute
instance-attribute
¶
gpu_partition_size: float | None = ...
The size of each GPU as a fraction of a full GPU, between 0 (excluded) and 1 (included).
logical_gpu_count
class-attribute
instance-attribute
¶
logical_gpu_count: int | None = ...
Total number of GPU devices of this type.
manufacturer
class-attribute
instance-attribute
¶
manufacturer: str | None = ...
The manufacturer of the GPU accelerator.
memory_info
class-attribute
instance-attribute
¶
memory_info: GpuDeviceMemoryInfo | None = ...
Describes the memory available to the GPU accelerator.