InferenceEngineSummary

Inference Engine Summary

id string

The unique identifier for the inference engine

Example: engine-12345

name string

Example: inference-test-engine

status string

Possible values: [Creating, Active, Inactive]

Example: Creating

base_model string

Example: Llama-3.2-1B-Instruct

server_type string

Example: on-demand

task_type string

Example: text-generation

deployment_counts integer

Number of deployments on this inference engine

Example: 1

created_at integer

The timestamp when the deployment was created

Example: 1633036800

InferenceEngineSummary

{
  "id": "engine-12345",
  "name": "inference-test-engine",
  "status": "Creating",
  "base_model": "Llama-3.2-1B-Instruct",
  "server_type": "on-demand",
  "task_type": "text-generation",
  "deployment_counts": 1,
  "created_at": 1633036800
}