InferenceEngineSummary

Inference Engine Summary

idstring

The unique identifier for the inference engine

Example: engine-12345

namestring

Example: inference-test-engine

statusstring

Possible values: [Creating, Active, Inactive]

Example: Creating

base_modelstring

Example: Llama-3.2-1B-Instruct

server_typestring

Example: on-demand

task_typestring

Example: text-generation

deployment_countsinteger

Number of deployments on this inference engine

Example: 1

created_atinteger

The timestamp when the deployment was created

Example: 1633036800

InferenceEngineSummary

{
  "id": "engine-12345",
  "name": "inference-test-engine",
  "status": "Creating",
  "base_model": "Llama-3.2-1B-Instruct",
  "server_type": "on-demand",
  "task_type": "text-generation",
  "deployment_counts": 1,
  "created_at": 1633036800
}