Search + K

Command Palette

Search for a command to run...

Sign In

Get an inference endpoint

GET /_inference/{task_type}/{inference_id}
Copy endpoint

This API requires the monitor_inference cluster privilege (the built-in inference_admin and inference_user roles grant this privilege).

Parameters

path Path Parameters

Name Type
task_type required

The task type

type InferenceTypesTaskType = "sparse_embedding" | "text_embedding" | "rerank" | "completion" | "chat_completion" | "embedding"
inference_id required

The inference Id

type TypesId = string

Responses

200 application/json
{ endpoints: InferenceTypesInferenceEndpointInfo

Represents an inference endpoint as returned by the GET API

type InferenceTypesInferenceEndpointInfo = InferenceTypesInferenceEndpoint & { inference_id: string;task_type: InferenceTypesTaskType; }
[]
; }