Completions

Provides a basic OpenAI compatible endpoint

post
Body
modelstring | nullableOptional
frequencyPenaltynumber · double | nullableOptional
maxTokensinteger · int32 | nullableOptional
seedinteger · int32Optional
temperaturenumber · float | nullableOptional
streambooleanOptional
topPnumber · double | nullableOptional
userstring | nullableOptional
Responses
200
OK
post
POST /api/v1/chat/completions HTTP/1.1
Host: 
Content-Type: application/json
Accept: */*
Content-Length: 173

{
  "messages": [
    {
      "content": "text",
      "role": "text",
      "name": "text"
    }
  ],
  "model": "text",
  "frequencyPenalty": 1,
  "maxTokens": 1,
  "seed": 1,
  "temperature": 1,
  "stream": true,
  "topP": 1,
  "user": "text"
}
200

OK

{
  "object": "text",
  "id": "text",
  "created": "2025-07-13T06:06:24.451Z",
  "model": "text",
  "systemFingerprint": "text",
  "usage": {
    "promptTokens": 1,
    "completionTokens": 1,
    "totalTokens": 1
  },
  "choices": [
    {
      "index": 1,
      "message": {
        "content": "text",
        "role": "text",
        "name": "text"
      },
      "finishReason": "text"
    }
  ]
}
PreviousChatNextInference