Completions

Provides a basic OpenAI compatible endpoint

POST/api/v1/chat/completions

Body

application/jsontext/jsonapplication/*+json

messagesnullable array of object

modelnullable string

frequencyPenaltynullable number (double)

maxTokensnullable integer (int32)

seedinteger (int32)

temperaturenullable number (float)

streamboolean

topPnullable number (double)

usernullable string

Response

200

OK

Body

text/plainapplication/jsontext/json

objectnullable string

idnullable string

createdstring (date-time)

modelnullable string

systemFingerprintnullable string

usageobject

choicesnullable array of object

Request

JavaScriptCurlPythonHTTP

const response = await fetch('/api/v1/chat/completions', {
    method: 'POST',
    headers: {
      "Content-Type": "application/json"
    },
    body: JSON.stringify({
      "messages": [
        {}
      ]
    }),
});
const data = await response.json();

Response

200

{
  "object": "text",
  "id": "text",
  "created": "2025-02-05T10:43:55.767Z",
  "model": "text",
  "systemFingerprint": "text",
  "usage": {
    "promptTokens": 1,
    "completionTokens": 1,
    "totalTokens": 1
  },
  "choices": [
    {
      "index": 1,
      "message": {
        "content": "text",
        "role": "text",
        "name": "text"
      },
      "finishReason": "text"
    }
  ]
}