Chat Completion

Create chat completion

Generate a conversational response using a language model.

Creates a chat completion using a language model, allowing interactive conversation by predicting the next response based on the given chat history. This is useful for AI-driven dialogue systems and virtual assistants.

POST/v1/chat/completions

Body

application/json

Llm.v1.ChatCompletionPayload (one of)

objectobjectobjectobjectobject

Response

201

Request

JavaScriptCurlPython

const response = await fetch('/v1/chat/completions', {
    method: 'POST',
    headers: {
      "Content-Type": "application/json"
    },
    body: JSON.stringify({
      "model": "microsoft/WizardLM-2-8x22B",
      "messages": [
        {
          "role": "system",
          "content": "text"
        }
      ]
    }),
});
const data = await response.json();