Chat Completion

Create chat completion

Please note that there is not just one, but several variations of this API described below, each with its own set of supported models and available parameters. You can explore these variations by selecting different options from the object dropdown menu and choose the one that suits you best.

Generate a conversational response using a language model.

Creates a chat completion using a language model, allowing interactive conversation by predicting the next response based on the given chat history. This is useful for AI-driven dialogue systems and virtual assistants.

POST/v1/chat/completions

Body

application/json

Llm.v1.ChatCompletionPayload (one of)

objectobjectobjectobjectobject

Response

201

Request

JavaScriptCurlPython

const response = await fetch('/v1/chat/completions', {
    method: 'POST',
    headers: {
      "Content-Type": "application/json"
    },
    body: JSON.stringify({
      "model": "microsoft/WizardLM-2-8x22B",
      "messages": [
        {
          "role": "system",
          "content": "text"
        }
      ]
    }),
});
const data = await response.json();