Meta-Llama-3.1-405B-Instruct-Turbo

This documentation is valid for the following list of our models:

• meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo

Model Overview

A state-of-the-art large language model developed by Meta AI, designed for advanced text generation tasks. It excels in generating coherent and contextually relevant text across various domains.

Setup your API Key

If you don’t have an API key for the AI/ML API yet, feel free to use our Quickstart guide.

Submit a request

API Schema

Generate a conversational response using a language model.

post

Creates a chat completion using a language model, allowing interactive conversation by predicting the next response based on the given chat history. This is useful for AI-driven dialogue systems and virtual assistants.

Authorizations

Body

modelundefined · enumrequired

Options: meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo

messagesone of[]required

max_tokensnumber · min: 1 · default: 512optional

stopany ofoptional

streamboolean · default: falseoptional

stream_optionsobjectoptional

ninteger · min: 1optional

seedinteger · min: 1optional

top_pnumber · min: 0.01 · max: 1optional

top_knumberoptional

temperaturenumberoptional

repetition_penaltynumber | nullableoptional

logprobsboolean | nullableoptional

echobooleanoptional

min_pnumber · max: 1optional

presence_penaltynumber | nullableoptional

frequency_penaltynumber | nullableoptional

logit_biasobject | nullableoptional

toolsobject[]optional

tool_choiceany ofoptional

response_formatone ofoptional

Responses

cURL

JavaScript

Python

HTTP

cURL

curl -L \
  --request POST \
  --url 'https://api.aimlapi.com/v1/chat/completions' \
  --header 'Authorization: Bearer <YOUR_AIMLAPI_KEY>' \
  --header 'Content-Type: application/json' \
  --data '{
    "model": "meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo",
    "messages": [
      {
        "role": "system",
        "content": "text",
        "name": "text"
      }
    ],
    "max_tokens": 1,
    "stop": "text",
    "stream": true,
    "stream_options": {
      "include_usage": true
    },
    "n": 1,
    "seed": 1,
    "top_p": 1,
    "top_k": 1,
    "temperature": 1,
    "repetition_penalty": 1,
    "logprobs": true,
    "echo": true,
    "min_p": 1,
    "presence_penalty": 1,
    "frequency_penalty": 1,
    "logit_bias": {
      "ANY_ADDITIONAL_PROPERTY": 1
    },
    "tools": [
      {
        "type": "function",
        "function": {
          "description": "text",
          "name": "text",
          "parameters": null
        }
      }
    ],
    "tool_choice": "none",
    "response_format": {
      "type": "text"
    }
  }'

201

201

No body