Llama-3.1-Nemotron-70B-Instruct-HF

This documentation is valid for the following list of our models:

• nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Model Overview

A sophisticated large language model developed by NVIDIA, designed to enhance the performance of instruction-following tasks. It utilizes advanced training techniques and a robust architecture to generate human-like responses across a variety of applications.

Setup your API Key

If you don’t have an API key for the AI/ML API yet, feel free to use our Quickstart guide.

Submit a request

API Schema

Generate a conversational response using a language model.

post

Creates a chat completion using a language model, allowing interactive conversation by predicting the next response based on the given chat history. This is useful for AI-driven dialogue systems and virtual assistants.

Authorizations

Body

modelundefined · enumrequired

Options: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

messagesone of[]required

max_tokensnumber · min: 1 · default: 512optional

stopany ofoptional

streamboolean · default: falseoptional

stream_optionsobjectoptional

ninteger · min: 1optional

seedinteger · min: 1optional

top_pnumber · min: 0.01 · max: 1optional

top_knumberoptional

temperaturenumberoptional

repetition_penaltynumber | nullableoptional

logprobsboolean | nullableoptional

echobooleanoptional

min_pnumber · max: 1optional

presence_penaltynumber | nullableoptional

frequency_penaltynumber | nullableoptional

logit_biasobject | nullableoptional

toolsobject[]optional

tool_choiceany ofoptional

response_formatone ofoptional

Responses

cURL

JavaScript

Python

HTTP

cURL

curl -L \
  --request POST \
  --url 'https://api.aimlapi.com/v1/chat/completions' \
  --header 'Authorization: Bearer <YOUR_AIMLAPI_KEY>' \
  --header 'Content-Type: application/json' \
  --data '{
    "model": "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
    "messages": [
      {
        "role": "system",
        "content": "text",
        "name": "text"
      }
    ],
    "max_tokens": 1,
    "stop": "text",
    "stream": true,
    "stream_options": {
      "include_usage": true
    },
    "n": 1,
    "seed": 1,
    "top_p": 1,
    "top_k": 1,
    "temperature": 1,
    "repetition_penalty": 1,
    "logprobs": true,
    "echo": true,
    "min_p": 1,
    "presence_penalty": 1,
    "frequency_penalty": 1,
    "logit_bias": {
      "ANY_ADDITIONAL_PROPERTY": 1
    },
    "tools": [
      {
        "type": "function",
        "function": {
          "description": "text",
          "name": "text",
          "parameters": null
        }
      }
    ],
    "tool_choice": "none",
    "response_format": {
      "type": "text"
    }
  }'

201

201

No body