# music-01 {% columns %} {% column width="66.66666666666666%" %} {% hint style="info" %} This documentation is valid for the following list of our models: * `music-01` {% endhint %} {% endcolumn %} {% column width="33.33333333333334%" %} Try in Playground {% endcolumn %} {% endcolumns %} An advanced AI model that generates diverse high-quality audio compositions by analyzing and reproducing musical patterns, rhythms, and vocal styles from the reference track. Refine the process using a text prompt. ## How to Make a Call {% hint style="success" %} [Create AI/ML API Key](https://aimlapi.com/app/keys) {% endhint %}
Step-by-Step Instructions Generating an audio using this model involves sequentially calling two endpoints: * The first one is for creating and sending a video generation task to the server (returns a generation ID). * The second one is for requesting the generated video from the server using the generation ID received from the first endpoint. Below, you can find two corresponding API schemas and examples for both endpoint calls. *** If you want to learn how to call AI models via API from the very basics, feel free to use our [Quickstart guide](https://docs.aimlapi.com/quickstart/setting-up).
## API Schemas ### Upload a reference sample This endpoint uploads a reference music piece to the server, analyzes it, and returns identifiers for the voice and/or instrumental patterns to use later. {% openapi src="" path="/v2/generate/audio/minimax/upload" method="post" %} [music-01-pair.json](https://3927338786-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FROMd1X5PuqtikJ48n2N9%2Fuploads%2Fgit-blob-e3afd41c9c8a074e9e664f50b6fe0616a4eb0e84%2Fmusic-01-pair.json?alt=media) {% endopenapi %} ### Generate music sample This endpoint generates a new music piece based on the voice and/or instrumental pattern identifiers obtained from the first endpoint above.\ The generation can be completed in 50-60 seconds or take a bit more. ## POST /v2/generate/audio/minimax/generate > ```json {"openapi":"3.0.0","info":{"title":"AI/ML Gateway","version":"1.0"},"servers":[{"url":"https://api.aimlapi.com"}],"security":[{"access-token":[]}],"components":{"securitySchemes":{"access-token":{"scheme":"bearer","bearerFormat":"","type":"http","description":"Bearer key"}},"schemas":{"Minimax.v2.GenerateAudioResponseDTO":{"type":"object","properties":{"data":{"type":"object","properties":{"status":{"type":"integer","description":"Music generation status. 1: In progress; 2: Completed."},"audio":{"type":"string","description":"Hex-encoded audio data or URL depending on output_format. When output_format is \"hex\", contains hex-encoded audio. When output_format is \"url\", contains download URL."}},"required":["status","audio"]},"extra_info":{"type":"object","properties":{"audio_length":{"type":"integer"},"audio_size":{"type":"integer"},"audio_bitrate":{"type":"integer"},"audio_sample_rate":{"type":"integer"},"music_duration":{"type":"integer"},"music_sample_rate":{"type":"integer"},"music_channel":{"type":"integer"},"bitrate":{"type":"integer"},"music_size":{"type":"integer"}}},"analysis_info":{"nullable":true},"trace_id":{"type":"string"},"base_resp":{"type":"object","properties":{"status_code":{"type":"integer"},"status_msg":{"type":"string"}},"required":["status_code","status_msg"]}},"required":["base_resp"]}}},"paths":{"/v2/generate/audio/minimax/generate":{"post":{"operationId":"MinimaxAudioControllerV2_createGeneration_v2","parameters":[],"requestBody":{"required":true,"content":{"application/json":{"schema":{"type":"object","properties":{"lyrics":{"type":"string","description":"Lyrics with optional formatting. You can use a newline to separate each line of lyrics. You can use two newlines to add a pause between lines. You can use double hash marks (##) at the beginning and end of the lyrics to add accompaniment. Maximum 600 characters."},"model":{"enum":["music-01"]},"audio_setting":{"type":"object","properties":{"sample_rate":{"type":"integer","description":"The sampling rate of the generated music.","enum":[16000,24000,32000,44100]},"bitrate":{"type":"integer","description":"The bit rate of the generated music.","enum":[32000,64000,128000,256000]},"format":{"type":"string","enum":["mp3","wav","pcm"],"description":"The format of the generated music."}},"required":["format"]},"refer_voice":{"type":"string","description":"voice_id.\n At least one of refer_voice or refer_instrumental is required. When only refer_voice is provided, the system can still output music data. The generated music will be an a cappella vocal hum that aligns with the provided refer_voice and the generated lyrics, without any instrumental accompaniment."},"refer_instrumental":{"type":"string","description":"instrumental_id.\n At least one of refer_voice or refer_instrumental is required. When only refer_instrumental is provided, the system can still output music data. The generated music will be a purely instrumental track that aligns with the provided refer_instrumental, without any vocals."}},"required":["lyrics","model"]}}}},"responses":{"default":{"description":"","content":{"application/json":{"schema":{"$ref":"#/components/schemas/Minimax.v2.GenerateAudioResponseDTO"}}}}},"tags":["Minimax"]}}}} ``` ## Quick Code Example Here is an example of generation an audio file based on a sample and a prompt using the music model **music-01**. {% tabs %} {% tab title="Python" %} {% code overflow="wrap" %} ```python import requests # Insert your AI/ML API key here: aimlapi_key = "" # Input data audio_url = "https://tand-dev.github.io/audio-hosting/spinning-head-271171.mp3" file_name = "spinning-head-271171.mp3" purpose = "song" # Possible values: 'song', 'voice', 'instrumental' def upload_reference_file(): """Download file from URL and upload it to AIML API""" url = "https://api.aimlapi.com/v2/generate/audio/minimax/upload" try: # Step 1: Download the file response = requests.get(audio_url) response.raise_for_status() # Step 2: Upload to AIML API payload = {"purpose": purpose} files = {"file": (file_name, response.content, "audio/mpeg")} headers = {"Authorization": f"Bearer {aimlapi_key}"} upload_response = requests.post(url, headers=headers, files=files, data=payload) upload_response.raise_for_status() data = upload_response.json() print("Upload successful:", data) return data # return JSON with file ids except requests.exceptions.RequestException as error: print(f"Error during upload: {error}") return None def generate_audio(voice_id=None, instrumental_id=None): """Send audio generation request and save result""" url = "https://api.aimlapi.com/v2/generate/audio/minimax/generate" lyrics = ( "##Side by side, through thick and thin, \n\n" "With a laugh, we always win. \n\n" "Storms may come, but we stay true, \n\n" "Friends forever—me and you!##" ) payload = { "refer_voice": voice_id, "refer_instrumental": instrumental_id, "lyrics": lyrics, "model": "music-01", } headers = { "Content-Type": "application/json", "Authorization": f"Bearer {aimlapi_key}", } response = requests.post(url, headers=headers, json=payload) response.raise_for_status() audio_hex = response.json()["data"]["audio"] decoded_hex = bytes.fromhex(audio_hex) out_name = "generated_audio.mp3" with open(out_name, "wb") as f: f.write(decoded_hex) print(f"Generated audio saved as {out_name}") def main(): uploaded = upload_reference_file() if not uploaded: return # Extract IDs depending on purpose voice_id = uploaded.get("voice_id") instrumental_id = uploaded.get("instrumental_id") generate_audio(voice_id, instrumental_id) if __name__ == "__main__": main() ``` {% endcode %} {% endtab %} {% tab title="JavaScript" %} {% code overflow="wrap" %} ```javascript import { writeFile } from "node:fs/promises"; import { Blob } from "node:buffer"; // Insert your AI/ML API key here: const API_KEY = ""; // Input data const AUDIO_URL = "https://tand-dev.github.io/audio-hosting/spinning-head-271171.mp3"; const FILE_NAME = "spinning-head-271171.mp3"; const PURPOSE = "song"; // Possible values: 'song', 'voice', 'instrumental' // Download file from URL and upload it to AIML API async function uploadReferenceFile() { const uploadUrl = "https://api.aimlapi.com/v2/generate/audio/minimax/upload"; try { // Step 1: Download the file const response = await fetch(AUDIO_URL); if (!response.ok) throw new Error(`Failed to download file: ${response.status}`); const arrayBuffer = await response.arrayBuffer(); const fileBlob = new Blob([arrayBuffer], { type: "audio/mpeg" }); // Step 2: Upload to AIML API const formData = new FormData(); formData.append("purpose", PURPOSE); formData.append("file", fileBlob, FILE_NAME); const uploadResponse = await fetch(uploadUrl, { method: "POST", headers: { Authorization: `Bearer ${API_KEY}`, // Content-Type should not be set manually for FormData }, body: formData, }); if (!uploadResponse.ok) { const text = await uploadResponse.text(); throw new Error(`Upload failed ${uploadResponse.status}: ${text}`); } const data = await uploadResponse.json(); console.log("Upload successful:", data); return data; // JSON with file ids } catch (err) { console.error("Error during upload:", err.message); return null; } } // Send audio generation request and save result async function generateAudio(voiceId = null, instrumentalId = null) { const url = "https://api.aimlapi.com/v2/generate/audio/minimax/generate"; const lyrics = ` ##Side by side, through thick and thin, With a laugh, we always win. Storms may come, but we stay true, Friends forever—me and you!## `.trim(); const payload = { refer_voice: voiceId, refer_instrumental: instrumentalId, lyrics, model: "music-01", }; const res = await fetch(url, { method: "POST", headers: { "Content-Type": "application/json", Authorization: `Bearer ${API_KEY}`, }, body: JSON.stringify(payload), }); if (!res.ok) { const text = await res.text(); throw new Error(`Generation failed ${res.status}: ${text}`); } const data = await res.json(); const audioHex = data?.data?.audio; if (!audioHex) throw new Error("No audio hex in response"); const audioBuffer = Buffer.from(audioHex, "hex"); const outName = "generated_audio.mp3"; await writeFile(outName, audioBuffer); console.log(`Generated audio saved as ${outName}`); } // Main function async function main() { const uploaded = await uploadReferenceFile(); if (!uploaded) return; // Extract IDs depending on purpose const voiceId = uploaded.voice_id; const instrumentalId = uploaded.instrumental_id; await generateAudio(voiceId, instrumentalId); } main(); ``` {% endcode %} {% endtab %} {% endtabs %}
Response {% code overflow="wrap" %} ```json5 Upload successful: {'voice_id': 'vocal-2025082518145625-6XW9wCOF', 'instrumental_id': 'instrumental-2025082518145625-vCCEiiES', 'trace_id': '04fb6a8721abeee5b66edd452b4d0f33', 'base_resp': {'status_code': 0, 'status_msg': 'success'}} Generated audio saved as generated_audio.mp3 ``` {% endcode %}
Listen to the track we generated: {% embed url="" %} --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.aimlapi.com/api-references/music-models/minimax/music-01.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.