A reference-driven video generation model that uses input images or video files as visual guidance for scene composition, ensuring strong subject and style consistency, with support for synchronized audio generation and high-quality cinematic output at 720p/1080p resolution, typically 5 to 15 seconds in length.
Setup your API Key
If you don’t have an API key for the AI/ML API yet, feel free to use our Quickstart guide.
How to Make a Call
Step-by-Step Instructions
Generating a video using this model involves sequentially calling two endpoints:
The first one is for creating and sending a video generation task to the server (returns a generation ID).
The second one is for requesting the generated video from the server using the generation ID received from the first endpoint. Below, you can find both corresponding API schemas.
API Schemas
Create a video generation task and send it to the server
post
Body
modelstring · enumRequiredPossible values:
promptstringRequired
The text description of the scene, subject, or action to generate in the video.
first_frame_imagestring · uriOptional
Optional first frame image URL.
image_urlsstring · uri[] · max: 5Optional
Reference image URLs.
video_urlsstring · uri[] · max: 5Optional
Reference video URLs.
aspect_ratiostring · enumOptional
The aspect ratio of the generated video.
Default: 16:9Possible values:
resolutionstring · enumOptional
An enumeration where the short side of the video frame determines the resolution.
Default: 1080pPossible values:
durationinteger · enumOptional
The length of the output video in seconds.
Default: 10Possible values:
enhance_promptbooleanOptional
Whether to enable prompt expansion.
Default: true
negative_promptstring · max: 500Optional
The description of elements to avoid in the generated video.
seedintegerOptional
Varying the seed integer is a way to get different results for the same other request parameters. Using the same value for an identical request will produce similar results. If unspecified, a random number is chosen.
watermarkbooleanOptional
Whether the video contains a watermark.
Default: false
Responses
200Success
application/json
idstringRequired
The ID of the generated video.
Example: 60ac7c34-3224-4b14-8e7d-0aa0db708325
statusstring · enumRequired
The current status of the generation task.
Example: completedPossible values:
post
/v2/video/generations
200Success
Retrieve the generated video from the server
After sending a request for video generation, this task is added to the queue. This endpoint lets you check the status of a video generation task using its generation_id, obtained from the endpoint described above.
If the video generation task status is completed, the response will include the final result — with the generated video URL and additional metadata.
curl -L \
--request POST \
--url 'https://api.aimlapi.com/v2/video/generations' \
--header 'Authorization: Bearer <YOUR_AIMLAPI_KEY>' \
--header 'Content-Type: application/json' \
--data '{
"model": "alibaba/wan-2-7-r2v",
"prompt": "Add a small fairy as a rider on the raccoon\'s back. She must have a black-and-golden face and a cloak in the colors of a dark emerald tropical butterfly with bright blue shimmering spots.",
"video_urls": [
"https://raw.githubusercontent.com/aimlapi/api-docs/main/reference-files/racoon-in-the-forest.mp4"
],
"duration": "5"
}'
import requests
import time
# Insert your AIML API Key instead of <YOUR_AIMLAPI_KEY>:
api_key = "<YOUR_AIMLAPI_KEY>"
base_url = "https://api.aimlapi.com/v2"
# Creating and sending a video generation task to the server
def generate_video():
url = f"{base_url}/video/generations"
headers = {
"Authorization": f"Bearer {api_key}",
"Content-Type": "application/json"
}
payload = {
"model": "alibaba/wan-2-7-r2v",
"prompt": '''
Use the woman from the second reference video as Mona Lisa — keep her face, clothing, colors, lighting, camera angle, and background exactly as in the second reference video.
Do not replace her with a different person and do not change the environment.
Take the raccoon only from the first reference video — keep the same fur pattern, colors, proportions, and appearance.
Do not generate a different raccoon.
Place the raccoon gently in Mona Lisa’s arms, as if he is her pet. She softly pets the raccoon. The raccoon affectionately licks her face, and Mona Lisa reacts with a warm, joyful laugh.
The audio must be in English. Mona Lisa says the short line:
"Oh, you sweet little one!"
Synchronize her lip movement to this line only. Do not generate Chinese speech.
Keep the visual style, motion, framing, and atmosphere realistic and consistent with the second reference video.
''',
"video_urls":[
"https://raw.githubusercontent.com/aimlapi/api-docs/main/reference-files/racoon-in-the-forest.mp4",
"https://raw.githubusercontent.com/aimlapi/api-docs/main/reference-files/monalisa.mp4"
],
# "duration": "5",
}
response = requests.post(url, json=payload, headers=headers)
if response.status_code >= 400:
print(f"Error: {response.status_code} - {response.text}")
else:
response_data = response.json()
return response_data
# Requesting the result of the task from the server using the generation_id
def get_video(gen_id):
url = f"{base_url}/video/generations"
params = {
"generation_id": gen_id,
}
headers = {
"Authorization": f"Bearer {api_key}",
"Content-Type": "application/json"
}
response = requests.get(url, params=params, headers=headers)
return response.json()
def main():
# Running video generation and getting a task id
gen_response = generate_video()
print(gen_response)
gen_id = gen_response.get("id")
print("Generation ID: ", gen_id)
# Try to retrieve the video from the server every 15 sec
if gen_id:
start_time = time.time()
timeout = 1000
while time.time() - start_time < timeout:
response_data = get_video(gen_id)
if response_data is None:
print("Error: No response from API")
break
status = response_data.get("status")
if status in ["queued", "generating"]:
print(f"Status: {status}. Checking again in 15 seconds.")
time.sleep(15)
else:
print("Processing complete:\n", response_data)
return response_data
print("Timeout reached. Stopping.")
return None
if __name__ == "__main__":
main()
const https = require("https");
const { URL } = require("url");
// Replace <YOUR_AIMLAPI_KEY> with your actual AI/ML API key
const apiKey = "<YOUR_AIMLAPI_KEY>";
const baseUrl = "https://api.aimlapi.com/v2";
// Creating and sending a video generation task to the server
function generateVideo(callback) {
const data = JSON.stringify({
model: "alibaba/wan-2-7-r2v",
prompt: `Use the woman from the second reference video as Mona Lisa — keep her face, clothing, colors, lighting, camera angle, and background exactly as in the second reference video.
Do not replace her with a different person and do not change the environment.
Take the raccoon only from the first reference video — keep the same fur pattern, colors, proportions, and appearance.
Do not generate a different raccoon.
Place the raccoon gently in Mona Lisa’s arms, as if he is her pet. She softly pets the raccoon. The raccoon affectionately licks her face, and Mona Lisa reacts with a warm, joyful laugh.
The audio must be in English. Mona Lisa says the short line:
"Oh, you sweet little one!"
Synchronize her lip movement to this line only. Do not generate Chinese speech.
Keep the visual style, motion, framing, and atmosphere realistic and consistent with the second reference video.`,
video_urls: [
"https://raw.githubusercontent.com/aimlapi/api-docs/main/reference-files/racoon-in-the-forest.mp4",
"https://raw.githubusercontent.com/aimlapi/api-docs/main/reference-files/monalisa.mp4"
]
};
const url = new URL(`${baseUrl}/video/generations`);
const options = {
method: "POST",
headers: {
"Authorization": `Bearer ${apiKey}`,
"Content-Type": "application/json",
"Content-Length": Buffer.byteLength(data),
},
};
const req = https.request(url, options, (res) => {
let body = "";
res.on("data", (chunk) => body += chunk);
res.on("end", () => {
if (res.statusCode >= 400) {
console.error(`Error: ${res.statusCode} - ${body}`);
callback(null);
} else {
const parsed = JSON.parse(body);
callback(parsed);
}
});
});
req.on("error", (err) => console.error("Request error:", err));
req.write(data);
req.end();
}
// Requesting the result of the task from the server using the generation_id
function getVideo(genId, callback) {
const url = new URL(`${baseUrl}/video/generations`);
url.searchParams.append("generation_id", genId);
const options = {
method: "GET",
headers: {
"Authorization": `Bearer ${apiKey}`,
"Content-Type": "application/json",
},
};
const req = https.request(url, options, (res) => {
let body = "";
res.on("data", (chunk) => body += chunk);
res.on("end", () => {
const parsed = JSON.parse(body);
callback(parsed);
});
});
req.on("error", (err) => console.error("Request error:", err));
req.end();
}
// Initiates video generation and checks the status every 15 seconds until completion or timeout
function main() {
generateVideo((genResponse) => {
if (!genResponse || !genResponse.id) {
console.error("No generation ID received.");
return;
}
const genId = genResponse.id;
console.log("Generation ID:", genId);
const timeout = 1000 * 1000; // 1000 sec
const interval = 15 * 1000; // 15 sec
const startTime = Date.now();
const checkStatus = () => {
if (Date.now() - startTime >= timeout) {
console.log("Timeout reached. Stopping.");
return;
}
getVideo(genId, (responseData) => {
if (!responseData) {
console.error("Error: No response from API");
return;
}
const status = responseData.status;
if (["queued", "generating"].includes(status)) {
console.log(`Status: ${status}. Checking again in 15 seconds.`);
setTimeout(checkStatus, interval);
} else {
console.log("Processing complete:\n", responseData);
}
});
};
checkStatus();
})
}
main();
{'id': 'B4s9SMzh12gKpK9EGuzez', 'status': 'queued', 'meta': {'usage': {'credits_used': 3900000, 'usd_spent': 1.95}}}
Generation ID: B4s9SMzh12gKpK9EGuzez
Status: queued. Checking again in 15 seconds.
Status: generating. Checking again in 15 seconds.
Status: generating. Checking again in 15 seconds.
Status: generating. Checking again in 15 seconds.
Status: generating. Checking again in 15 seconds.
...
Status: generating. Checking again in 15 seconds.
Status: generating. Checking again in 15 seconds.
Status: generating. Checking again in 15 seconds.
Status: generating. Checking again in 15 seconds.
Processing complete:
{'id': 'B4s9SMzh12gKpK9EGuzez', 'status': 'completed', 'video': {'url': 'https://cdn.aimlapi.com/generations/alligator/1778021564136-f9fa8fdc-17a9-4b89-91f7-27eacc440a87.mp4'}}
