Start calling this model with endpoint-specific examples.
Headline benchmark standings and comparison context.
Key dates, capabilities, and model metadata.
Start calling this model with endpoint-specific examples.
Headline benchmark standings and comparison context.
Key dates, capabilities, and model metadata.
Start calling this model with endpoint-specific examples.
Headline benchmark standings and comparison context.
Key dates, capabilities, and model metadata.
01 Oct 2024
Parameters
8,000,000,000
License
Llama 3.1 Community License
Input
No modalities listed.
Output
No modalities listed.
developer.nvidia.com
Core latency and throughput trends from recent traffic.
Start calling this model with endpoint-specific examples.
Choose a supported endpoint, pick a main language, then select the example style you want to copy.
import AIStats from '@ai-stats/sdk';
const client = new AIStats({
apiKey: process.env.AI_STATS_API_KEY,
});
const response = await client.generateResponse({
"model": "nvidia/llama-3.1-nemotron-70b-instruct",
"input": "Give me one fun fact about cURL.",
"service_tier": "standard"
});
const outputText = response.output
?.flatMap((item) => item.content ?? [])
.find((item) => item.type === "output_text")
?.text;
console.log(outputText ?? response);Select a route to update the request snippet and compatibility details.
/v1/responses/v1/chat/completions/v1/messagesLatency
Throughput
Uptime
Headline benchmark standings and comparison context.
Top benchmark results for nvidia/llama-3.1-nemotron-70b-instruct.
Detailed benchmark comparisons now live in the Compare tool.
