Skip to content
OpenKey

Llama 3.3 70B Instruct

Meta AIReleased Dec 6, 2024

The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model...

Try in playground
Context window
131K tokens
Max output
16K tokens
Input
text
Output
text
Tokenizer
Llama3
Knowledge cutoff
Dec 31, 2023
Released
Dec 6, 2024

Pricing

Per 1M tokens. The provider price and our flat 3% fee are separate columns — what you pay is their sum.

Per 1M tokensProvider+ 3% feeYou pay
Input$0.100$0.0030$0.103
Output$0.320$0.0096$0.330

Supported parameters

  • frequency_penalty
  • logit_bias
  • logprobs
  • max_tokens
  • min_p
  • presence_penalty
  • repetition_penalty
  • response_format
  • seed
  • stop
  • structured_outputs
  • temperature
  • tool_choice
  • tools
  • top_k
  • top_logprobs
  • top_p

Call it

OpenAI-compatible: point your SDK at api.openkey.ai/v1 and use model meta-llama/llama-3.3-70b-instruct.

Code sample language
curl https://api.openkey.ai/v1/chat/completions \
  -H "Authorization: Bearer $OPENKEY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.3-70b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.openkey.ai/v1",
    api_key=os.environ["OPENKEY_API_KEY"],
)

completion = client.chat.completions.create(
    model="meta-llama/llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(completion.choices[0].message.content)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.openkey.ai/v1",
  apiKey: process.env.OPENKEY_API_KEY,
});

const completion = await client.chat.completions.create({
  model: "meta-llama/llama-3.3-70b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Questions

How much does Llama 3.3 70B Instruct cost via API?
Through OpenKey, Llama 3.3 70B Instruct costs $0.103 per 1M input tokens and $0.330 per 1M output tokens. That is the provider price ($0.100 / $0.320) plus a flat 3% fee — nothing else.
What is Llama 3.3 70B Instruct's context window?
Llama 3.3 70B Instruct accepts up to 131K tokens of context and returns up to 16K tokens per request.
Is Llama 3.3 70B Instruct OpenAI-compatible?
Yes. Send requests to OpenKey's /v1/chat/completions endpoint with model "meta-llama/llama-3.3-70b-instruct" using any OpenAI SDK — only the base URL and API key change.
What inputs does Llama 3.3 70B Instruct support?
Llama 3.3 70B Instruct accepts text input and produces text output. Its knowledge cutoff is Dec 31, 2023.

More from Meta AI

All Meta AI models →