Skip to content
OpenKey

Llama 3 8B Instruct

Meta AIReleased Apr 18, 2024

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...

Try in playground
Context window
8K tokens
Input
text
Output
text
Tokenizer
Llama3
Knowledge cutoff
Dec 31, 2023
Released
Apr 18, 2024

Pricing

Per 1M tokens. The provider price and our flat 3% fee are separate columns — what you pay is their sum.

Per 1M tokensProvider+ 3% feeYou pay
Input$0.140$0.0042$0.144
Output$0.140$0.0042$0.144

Supported parameters

  • frequency_penalty
  • logit_bias
  • max_tokens
  • min_p
  • presence_penalty
  • repetition_penalty
  • response_format
  • stop
  • structured_outputs
  • temperature
  • top_k
  • top_p

Call it

OpenAI-compatible: point your SDK at api.openkey.ai/v1 and use model meta-llama/llama-3-8b-instruct.

Code sample language
curl https://api.openkey.ai/v1/chat/completions \
  -H "Authorization: Bearer $OPENKEY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3-8b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.openkey.ai/v1",
    api_key=os.environ["OPENKEY_API_KEY"],
)

completion = client.chat.completions.create(
    model="meta-llama/llama-3-8b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(completion.choices[0].message.content)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.openkey.ai/v1",
  apiKey: process.env.OPENKEY_API_KEY,
});

const completion = await client.chat.completions.create({
  model: "meta-llama/llama-3-8b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Questions

How much does Llama 3 8B Instruct cost via API?
Through OpenKey, Llama 3 8B Instruct costs $0.144 per 1M input tokens and $0.144 per 1M output tokens. That is the provider price ($0.140 / $0.140) plus a flat 3% fee — nothing else.
What is Llama 3 8B Instruct's context window?
Llama 3 8B Instruct accepts up to 8K tokens of context.
Is Llama 3 8B Instruct OpenAI-compatible?
Yes. Send requests to OpenKey's /v1/chat/completions endpoint with model "meta-llama/llama-3-8b-instruct" using any OpenAI SDK — only the base URL and API key change.
What inputs does Llama 3 8B Instruct support?
Llama 3 8B Instruct accepts text input and produces text output. Its knowledge cutoff is Dec 31, 2023.

More from Meta AI

All Meta AI models →