Roar AI
DiscordGet started
All models
Meta · Open weights

Llama 3.1 8B

Llama 3.1 8B costs $0.0714 per million input tokens and $0.1143 per million output tokens on Roar AI. Meta’s small Llama: quick and very cheap for simple, high-volume text work.

Input$0.0714per 1M tokens
Output$0.1143per 1M tokens
Context window128Ktokens

Llama 3.1 8B API pricing

Input$0.0714 per 1M tokens
Output$0.1143 per 1M tokens

Example: 1,000 requests with 3,000 input and 1,000 output tokens each cost $0.33. Every rate is published and stays the same from one request to the next. See every model.

Rates as of 20 November 2026.

Specs

Made byMeta
ReleasedJuly 2024
TypeChat
Context window128K tokens
ReadsText
Thinks before answeringNo
WeightsOpen (Llama 3.1 Community License)
Size8B, dense
Processed inGlobal
Model idllama-3.1-8b

About Llama 3.1 8B

Llama 3.1 8B is the smallest model in Meta’s Llama 3.1 family and one of the most widely used open models anywhere. It has no reasoning mode and makes no pretence of one: it is fast, very inexpensive, follows instructions well for its size (80.4% on IFEval) and handles a 128K-token context.

Use it where the task is simple and the volume is high, such as routing messages, tagging, short summaries and pulling out a few fields. For anything that needs real reasoning, a 2026 small model will do much better.

What is Llama 3.1 8B good for?

  • Routing, tagging and extraction at very low cost.
  • Short summaries and simple chat.
  • Steps in a pipeline where speed matters more than depth.

Llama 3.1 8B limitations

  • Its knowledge stops at December 2023.
  • Weak at maths and multi-step reasoning next to newer small models.
  • Meta’s licence carries use restrictions; it is not open source in the OSI sense.

How to use the Llama 3.1 8B API

Use the OpenAI SDK you already have: point it at Roar AI and set the model name. Read the docs.

from openai import OpenAI

client = OpenAI(base_url="https://api.roar-ai.com/v1", api_key="roar_live_…")

reply = client.chat.completions.create(
    model="llama-3.1-8b",
    messages=[{"role": "user", "content": "Summarise this contract in plain English."}],
)

Llama 3.1 8B FAQ

How much does Llama 3.1 8B cost?

Input is $0.0714 per 1M tokens; output is $0.1143 per 1M tokens. For example, 1,000 requests with 3,000 input and 1,000 output tokens each cost $0.33.

Can I use Llama 3.1 8B alongside other models?

Yes. Every model on Roar AI is on the same API key and the same monthly invoice, so switching from Llama 3.1 8B to another model only means changing the model name in your code.

Is Llama 3.1 8B open source?

Its weights are open under the Llama 3.1 Community License licence, so you could run it yourself. Through Roar AI you call it like any other model, with no servers to manage.

What is the context window of Llama 3.1 8B?

Llama 3.1 8B can read up to 128K tokens in one request.

Can Llama 3.1 8B read images and PDFs?

It reads text only. You can still send it a PDF: Roar AI turns each page into text first, at no extra charge. Scanned pages need a model that can see images.

Start using Llama 3.1 8B

Create a free account, get an API key and call Llama 3.1 8B with the OpenAI SDK.