Meta Llama/operational

Meta: Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Input / output per 1M

$0.40/$0.40

Get an API key

function-callingopen weights

131K

Context window

tokens

16K

Max output

tokens per reply

80ms

Time to first token

p50, EU region

$0.40

Output price

per 1M tokens

Fit

Where this model earns its place

function calling

Tool use and structured output — dependable JSON for agent loops, RAG pipelines, and workflow automation.

Data handling

Requests are processed in the EU. Prompts are not used for training, and logs follow the retention period in your contract — zero-retention is available on request.

Specifications

Model

Model ID: meta-llama/llama-3.1-70b-instruct
Provider: Meta Llama
Context length: 131K
Max output: 16K
Modality: text
Licence: Open Weight

Commercial

Input: $0.40
Output: $0.40
Cached input: —
Deployment: serverless
Availability: operational
Last updated: 2026-10-26

Cost

What a month actually costs

Workload	Input tokens	Output tokens	Monthly cost
Prototype	1.0M	250K	$0.50
Production	50.0M	12.0M	$24.80
At scale	500.0M	120.0M	$248.00

Illustrative volumes at list price, excluding cached-input discounts and any committed-use agreement. Your invoice shows the same rates, itemised per key.

Cheaper by caching

Repeated prompts — system instructions, retrieved context, few-shot examples — are billed at the cached-input rate where the model supports it. On long system prompts this is typically the largest single line-item saving.

API

Same SDK, different base URL

cURL

curl https://api.itciphtech.com/v1/chat/completions \
  -H "Authorization: Bearer $CIPHER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-70b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

TypeScript

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.itciphtech.com/v1",
  apiKey: process.env.CIPHER_API_KEY,
});

const res = await client.chat.completions.create({
  model: "meta-llama/llama-3.1-70b-instruct",
  messages: [{ role: "user", content: "Hello!" }],
});

Alternatives

Close substitutes in the catalog

Meta: Llama 3.1 8B Instruct

Meta Llama

Context

131K

In / out

$0.05 / $0.08

TTFB

58ms

View

Meta: Llama 3.2 3B Instruct

Meta Llama

Context

131K

In / out

$0.05 / $0.33

TTFB

91ms

View

Meta: Llama 3.3 70B Instruct

Meta Llama

Context

131K

In / out

$0.10 / $0.32

TTFB

69ms

View

Meta: Llama 4 Maverick

Meta Llama

Context

128K

In / out

$0.19 / $0.65

TTFB

113ms

View

Need this model on dedicated hardware?

Run it single-tenant, inside your own network boundary, with the operations handled by us.

Private hosting