Llama 3.1 70B Instruct

meta-llama/llama-3.1-70b-instruct

JSON

Specification

Published by the vendor; the platform bills at the target's declared price.

Llama 3.1 70B Instruct

open weights tools

Meta meta-llama/llama-3.1-70b-instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Input $/1M: $0.40
Output $/1M: $0.40
Context: 131K
Max output: 16K
Released: Jul 23, 2024
Modalities: text

On this deployment

No routing target resolves to this model yet. Declare one and the router picks it up without retraining.

Not routable here yet

Add a target with metadata.model set to this id.

targets.yamlyaml

# targets.yaml - declare a target that runs Llama 3.1 70B Instruct
targets:
  - id: llama-3-1-70b-instruct
    kind: llm
    name: Llama 3.1 70B Instruct
    metadata:
      model: meta-llama/llama-3.1-70b-instruct          # links the target to this catalogue entry
    capabilities:
      domains: [general]
      supports_tools: true
      context_window: 131072
    cost:
      usd_per_1k_tokens: 0.000400

Price among Meta models

Input list price per million tokens; Llama 3.1 70B Instruct is the most expensive of 8 listed.

1
Llama 3.2 1B Instruct
$0.03
2
Llama 3.2 3B Instruct
$0.05
3
Llama 3.1 8B Instruct
$0.05
4
Llama 4 Scout
$0.10
5
Llama 3.3 70B Instruct
$0.10
6
Llama Guard 4 12B
$0.18
7
Llama 4 Maverick
$0.20
8
Llama 3.1 70B Instruct
$0.40

More from Meta

Other models by the same vendor in the catalogue.