Meta Llama 3.3 70B on W&B Inference
Price per 1M tokens
$0.71 (input)
$0.71 (output)
Parameters
70B
Context window
128K
Release date
Dec 2024
Meta Llama 3.3 70B inference details
Llama 3.3 70B excels in multilingual conversational interactions, providing strong capabilities in detailed instruction-following, coding tasks, and mathematical reasoning. Ideal for general-purpose chatbots, complex text-based queries, and multilingual user interactions.
Created by: Meta
License: llama3.3
🤗 model card: Llama-3.3-70B-Instruct
import openai
import weave
# Weave autopatches OpenAI to log LLM calls to W&B
weave.init("<team>/<project>")
client = openai.OpenAI(
# The custom base URL points to W&B Inference
base_url='https://api.inference.wandb.ai/v1',
# Get your API key from https://wandb.ai/authorize
# Consider setting it in the environment as OPENAI_API_KEY instead for safety
api_key="<your-apikey>",
# Team and project are required for usage tracking
project="<team>/<project>",
)
response = client.chat.completions.create(
model="meta-llama/Llama-3.3-70B-Instruct",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Tell me a joke."}
],
)
print(response.choices[0].message.content)
Meta Llama 3.3 resources
A primer on building successful AI agents
W&B Inference powered by CoreWeave guide
