282 GB
53 files
Updated 3 months ago
Name
Size
.gitattributes1.52 kB
xet
README.md433 Bytes
xet
checklist.chk528 Bytes
xet
consolidated.00.pth17.6 GB
xet
consolidated.01.pth17.6 GB
xet
consolidated.02.pth17.6 GB
xet
consolidated.03.pth17.6 GB
xet
consolidated.04.pth17.6 GB
xet
consolidated.05.pth17.6 GB
xet
consolidated.06.pth17.6 GB
xet
consolidated.07.pth17.6 GB
xet
params.json221 Bytes
xet
tokenizer.model2.18 MB
xet
README.md

This repository is a early-access checkpoint for Llama 3.1 70B. This repo contains only Meta provided original checkpoints. Hugging Face checkpoints are available here.

You can invoke them via torchrun by doing the following:
CHECKPOINT_DIR=~/.llama/checkpoints/Llama3.1-70B-Instruct-2014-12/
pip install torch fairscale
torchrun --nproc_per_node 8 `which example_chat_completion` "$CHECKPOINT_DIR"
Total size
282 GB
Files
53
Last updated
Jul 8
Pre-warmed CDN
US EU US EU

Contributors