knox revised this gist . Go to revision
1 file changed, 9 insertions
LLaMA-Factory-5.md(file created)
| @@ -0,0 +1,9 @@ | |||
| 1 | + | | Method | Bits | 7B | 13B | 30B | 70B | 110B | 8x7B | 8x22B | | |
| 2 | + | | ----------------- | ---- | ----- | ----- | ----- | ------ | ------ | ----- | ------ | | |
| 3 | + | | Full | AMP | 120GB | 240GB | 600GB | 1200GB | 2000GB | 900GB | 2400GB | | |
| 4 | + | | Full | 16 | 60GB | 120GB | 300GB | 600GB | 900GB | 400GB | 1200GB | | |
| 5 | + | | Freeze | 16 | 20GB | 40GB | 80GB | 200GB | 360GB | 160GB | 400GB | | |
| 6 | + | | LoRA/GaLore/BAdam | 16 | 16GB | 32GB | 64GB | 160GB | 240GB | 120GB | 320GB | | |
| 7 | + | | QLoRA | 8 | 10GB | 20GB | 40GB | 80GB | 140GB | 60GB | 160GB | | |
| 8 | + | | QLoRA | 4 | 6GB | 12GB | 24GB | 48GB | 72GB | 30GB | 96GB | | |
| 9 | + | | QLoRA | 2 | 4GB | 8GB | 16GB | 24GB | 48GB | 18GB | 48GB | | |
Newer
Older