knox revised this gist . Go to revision
1 file changed, 17 insertions
LLaMA-Factory-4.md(file created)
| @@ -0,0 +1,17 @@ | |||
| 1 | + | | Mandatory | Minimum | Recommend | | |
| 2 | + | | ------------ | ------- | --------- | | |
| 3 | + | | python | 3.8 | 3.11 | | |
| 4 | + | | torch | 1.13.1 | 2.4.0 | | |
| 5 | + | | transformers | 4.41.2 | 4.43.4 | | |
| 6 | + | | datasets | 2.16.0 | 2.20.0 | | |
| 7 | + | | accelerate | 0.30.1 | 0.32.0 | | |
| 8 | + | | peft | 0.11.1 | 0.12.0 | | |
| 9 | + | | trl | 0.8.6 | 0.9.6 | | |
| 10 | + | ||
| 11 | + | | Optional | Minimum | Recommend | | |
| 12 | + | | ------------ | ------- | --------- | | |
| 13 | + | | CUDA | 11.6 | 12.2 | | |
| 14 | + | | deepspeed | 0.10.0 | 0.14.0 | | |
| 15 | + | | bitsandbytes | 0.39.0 | 0.43.1 | | |
| 16 | + | | vllm | 0.4.3 | 0.5.0 | | |
| 17 | + | | flash-attn | 2.3.0 | 2.6.3 | | |
Newer
Older