book
/
kubernetes-guide
mirror of https://github.com/imroc/kubernetes-guide.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

update at 2024-04-26 19:54:52

pull/158/head
roc 2024-04-26 19:54:52 +08:00
parent d8e1a71645
commit fc05e59d74
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
content/cases/llama3.md
View File

@ -58,6 +58,10 @@ pulling manifest
Error: pull model manifest: Get "https://registry.ollama.ai/v2/library/llama3/manifests/70b": dial tcp 172.67.182.229:443: i/o timeout Error: pull model manifest: Get "https://registry.ollama.ai/v2/library/llama3/manifests/70b": dial tcp 172.67.182.229:443: i/o timeout
``` ```
### 70b 的速度非常慢
70b 是 700 亿参数的大模型，使用 CPU 运行不太现实，使用 GPU 也得显存足够大，实测用 32G 显存的显卡运行速度也非常慢，建议至少 40G（比如 A100）。
## 参考资料 ## 参考资料
* Llama3 模型库：https://ollama.com/library/llama3 * Llama3 模型库：https://ollama.com/library/llama3