AMD Vega 56 ubuntu 24.04.2 安装大模型
·2 min read
ubuntu 24.04.2 ( 测试中 )
24.04.4 肯定不行
安装AMD的驱动
方法
sudo apt update
sudo apt install "linux-headers-$(uname -r)" "linux-modules-extra-$(uname -r)"
sudo apt install python3-setuptools python3-wheel
sudo usermod -a -G render,video $LOGNAME # Add the current user to the render and video groups
wget https://repo.radeon.com/amdgpu-install/6.3.3/ubuntu/noble/amdgpu-install_6.3.60303-1_all.deb
sudo apt install ./amdgpu-install_6.3.60303-1_all.deb
sudo apt update
sudo apt install amdgpu-dkms rocm
地址:
Linux® Drivers for AMD Radeon™ and Radeon PRO™ Graphics
下载amdgpu-install_6.3.60304-1_all.deb
安装
~$ sudo amdgpu-install --no-dkms
~$ sudo apt install rocm-dev
~$ sudo reboot
等待重启
然后运行
~$ /opt/rocm/bin/rocminfo
可以查看显卡状态。
二、安装ollama
首先安装ollama
可以从ubuntu自带的应用中心安装,
安装完成后一定要到github安装amd版本的ollama相关库
GitHub - ollama/ollama: Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
ollama/docs/linux.md at main · ollama/ollama · GitHub
找到
AMD GPU install
If you have an AMD GPU, also download and extract the additional ROCm package:
curl -L https://ollama.com/download/ollama-linux-amd64-rocm.tgz -o ollama-linux-amd64-rocm.tgz
sudo tar -C /usr -xzf ollama-linux-amd64-rocm.tgz
按照方法下载,下载较慢