geir/configs
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

local ollama with codestral

Browse source
This commit is contained in:
Geir Okkenhaug Jerstad 2024-12-15 14:14:45 +01:00
parent d0fb9ece33
commit e74b033549
5 changed files with 246 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

10
workstation/ollama.nix
View file

@ -1,4 +1,10 @@
{ pkgs, ... }:
{ configs, pkgs, ... }:
{
services.ollama = {
enable = true;
home = "/home/geir/virtual/ollama";
package = pkgs.ollama-rocm;
acceleration = "rocm";
loadModela = [ "codestral" ];
};
}