geir/home-lab
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
home-lab/packages
History
Geir Okkenhaug Jerstad 2e193e00e9 feat: Complete Ollama CPU optimization and TaskMaster consolidation 
🚀 Major Performance Improvements:
- Increased CPU quota from 800% to 2000% (20/24 cores)
- Enhanced threading: OMP/MKL/BLAS threads from 8 to 20
- Upgraded context length from 4096 to 8192 tokens
- Deployed optimized 7-8B parameter models

🔧 Infrastructure Enhancements:
- Updated ollama.nix with comprehensive CPU optimizations
- Added memory-efficient q8_0 KV cache configuration
- Implemented systemd resource limits and I/O optimizations
- Forced cpu_avx2 library for optimal performance

📊 Performance Results:
- Achieved 734% CPU utilization during inference
- Maintained stable 6.5GB memory usage (19.9% of available)
- Confirmed 3-4x performance improvement over baseline
- Successfully running qwen2.5-coder:7b and deepseek-r1:7b models

🎯 TaskMaster Integration:
- Consolidated duplicate .taskmaster configurations
- Merged tasks from packages folder to project root
- Updated MCP service configuration with optimized models
- Verified AI-powered task expansion functionality

📝 Documentation:
- Created comprehensive performance report
- Documented optimization strategies and results
- Added monitoring commands and validation procedures
- Established baseline for future improvements

✅ Deployment Status:
- Successfully deployed via NixOS declarative configuration
- Tested post-reboot functionality and stability
- Confirmed all optimizations active and performing optimally
- Ready for production AI-assisted development workflows
2025-06-18 14:22:08 +02:00
..
.cursor feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00
.roo feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00
lab-tool feat: Complete Ollama CPU optimization for TaskMaster AI 2025-06-18 13:08:24 +02:00
mcp-server grokking simplicity and refactoring 2025-06-16 13:43:21 +02:00
.env.example feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00
.instructions.md grokking simplicity and refactoring 2025-06-16 13:43:21 +02:00
.roomodes feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00
.windsurfrules grokking simplicity and refactoring 2025-06-16 13:43:21 +02:00
claude-task-master-ai.nix feat: Add deploy-rs integration with basic configuration 2025-06-15 10:03:56 +02:00
default.nix feat: Complete Ollama CPU optimization for TaskMaster AI 2025-06-18 13:08:24 +02:00
flake.lock feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00
flake.nix feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00
lab-tools.nix grokking simplicity and refactoring 2025-06-16 13:43:21 +02:00
lab_tool_howto.md feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00
RAG-MCP-TaskMaster-Roadmap.md Some research into building a RAG 2025-06-16 08:58:52 +02:00
README.md feat: Complete migration to GNU Guile Scheme with MCP integration 2025-06-15 22:17:47 +02:00

README.md