Posted inLocal LLMs
Self-hosting a 35B MoE for a 20-person team on one desktop box: what it took and what it does (all open source)
Implementing a 35-Billion Parameter Mixture of Experts Model for Small Teams: A Practical Guide (Open Source) In recent months, we embarked on an ambitious project: deploying a large language model…









