From Dev.to
Hot experts, cold RAM: a big MoE on a box with more memory than VRAM
Two budgets, and only one of them is expensive Every local deployment spends against two budgets at once: the size of the model and the price of That is what Strata is for. It is forked from llama.c...