Topic

inference

2 articles

Cover for Bonsai 27B on RTX PRO 6000 vs DGX Spark: what actually works
aigpuJul 16, 2026

Bonsai 27B on RTX PRO 6000 vs DGX Spark: what actually works

Real Bonsai 27B benchmarks on an RTX PRO 6000 and a DGX Spark, including the supported llama.cpp setup, ternary vs 1-bit results, and speculative decoding.

Saiyam PathakSaiyam Pathak · 14 min
Read →
Cover for mlxcel: A Rust-Native Inference Engine for Apple Silicon, Tested on My M1 Max
mlxapple-siliconMay 29, 2026

mlxcel: A Rust-Native Inference Engine for Apple Silicon, Tested on My M1 Max

Day-one deep dive into mlxcel v0.1.0, a Rust-native MLX inference engine. Real M1 Max benchmarks vs mlx-lm and Ollama on Llama 3.2 3B and Qwen 2.5 7B, with architecture diagrams and an honest take on TurboQuant.

Saiyam PathakSaiyam Pathak · 28 min
Read →