Results for "llama.cpp"

Tutorials

Ollama Just Switched to MLX on Apple Silicon and My M2 MacBook Air Went from Sluggish to Scary Fast — Benchmarks Included

I have a confession. Until about 36 hours ago, I was running Ollama on my M2 MacBook Air and quietly pretending the token generation speed was "fine." It was no...

Tutorials

A Guy Built a Custom C Engine That Runs a 397 Billion Parameter AI Model on a Regular MacBook — Here Is How Flash-Moe Actually Works

A Guy Built a Custom C Engine That Runs a 397 Billion Parameter AI Model on a Regular MacBook Last Wednesday at around 11 PM, I was scrolling through Hacker Ne...