Skip to content

Notes from building production AI

Writing about agentic systems, RAG, evaluation, and reliability — the practical lessons behind the work, published as they happen.

Illustration of are state space models better than transformers - A mechanical balance scale with two platforms. LeftMamba Architecture

9 min read

Are State Space Models Better Than Transformers? A Technical Comparison

Discover whether state space models like Mamba outperform transformers for long-context tasks, inference speed, and memory efficiency. Learn when each wins.

I spent three weeks last year convinced I'd found the silver bullet for our inference costs. We were running a document processing pipeline that choked on anything over 32K tokens - the KV cache alone was eating our GPU memory alive. Mamba looked perfect on paper: linear scaling, constant memory during generation, benchmarks showing 5x throughput improvements. Then we actually…

Read more

Keep exploring

AboutSkillsServicesProjectsExperienceCertificationsFAQContact