Notes on AI engineering, LLMs, and building software that ships.
Classifying 2.5M Shopify stores with the OpenAI API sounded ruinously expensive. Here's how model choice, caching, and a cheap pre-filter brought the bill down ~100×.
3 min read