Skip to main content

AI Engineering Insights: Page 2

Timeline of proof of concept, data, evaluation, hardening and launch phases across 24 weeks

From PoC to Production: An Honest Engineering Timeline

One of the most frequent conversations we have with new clients starts the same way: "We have a work...

Trust boundary between untrusted inputs, the LLM and sensitive systems it can reach

Securing AI Applications: The Threat Model You Haven't Thought About

Enterprise teams investing in AI security are mostly focused on the wrong things. Compliance checkli...

Frozen 4-bit base model with trainable LoRA adapters and a single 80 GB GPU memory budget

Fine-Tuning Llama 3 with QLoRA: A Practical Guide

QLoRA (Quantized Low-Rank Adaptation) changed the economics of LLM fine-tuning. Before QLoRA, fine-t...

Synchronous, streaming and async job response patterns for AI-powered APIs

Designing AI-Powered APIs: Patterns and Pitfalls

Building an API that wraps an AI model sounds straightforward — take input, call model, return outpu...

Orchestrator delegating to researcher, writer and validator agents over a shared message log

Building a Multi-Agent AI System That Actually Works in Production

The demos for multi-agent AI frameworks look incredible. Autonomous agents planning, executing, and ...

Cost levers alongside the break-even point where self-hosted inference beats API pricing

GPU Inference on a Budget: Optimizing Costs for Self-Hosted Models

Once your AI application reaches sufficient scale, the math on self-hosted model inference often sta...