Topic

Local AI

Operating local models with explicit privacy, hardware, and deployment trade-offs.

Articles

6 articles

Local AI

Choosing a Cache-Aware Prompt Accounting Boundary for Ollama

A practical recording boundary for Ollama usage: keep requested context, observed prompt tokens, cache-read tokens, and prompt-evaluation time in separate fields, and collect streaming usage only from the terminal chunk.