- Using AI for deterministic tasks like data formatting is inefficient, costly, and error-prone compared to simple scripts.
- Prompting is fast for one-off tasks but becomes expensive and non-deterministic when used for recurring jobs, leading to high token costs and context bloat.
- Tasks should be categorized as probabilistic (requiring judgment) for AI agents or deterministic (exact and repeatable) for apps to optimize costs and performance.
- Avoid using AI memory notes as a database for structured data; instead, use real databases for structured, high-volume data and notes for unstructured, interpretive context.