a month ago
- A comprehensive guide to building autonomous AI systems, covering from foundations to production deployment.
- Covers LLM substrate (transformer architecture, GPU systems, training, fine-tuning, compression, inference optimization).
- Develops alignment and reasoning layer (RLHF, PPO, DPO, GRPO, reward modeling, RL for reasoning models).
- Focuses on agentic AI including agentic training, RAG, memory systems, agent harness design, and design patterns.