a month ago
- AI assistants are most valuable for reviewing code and finding bugs, with frontier models performing well.
- Refactoring tasks benefit from AI, reducing the cost of fixing design mistakes, but review can be challenging due to mixed-in incorrect changes.
- Writing code together with AI is problematic because AI makes poor decisions and often disregards instructions, though future harnesses may improve collaboration.
- AI is effective for one-off scripts and small tasks where output can be easily verified, but fails for complex projects like implementing board game rules.