AI code review: Should the author be the reviewer?
a year ago
- #AI Code Review
- #Pull Requests
- #Software Development
- Daksh, co-founder of Greptile, uses AI to review pull requests for bugs and anti-patterns.
- A power law exists in the number of PRs opened by Greptile users, with an AI bot (Devin) opening more PRs than any human.
- The article questions whether AI should review its own code, considering statelessness and scaffolding differences.
- AI-generated code tends to be sloppier due to imperfect prompting and less careful human review.
- AI-generated bugs are different from human-introduced bugs and are harder for humans to catch.
- AI is better than humans at finding bugs, with the Anthropic Sonnet model outperforming skilled engineers in tests.
- The article concludes with a disclaimer about Greptile selling an AI code reviewer, emphasizing intellectual honesty.