Groowe Groowe BETA / Newsroom
⏱ News is delayed by 15 minutes. Sign in for real-time access. Sign in

CodeRabbit’s “State of AI vs Human Code Generation” Report Finds That AI-Written Code Produces ~ 1.7x More Issues Than Human Code

businesswire.com
NVDA NVIDIA's venture capital arm is mentioned as an investor in CodeRabbit, but the article does not provide specific sentiment towards NVIDIA's stock performance or business operations.

SAN FRANCISCO--( BUSINESS WIRE)--CodeRabbit, the leading AI-powered code review platform, today released the “State of AI vs Human Code Generation”, a comprehensive new report analyzing the quality of AI-generated code in real-world software development. The study, which analyzed 470 real-world open source pull requests, found that AI-generated code introduces significantly more defects across every major category of software quality – including logic, maintainability, security, and performance – compared to human-authored code. The report can be downloaded here.

The study found that AI-generated code introduces significantly more defects across every major category of software quality – including logic, maintainability, security, and performance – compared to human-authored code.

Despite several high-profile 2025 postmortems identifying AI-authored or AI-assisted changes as contributing factors, before this report, there was little hard data on which issues AI introduces most often or how those patterns differ from human-written code. This study fills that gap and provides clear insight into the specific risks and failure modes present in AI-generated pull requests.

Key Findings:

“These findings reinforce what many engineering teams have sensed throughout 2025,” said David Loker, Director of AI, CodeRabbit. “AI coding tools dramatically increase output, but they also introduce predictable, measurable weaknesses that organizations must actively mitigate.”

The use of AI code generation is rapidly increasing, with over 90% of developers now reporting to use these tools to boost productivity and handle routine tasks. Companies can experience significant gains, such as 10% faster engineering speed and major reductions in time spent on repetitive work by using these tools, and its value is continuing to be realized. To help organizations mitigate risks, the report also outlines practical steps for teams adopting AI-assisted development, including:

About the Report

The analysis draws exclusively from 470 open-source GitHub PRs, using CodeRabbit’s structured review taxonomy to classify issues across logic, maintainability, security, and performance categories. The PRs include 320 that were labelled as AI-coauthored and 150 as human-only. Statistical comparisons were made using normalized issue rates and Poisson rate ratios with 95% confidence intervals.

Supporting Resources

To learn more about AI-powered code review and keep up-to-date on the latest resources and features, check out:

About CodeRabbit

CodeRabbit is the category-defining platform for AI code reviews, built for modern engineering teams navigating the rise of AI-generated development. By delivering context-aware reviews that pull in dozens of points of context, CodeRabbit provides the most comprehensive reviews coupled with customization features to tailor your review to your codebase and reduce the noise. CodeRabbit helps organizations catch bugs, strengthen security, and ship reliable code at speed. Trusted by thousands of companies and open-source projects worldwide, CodeRabbit is backed by Scale Venture Partners, NVentures: NVIDIA's venture capital arm, CRV, Harmony Partners, Flex Capital, Engineering Capital and Pelion Venture Partners. Learn more at www.coderabbit.ai.