METR is revising its methodology for measuring AI's impact on developer productivity after finding that recent experimental data is biased by participant attrition and payment changes. The organization acknowledges that while early 2025 data showed a slowdown, current conditions suggest AI tools may now be providing significant speedups, though precise quantification remains difficult.
Background
METR (Modeling Evaluation and Transparency Research) conducts independent studies on AI safety and capabilities, including tracking how AI tools affect software engineering workflows over time.
- Source
- Lobsters
- Published
- Jul 17, 2026 at 08:51 PM
- Score
- 6.0 / 10