InfoQ AI/ML/Data Eng
1 sourcesAkka Tests Spec-Driven AI Delivery Across 65 Open Source Projects
Akka conducted an experiment using 65 open-source projects to examine how specification structure, context, model selection, automated validation, and delivery guardrails affect AI-assisted software porting. The study measured time, token use, code size, test parity, and performance, finding substantial variation across models, effort levels, and project types.