Government trial found developers vastly overestimate AI's time-saving power
A trial found software developers took 19 per cent longer with AI. Yet they believed it saved them time.
Governments can run experiments to find which policies actually work. This is better than relying on hunches.
In one striking study, experienced software developers completed real programming tasks. Some had AI assistance.
Some did not. Developers with AI took about 19 per cent longer to finish.
A research group had surprising news. Developers still believed AI had saved them 20 per cent of their time.
This happened even after completing the work. The gap shows something important.
Our sense of technology can mislead us about how much it really helps. Other government trials tested messaging strategies.
A text message sent before a Services Australia call raised contact rates from 52 to 64 per cent. A banking trial also worked.
Banks told customers clearly about lower loan rates available to them. This lifted inquiries by 50 per cent.
- 19 per cent slower
- AI impact on speed
- Believed 20 per cent saved
- Developer perception
- 52 to 64 per cent contact rate
- Services Australia SMS trial
- 50 per cent more inquiries
- Banking rate messaging
Why it mattersCareful testing, not hunches, reveals which policies and tools actually work. It saves money and stops failed programs.
AustraliaAustralian government can now evaluate whether new policies and tools genuinely improve outcomes before rolling them out nationwide.
✓ Claims checked against the source and corrected before publish. checked 2 h ago
