MELBOURNE: Deloitte Australia will partially refund the 440,000 Australian dollars ($290,000) paid by the Australian government for a report that was riddled with apparent AI-generated errors, including a fabricated quote from a federal court judgment and references to nonexistent academic research papers.
The financial services firm’s report to the Department of Employment and Workplace Relations was initially published on the department's website in July. A revised version was released on Friday after Chris Rudge, a University of Sydney researcher of health and welfare law, said he alerted the media that the report was “full of fabricated references.”
Deloitte reviewed the 237-page report and “confirmed some footnotes and references were incorrect,” the department said in a statement Tuesday.
“Deloitte has agreed to repay the final installment under its contract,” the department said. The amount will be made public after the refund is processed.
Asked to comment on the inaccuracies, Deloitte told The Associated Press in a statement that the “matter has been resolved directly with the client.”
Deloitte did not respond to questions about whether the errors were generated by artificial intelligence.
A tendency for generative AI systems to fabricate information is known as hallucination.
The report reviewed the department’s IT systems and their use of automated penalties in Australia's welfare system. The department said the “substance” of the report had been maintained and that there were no changes to its recommendations.
The revised version included a disclosure that a generative AI language system, Azure OpenAI, was used in writing the report.
Quotes attributed to a federal court judge were removed, as were references to nonexistent reports attributed to law and software engineering experts.
Rudge said he found up to 20 errors in the first version of the report.
The first error that caught his attention incorrectly stated that Lisa Burton Crawford, a professor of public and constitutional law at the University of Sydney, had written a nonexistent book with a title suggesting it was outside her field of expertise.
“I instantaneously knew it was either hallucinated by AI or the world’s best-kept secret because I’d never heard of the book and it sounded preposterous,” Rudge said.
Work by his academic colleagues had been used as “tokens of legitimacy,” cited by the report’s authors but not read, Rudge said, adding that he considered misquoting a judge a more serious error in a report that was effectively an audit of the department’s legal compliance.
“They’ve totally misquoted a court case, then made up a quotation from a judge, and I thought, well, hang on — that’s actually a bit bigger than academics’ egos. That’s about misstating the law to the Australian government in a report they rely on. So I thought it was important to stand up for diligence,” Rudge said.
Senator Barbara Pocock, the Australian Greens party’s spokesperson on the public sector, said Deloitte should refund the entire AU$440,000 ($290,000).
Deloitte “misused AI and used it very inappropriately — misquoted a judge, used references that are nonexistent,” Pocock told the Australian Broadcasting Corp. “I mean, the kinds of things that a first-year university student would be in deep trouble for.”
.jpg)
.jpg)
.jpg)
.jpg)
