Australia's Treasury Copilot Trial: ROI Positive, But Employee Confidence Lags

A 14-week trial of Microsoft 365 Copilot by Australia's Department of the Treasury showed a positive return on investment (ROI), but employee confidence in its workplace effectiveness fell short. The trial revealed Copilot's actual applicability was lower than anticipated, with most participants using it less than three times a week. While Copilot excelled at basic administrative tasks like summarizing information and generating meeting minutes, it struggled with more complex tasks. The Treasury concluded that more careful staff selection, comprehensive training, and ongoing monitoring of AI's impact are crucial. The findings also hinted that AI-as-a-service might not be suitable for organizations handling sensitive data like the Treasury, suggesting on-premises AI infrastructure may be preferable.