Thursday, November 18, 2010

Auditor diagnoses Queensland Government's IT ills

Queensland’s Auditor General Glen Poole has issued a report tabled in parliament yesterday which is sharply critical of the way Queensland Government implement their computer systems. The report “No 13 for 2010” is the result of audits to end October. Among the many government audits in the report, the one of biggest interest to the media is the one on Queensland Health’s troubled new payroll system. But what the auditor is really saying is the fact the problems Health had were replicated in other agencies with their new payroll systems and there are some serious issues with the IT outsourcing process.

The same audit report said QBuild’s (Department of Public Works) Ellipse system was implemented to replace their existing operational, financial and payroll systems at a cost of approximately $32m and “significant issues arose after this system was implemented.” The auditor found project management controls were not consistently applied across the system implementation lifecycle while governance structures were not effective in communicating complete and timely information. The auditor said the level of testing performed was also unsatisfactory given QBuild’s financial reporting and payroll processes “were dependent on the rigour of this testing.”

The audit said his QBuild findings were consistent with what he found at QH and between them they demonstrate “a critical need for improved system implementation skills within the public sector.” The original idea was whole of government implementation which was changed to a project governance arrangement in June 2009.

After many years of design, development and testing, Queensland Health implemented a new payroll system on 14 March this year. Poor requirements gathering and system design meant there were over 47 change requests to the original scope, delaying the project by 18 months and making the project three times more expensive than it was original estimated. Overall QH spent $100 million on their new payroll system and associated whole of government initiatives.

An auditor’s opinion on the QH debacle was issued in Report No 7 in June 2010 after significant deficiencies were found in the completeness, accuracy and timely payment of employees when the system first rolled out. The audit found the deficiencies arose as a result of “weakness in internal control” and represented “material non-compliance with the prescribed requirements for the department to maintain an appropriate expense management system.

The system was clearly not ready to implement on 14 March however the Go Live decision was made after project partners IBM and CorpTech signed off the technical readiness while the business signed off on the Acceptance Testing report. Because of the project’s complex outsourcing, it was acknowledged significant contractual and commercial challenges would occur if the project was further delayed. Yet there were no contingency plans for business cut-over and no testing done in the production environment to determine whether the pays were correct prior to the first live payroll being produced. Nor did anyone consider the impact of the changed business rules in the new system on business practice.

The initial problems after implementation were so bad and so widespread, QH were forced to establish a Payroll Stabilisation Project in conjunction with KPMG. In yesterday’s report the auditor said the Stabilisation Project has now ended and the project has transitioned into the Payroll Improvement Program. QH activities have resulted in a declining trend in payroll enquiries and outstanding transactions. But Poole cautions “close monitoring of the transaction backlog and further improvement in the efficiency of business processes is still required.” Importantly however, the audit found the deficiencies did not have a material effect on the completeness and accuracy of the reported employee expenses.

The recommendations for the QBuild project closely mirror what was recommended for QH in Report No 7. The first key point is a lack of a project management methodology that includes requirements for project reporting, including key risks and issues. Poole also recommends government departments engage an experienced project manager with strong enterprise resource planning implementation experience. He said strong governance frameworks should be established to ensure there is separation between the roles of the senior supplier and the project manager while suppliers should only be paid on deliverables satisfying acceptance criteria.

Some of his recommendations may be unrealistic (eg “user acceptance testing should be completed prior to commencing user training”) however most of it is basic project management methodology. Given that experience of such methodology is plentiful at QH, CorpTech and IBM, it may be that too many cooks spoiled this particular broth. Serious questions need to be asked about the efficacy of outsourcing large government IT projects.

Disclosure: this writer is a former employee of IBM and worked very briefly – and unenjoyably – on the QHIT project before tendering his resignation in April 2009.

No comments: