Last month our company announced its new Agility Awards – and the first set of awards were presented for five Agile projects that had been completed by customers and partners using OutSystems’ Agile Platform and employing Agile methodology.
The question I want to pose is what are good criteria for assessing a successful Agile project? This question builds on Mike’s recent post about criteria for measuring an Agile project manager’s success – and we got lots of great responses and ideas in the comments.
The data points being used by the OutSystems team to evaluate whether projects are eligible for an award are:
1. Size & scope of project: the project should be of medium to large scale (over 40,000 software units in size.)
2. Project definition & objectives: the project should deliver significant and measurable business value.
3. Project approach: the project should have been run based on Agile practices, following an iterative development approach with regular end user involvement.
4. Project metrics: a baseline of project metrics must be submitted in order to measure the impact of using Agile to deliver the application.
The team then use these data points to assess whether an Agile approach was employed to deliver the project on time, on budget, with 100% user adoption and delivered true value to the business and IT.
Is this list a reasonable set of data points for measuring the success of an agile project?
BTW – Here are some examples of the results from the initial set of award winners (read more details here):
XDx – Analysis Request Management System
Time-to-market: 6 weeks + 1 for launch; Number of Agile sprints: 3
Customer quote: “This was our first Agile project and it achieved the two key business goals: avoiding tracking errors and improving real-time data consistency for our studies. Most importantly, we were able to deliver this value to the business in a record time, exceeding both developer’s and user’s expectations and establishing Agile as the preferred methodology for this type of development project.” – Jochen Scheel, Director at XDx.
RWE – Tiger, Implemented by Atos Origin (BTW – nice blog from Atos Origin on the project & award here)
Time-to-market:14 weeks; Number of Agile sprints: 5 + 1 tuning
Customer quote: “The Gas Portfolio Management application was implemented over a period of three months which was only possible with the OutSystems’ Agile Platform and methodology. Their way of sharing information, processing activities and reviewing project deliverables with key users of RWE NL was instrumental to the success of this project.”- Perry van de Goorberg, Project Manager at RWE.
OK! teleseguros – Sales Platform and Home Insurance, Implemented by Keep It Simple
Time-to-market: 13 weeks; Number of Agile sprints: 3
Customer quote: “This project was a true success as it exceeded the business’s expectations in terms of objectives achieved and above all business benefits. The Agile Platform and methodology allowed the business to engage the development team and see the immediate impact and results of all project changes and decisions.” – Sérgio Carvalho, Marketing and Product Director at OK! teleseguros.