Ambysoft logo

Process Framework Survey Results: January 2008

Follow @scottwambler on Twitter!

How to Measure Anything 2nd Edition This survey was performed in mid January and there was 339 respondents. The survey was announced in the blog of Jon Erickson, the Dr. Dobb's Journal editor, and in an email to the DDJ readership.

The Survey Results

The results of the survey are summarized in my February through April 2008 newsletters, Agile CMMI?, How Effective are Process Frameworks?, and Repeatable Results over Repeatable Processes respectively.

Some findings include:

Figure 1. Rate at which Agile is being applied within CMMI environments.

Application of agile within CMMI environments


Survey questions

The Survey Questions (122 K)

Survey Data File

Raw Data (145 K)

Survey Presentation

Summary Presentation (103 K)

What You May Do With This Information

You may use this data as you see fit, but may not sell it in whole or in part. You may publish summaries of the findings, but if you do so you must reference the survey accordingly (include the name and the URL to this page). Feel free to contact me with questions. Better yet, if you publish, please let me know so I can link to your work.

Discussion of the Results

  1. The response rate was unusual for us, I suspect because of the topic: Only 339 started the survey, the lowest survey response rate that we've ever gotten, and only 219 completed it. I suspect that many people were turned off by the second of five pages which explored the adoption rate and effectiveness of the frameworks (CMMI, COBIT, ITIL, PMI PMBoK, Prince2, TOGAF, and Zachman Framework).
  2. The survey results are likely biased because we told people up front that the survey focused on frameworks. Therefore, it's likely that people with an interest in frameworks would respond to the survey.
  3. The CMMI results seem very high. When surveying the agile community, only 9% of people responded to being currently on an agile project that was CMMI complian.
  4. This survey suffers from the fundamental challenges faced by all surveys.

Links to Other Articles/Surveys

  1. My other surveys

Why Share This Much Information?

I'm sharing the results, and in particular the source data, of my surveys for several reasons:

  1. Other people can do a much better job of analysis than I can. If they publish online, I am more than happy to include links to their articles/papers.
  2. Once I've published my column summarizing the data in DDJ, I really don't have any reason not to share the information.
  3. Too many traditionalists out there like to use the "where's the proof" question as an excuse not to adopt agile techniques. By providing some evidence that a wide range of organizations seem to be adopting these techniques maybe we can get them to rethink things a bit.
  4. I think that it's a good thing to do and I invite others to do the same.