Abstract/Description

If you roll out large-scaled agile metrics the wrong way, it can be a monster, raggedly sewn together from different, incompatible mindsets. It may be able to breathe — and maybe even walk — but don’t be surprised when you find your business being choked to death by it.

SAFe is profoundly effective because it provides a clear, easy-to-follow map for scaling your agile process. However, even though SAFe covers metrics it in its M1-M8 "specification", metrics aren’t its primary mission. Because of that, the specification is neither as broad nor as deep as it needs to be in order to have a truly successful understanding of what’s going on — and what to do about it.

METRICS ARE INHERENTLY ABOUT THE "WHAT?":
What is our current sprint velocity? What is our current defect density? What can we predict for the next iteration? And many more...

Many of the existing SAFe metrics were chosen based on well-educated best guesses of what might be useful to track rather than what are empirically shown to be the most useful.

In order to find what was most useful, we studied 120 individual metrics related just to M7 and M8, and found the seven metrics that best illuminated the dimensions that M7 and M8 are attempting to track. COME TO THE TALK TO FIND OUT WHAT THEY ARE.

IN ORDER TO BE TRULY USEFUL IN BUSINESS DECISIONS, METRICS MUST GO BEYOND THE "WHAT?" AND HELP YOU ANSWER THE "SO WHAT?" AND EVEN THE "NOW WHAT?"

SAFe is clear about the fact that implementing metrics requires "Adult Supervision" if you want to avoid "unintended" behaviors, i.e., the dark side of metrics that comes from gaming and unhealthy internal competition, but doesn’t go into detail about what that is or how to do it. (http://scaledagileframework.com/metrics/).
We extend that idea by including clear guidelines on what is meant by being an “adult” with respect to scaled agile metrics that reinforce your agile culture.

Moreover, much of the information on the SAFe metrics page is admittedly just “examples.” Some of it doesn’t even go that far and rather just provides suggestions of things you might want to look at.
In this talk you'll see fully fleshed out visualizations complete with calculations and noise filtering capability that will show you the "What?". More importantly, it includes references to trends, benchmarking, indicators, and analysis that allows you to also answer the "So what?" and even the "Now what?"

THE EXAMPLES YOU'LL SEE ARE NOT THEORETICAL. They come from roughly 30 organizations using various parts of this framework. We'll talk about their experiences, the struggles they had and how the framework we're discussing successfully deals with those difficulties.

ADDRESSED IN THIS PRESENTATION:

* Overview of Leffingwell's current SAFe metrics M1-M8
* Explain the framework (Team, Program, Portfolio/Organization)
* Propose my own framework similar to SAFe M1-M8, and extending it further
* Give examples of how to satisfy each
* What to do and what NOT to do when rolling out metrics at scale in an agile environment

Additional Resources

About the Speaker(s)

Larry Maccherone is an industry-recognized thought leader on agile, metrics, and cybersecurity. He currently helps a number of companies including Comcast, AgileCraft, and Agility Health. Previously, Larry led the insights product line at Rally Software which enabled better decisions with data, leveraged big data techniques to conduct ground-breaking research, and offered the first-ever agile performance benchmarking capability. Before Rally, Larry worked at Carnegie Mellon with the Software Engineering Institute (SEI) and CyLab for seven years conducting research on cybersecurity and software engineering metrics with a particular focus on reintroducing quantitative insight back into the agile communities. Contact Larry on his LinkedIn page: https://www.linkedin.com/in/larrymaccherone