IT Brief New Zealand logo
Technology news for New Zealand's largest enterprises
Story image

Agile success metrics that matter most – Certus3

By Contributor
Mon 5 Aug 2019
FYI, this story is more than a year old

Article by Certus3 managing partners Michael Devlin and Simo Popovac

We recently explored value creation as the end goal for Agile.

We noted a few ways value could be measured, such as in terms of time-to-market for new products or features, or in an organisation’s ability to cut projects that are no longer value-accretive.

We also noted a wide choice of possible metrics to use when trying to measure the value of your Agile journeys and outputs.

At Certus3, we find a combination of metrics that focus both on the project environment and the people in it are necessary when measuring the value generated by an Agile project.

Project environment encompasses how the project is set up and operates.

People metrics, on the other hand, determine just how aligned and effective all parties - from the project team and business stakeholders to executives and suppliers - are in contributing to value delivery.

The strategy-value connection

As Agile has taken root as an organisation-wide methodology pursued by many government agencies and listed companies, it has become important to measure how clearly Agile business initiatives are connected to an organisation’s overarching strategy.

One of the market-leading frameworks for implementing Agile on an organisation-wide basis - the Scaled Agile Framework or SAFe - proposes two mechanisms for establishing, measuring and maintaining this connection.

These mechanisms are known as ‘Strategic Themes’ and ‘Value Streams’.

Strategic Themes are specific business objectives that clearly communicate strategic intent from the business strategy to the Agile business initiatives.

Value Streams, meanwhile, are a sequence of high-level business activities (“value stages”) that lead to the achievement of the specific business objectives, which ultimately focus on delivering value to the business and its customers.

The quality of these two mechanisms is critical to the success of every Agile business initiative.

They can and should be measured from the inception of an Agile transformation.

While the two mechanisms do not remain static throughout the lifecycle of an Agile business initiative, their rate of change is sufficiently slow to provide stable foundations for the planning and execution of

Agile in the organisation.

Decision-making in check

Administration of organisation-wide or Scaled Agile projects should be centralised.

The setting of appropriate Strategic Themes and Value Streams keeps this aspect of the project in check.

However, the actual execution of Agile initiatives is decentralised - in line with Agile principle #9 to decentralise decision-making.

Decentralisation of decision-making is one of the key enablers for Agile to be significantly

more successful than traditional waterfall approaches to projects.

It also requires a set of reliable measures to ensure it meets its stated objectives - and contributes to the overall success of Agile at a central organisational level.

As we’ve previously discussed, Agile is not the complete antithesis of Waterfall.

That is, project fundamentals may take a different form in Agile, but they still exist and serve a roughly similar purpose.

Business requirements, for example, still exist in the Agile world.

They are not expressed

in hundreds of pages of documents developed upfront, nor are they immovable.

Instead, SAFe proposes an elegant and comprehensive hierarchy of common themes that, together, provide clarity of the expected value to be delivered (benefits hypothesis) and the acceptance criteria

(definition of done).

Likewise, there is still a need in Agile to define solution architectures using a stable set of values, principles and practices - as well as enough of a runway to incorporate emerging design.

Some level of delivery planning and control is also still required.

The key focus in Agile plans is on continuous prioritisation of themes in their corresponding backlogs, based on the maximum economic benefits.

Don’t forget your people

All of the above focuses on project measurement.

Whilst this is critical to success, there is another set of measures that focuses on the team or people aspects of the Agile business initiatives.

Agile teams who are long-lived, dedicated and empowered to make decisions; have the cross-functional make-up required to deliver value; and who strive for and demonstrate an ability to learn continuously and collaborate with other teams, are at the very foundation of successful Agile delivery.

Understanding the behavioural characteristics of Agile teams that are essential for success and should be regularly measured and improved is critical.

Tools like Certus3’s TeamAmp can assist in this regard.

A side note on these metrics

It’s worth noting that what we have discussed - and indeed across this five-part series - combines aspects of the SAFe framework as well as our own experiences with Agile.

SAFe is a framework for how to approach an Agile delivery from the top level of the organisation down - but, by itself, it does not answer how to organise complex pieces of work.

That’s why we borrowed concepts from SAFe, but added a whole lot of structure and data analytics around it.

That structure comes in the form of the questions our tools are designed to ask Agile teams and in the scoring of their responses.

SAFe alone will not tell you whether a particular Agile development is good or bad or how that might be measured.

It won’t tell you how to phase a project or move through a bottleneck.

And it won’t flag cultural challenges that crop up along the Agile journey.

The move to organisation-wide Scaled Agile shows few signs of abating.

Though there have been speed bumps for some early adopters, for those that understand how and where to start, the end goal, and how to chart a path between those two points, significant upside awaits.

Related stories
Top stories
Story image
Tech job moves - Forcepoint, Malwarebytes, SolarWinds & VMware
We round up all job appointments from May 13-20, 2022, in one place to keep you updated with the latest from across the tech industries.
Story image
Let’s clear the cloud visibility haze with app awareness
Increasingly, organisations are heading for the cloud, initiating new born-in-the-cloud architectures and migrating existing applications via ‘lift and shift’ or refactoring.
Story image
Remote Working
Successful digital transformation in the hybrid work era is about embracing shifting goalposts
As organisations embraced remote working, many discovered they lacked the infrastructure needed to support history’s first global load test of remote work capabilities.
Story image
Vectra AI
Understanding the weight on security leader’s shoulders, and how to shift it
Millions of dollars of government funding and internal budgets are being funnelled into cybersecurity to build resilience against sophisticated threats, indicating how serious this issue has become.
Story image
Revenue operations is taking centre stage
As the business world continues to evolve, new demands need to be met to keep up with the ever-changing landscape. 
Story image
Nozomi Networks
Nozomi Networks, Siemens reveal software integration
Nozomi Networks and Siemens have extended their partnership by embedding Nozomi Networks’ software into the Siemens Scalance LPE local processing engine.
Story image
Qualys updates Cloud Platform solution with rapid remediation
The new update is designed to enable organisations to fix asset misconfigurations, patch OS and third-party applications, and deploy custom software.
Story image
More than 40% of banks worried about cloud security - report
Publicis Sapient's new report finds security and the lack of cloud skills and internal understanding of business benefits are big obstacles for banks moving to the cloud.
Story image
A third of companies paying ransom don’t recover data - report
Veeam's report finds 76% of businesses who are victims of cyberattacks paid the ransom to recover data, but a third were still unable to get their information back.
Story image
Cybersecurity starts with education
In 2021, 80% of Australian organisations responding to the Sophos State of Ransomware study reported being hit by ransomware. 
Story image
Customer experience
Gartner recognises Okta for abilities in Access Management
Okta has announced it has been recognised as a Customers' Choice for the fourth time in a row in the Gartner Peer Insights "Voice of the Customer" report.
Story image
Fonterra to use automated guided vehicles by Dematic
New Zealand's dairy giant Fonterra is upgrading its manufacturing facility in Edendale with new automated guided vehicles (AGVs) from Dematic.
Story image
Digital Transformation
The impact of COVID-19 on healthcare environments and care delivery
The COVID-19 pandemic has revolutionised the healthcare industry while overcoming staff shortages, social distancing requirements, and lockdowns.
Story image
Commerce Commission
ComCom appeals $2.25 million fine in Vodafone FibreX case
The Commerce Commission has filed an appeal in the High Court against a $2.25 million fine imposed on Vodafone NZ for its offending under the Fair Trading Act.
Story image
ChildFund launches new campaign to protect children online
ChildFund says WEB Safe & Wise aims to protect children from sexual exploitation and abuse online while also empowering them to become digitally savvy. 
Story image
Customer experience
Research unveils precarious customer loyalty for retailers
New research has found customers are reassessing established brand loyalties as their priorities and behaviours shift.
Story image
Meadows exits Ingram Micro New Zealand on a good note
We look at the resignation of Danny Meadows from Ingram Micro's New Zealand Unified Communications & Collaboration business unit.
Story image
Data Protection
Barracuda launches new capabilities for API Protection
"Every business needs this type of critical protection against API vulnerabilities and automated bot attacks," Barracuda says.
Threat actors are exploiting weaknesses in interconnected IT/OT ecosystems. Darktrace illuminates your entire business and takes targeted action to stop emerging attacks.
Link image
Story image
A10 Networks finds over 15 million DDoS weapons in 2021
A10 Networks notes that in the 2H 2021 reporting period, its security research team tracked more than 15.4 million Distributed Denial-of-Service (DDoS) weapons.
Story image
PwC NZ unveils new Cloud Security Operations Center
PwC New Zealand has unveiled its new Cloud Security Operations Center for the entire Microsoft technology stack.
Story image
Apple previews new features for users with disabilities
Apple says new software features that offer users with disabilities new tools for navigation, health and communication, are set to come out later this year.
For every 10PB of storage run on HyperDrive vs. comparable alternatives, an estimated 6,656 tonnes of CO₂ are saved by reduced energy consumption alone over its lifespan. That’s the equivalent of taking nearly 1,500 cars off the road for a year.
Link image
Story image
Artificial Intelligence
CFOs using digital workers and AI to prevent unnecessary loss
New technology is now allowing CFOs to use digital workers to automate their accounting processes, making it easier for them to avoid unnecessary losses.
Story image
Data and analytics could be key to higher selling prices in APAC
Sisense's latest report has found that almost half of data professionals in APAC think customised data and analytics can create better selling prices for their products.
Story image
Power at the edge: the role of data centers in sustainability
The Singaporean moratorium on new data center projects was recently lifted, with one of the conditions being an increased focus on power efficiency and sustainability.
Story image
Nutanix study reveals financial services sector lagging with multicloud adoption
Nutanix has released new research that reveals the financial services sector is lagging behind when it comes to multicloud adoption.
Story image
Cradlepoint expands its Cellular Intelligence capabilities
Cradlepoint has announced additional Cellular Intelligence capabilities with its NetCloud service.
Story image
Supply chain
Jetstack promotes better security with supply chain toolkit
The web-based resource is designed to help organisations evaluate and plan the crucial steps they need to establish effective software supply chain security.
Find out how a behavioural analytics-driven approach can transform security operations with the new Exabeam commissioned Forrester study.
Link image
Booster Innovation Fund. A fund of Kiwi ingenuity – for Kiwi investors.
Link image
Story image
Vodafone NZ buys remaining stake in retail joint venture
Vodafone New Zealand has purchased the remaining 50% stake in the specialist joint venture (JV) with private equity company Millennium Corp.
Story image
Digital Transformation
The Huawei APAC conference kicks off with digital transformation
More than 1500 people from across APAC have gathered for the Huawei APAC Digital Innovation Congress to explore the future of digital innovation.
Story image
Lightspeed launches all-in-one marketing platform in A/NZ
ECommerce provider, Lightspeed has launched a new all-in-one marketing solution, Lightspeed Marketing & Loyalty in Australia and New Zealand.
Story image
Application Security
What are the DDoS attack trend predictions for 2022?
Mitigation and recovery are vital to ensuring brand reputation remains solid in the face of a Distributed Denial of Service (DDoS) attack and that business growth and innovation can continue.
Story image
Rubrik Security Cloud marks 'next frontier' in cybersecurity
"The next frontier in cybersecurity pairs the investments in infrastructure security with data security giving companies security from the point of data."
Story image
Legrand unveils Nexpand, a data center cabinet platform
Legrand has unveiled a new data center cabinet platform, Nexpand, to offer the necessary scalability and future-proof architecture for digital transformation.
Story image
Data Center
Preventing downtime costs and damage with Distributed Infrastructure Management
Distributed Infrastructure Management (DIM) can often be a lifeline for many enterprises that work with highly critical ICT infrastructure and power sources.
Story image
Wireless Nation
Wireless Nation, N4L provide 4G network to remote NZ schools
Wireless Nation and Network for Learning (N4L) have rolled out the Rural Connectivity Group’s (RCG) new 4G network to better connect three Chatham Islands schools.
Story image
Grasping the opportunity to rethink the metrics of a sustainable data centre
A data centre traditionally has two distinct operations teams: the Facility Operations team, and the IT Operations team. Collaboration between them is the key to defining, measuring, and delivering long-term efficiency and sustainability improvements.
Story image
Data backup plans inadequate, data still at risk - study
The Apricorn 2022 Global IT Security Survey revealed that while the majority organisations have data backup plans in place, data for many are at risk.
Story image
Could your Excel practices be harming your business?
While Excel has been the de-facto standard for budgeting, planning, and forecasting, is it alone, enough to support organisations in the global marketplace that’s facing rapid changes due to digital transformation?
Story image
Sift shares crucial advice for preventing serious ATO breaches
Are you or your business struggling with Account Takeover Fraud (ATO)? One of the latest ebooks from Sift can provide readers with the tools and expertise to help launch them into the new era of account security.
Story image
Digital Transformation
Pluralsight and Ingram Micro Cloud team up on cloud initiative
Pluralsight has teamed with Ingram Micro Cloud to build upon cloud competence and maturity internally, and externally support partners’ capabilities.