Man wearing a black cap, round glasses, and a dark green t-shirt standing with hands on hips against a wall with vertical black slats illuminated by teal and purple lights.

Your agile transformation is not real until the work changes

The transformation report is green.

Teams have been trained. Roles exist. Ceremonies are on the calendar. A scaling framework has been selected. The maturity score went up. The board looks cleaner. Leadership can say the organization is now "more agile".

Then the delivery system tells a different story.

Decisions still wait. Dependencies still age. Product feedback still arrives late. Review queues still stretch. People still need three approvals to change a small thing. Teams still spend more energy feeding the process than improving the product.

That is the uncomfortable part: an agile transformation can look complete while the work barely changed.

The problem is not that agile is useless. The problem is that many organizations measure adoption and call it transformation.

Adoption is the easy part

Adoption asks whether the visible method is in place.

Do teams use Scrum or Kanban? Are roles named? Are ceremonies running? Is the scaled model deployed? Are managers trained? Are artifacts standardized? Can the PMO show progress?

Those questions are not irrelevant. A team cannot improve a way of working it has not tried. Shared language helps. Basic discipline matters.

But adoption is a weak finish line.

A method can be adopted in the same way a company adopts a new expense tool: people log in, follow the steps, and quietly route around the parts that make no sense. The organization gets compliance. It does not necessarily get a better delivery system.

The better question is whether the new way of working has become normal work.

Normal work has a higher bar

Carroll, Conboy, and Wang studied a large-scale agile transformation through Normalization Process Theory. Their point is useful because it moves the conversation away from rollout and toward embedding. A transformation can fail when the organization focuses on initial adoption and method adherence, while the new practices never become workable, legitimate, resourced, and useful in everyday work.

That distinction matters.

You can run a daily meeting without improving coordination. You can install Product Owners without changing decision rights. You can create tribes, squads, chapters, or release trains while dependencies still move through old governance queues. You can improve a maturity score while cycle-time tails get worse.

Normalisation asks harder questions:

  • Do people understand why this practice exists?
  • Does it help them do real work, or does it sit beside the work?
  • Are roles and decision rights clear enough to remove waiting?
  • Are managers changing policies, incentives, and funding rules, or only asking teams to change?
  • Is the organization learning from the effects and adjusting the system?

This is where many transformation dashboards become misleading.

They count the method. They do not test whether the method changed the operating system.

The evidence keeps pointing away from ceremony compliance

The research on large-scale agile transformation is not as strong as the market would like it to be. That caveat should be said plainly.

Dikert, Paasivaara, and Lassenius reviewed 52 publications describing 42 industrial cases of large-scale agile transformation. They found recurring challenges and success factors. They also noted that almost 90 percent of the included papers were experience reports. So this is useful pattern evidence, not a precise causal law.

Still, the recurring patterns are practical.

The salient success factors included management support, choosing and customizing the agile model, training and coaching, and mindset and alignment. The challenges included the difficulty of implementation, integration with other functions, and change resistance.

Read that slowly.

The evidence does not say: "Pick a framework and push harder."

It says: management, context, training, alignment, integration, and adaptation matter. The work system matters.

Edison, Wang, and Conboy reach a related warning in their systematic review of large-scale agile methods. They found that the literature often emphasizes commercial framework practices at the expense of underlying principles and custom-built methods. That is exactly where adoption theater begins: when the transformation becomes a test of whether the framework is visible enough.

Visibility is not the same as value.

Speed of rollout can be a risk

Kalenda, Hyna, and Rossi studied scaling agile in a large organization using a focused literature review and action research. Their reported success factors included culture, prior agile and lean experience, management support, and value unification. Their critical challenges included resistance to change, an overly aggressive rollout timeframe, quality assurance concerns, and integration into existing non-agile business processes.

This is a useful warning for leaders.

A fast rollout looks decisive. It produces slides. It gives the transformation office something to show. It can also flood the organization with new labels before people understand how the work is supposed to move.

If quality assurance, architecture, budgeting, compliance, staffing, and product governance still operate on the old rules, the team-level agile layer becomes decorative. Teams may change their rituals while the real constraint stays untouched.

That is how a transformation turns into extra process.

The work did not get simpler. It got bilingual: agile language on top, old decision system underneath.

What success evidence actually measures

Project-level studies make the same point from another angle.

Tam, Moura, Oliveira, and Varajão surveyed 216 agile practitioners and triangulated the findings with a focus group. They measured success in terms of cost, time, and customer satisfaction. Their model found team capability and customer involvement to be the main factors contributing to success in ongoing agile software development projects.

Binboga and Gumussoy studied agile project success with a model built from literature, practitioner refinement, and survey data from 596 agile practitioners. They report that customer factors and agile process factors were stronger predictors of process efficiency, sustainable software product quality, and stakeholder satisfaction.

These studies do not prove a universal transformation recipe. They do something more useful for a delivery manager or agile coach: they point to the variables that should not be missing from a serious transformation report.

If the report says a transformation is working but cannot show changes in customer involvement, team capability, process efficiency, product quality, stakeholder satisfaction, decision speed, or flow, then what exactly improved?

The calendar?

A better transformation audit

Before accepting a green transformation report, I would ask for a small, unpolished audit.

Not a maturity model. Not a self-assessment workshop with optimistic scoring. A check against the work.

Start with four questions.

1. Did the work become more workable?

Look at the last 30 to 50 pieces of meaningful work. Pull the dates, wait states, review time, blocked time, reopen events, and decision points.

Then ask:

  • Where does work wait longer than expected?
  • Which decisions repeatedly block teams?
  • Which ceremonies produced actual decisions?
  • Which dependencies were discovered late?
  • Which approval steps still define the real cadence?

If agile introduced more meetings but did not reduce waiting, the system may be better dressed, not better designed.

2. Did capability increase?

Training completion is not capability.

Capability shows up when people can handle more of the work with less escalation, better judgment, clearer collaboration, and fewer avoidable loops.

Useful questions:

  • Can teams explain the purpose of their roles and practices in relation to delivery outcomes?
  • Are Product Owners able to make product decisions, or mostly collect stakeholder opinions?
  • Can teams split work smaller without slicing away value?
  • Are managers removing system constraints, or coaching teams to tolerate them?
  • Are retrospectives producing implemented changes, instead of written action items that never move?

If the transformation created labels without increasing the ability to make and finish decisions, it is thin.

3. Did the customer and value loop improve?

Agile without customer involvement becomes internal optimization.

So measure the loop.

How often does real customer, user, or stakeholder feedback reach the team? How long does it take to turn feedback into a decision? How often does post-release evidence change backlog order? How many backlog items are linked to a clear outcome or learning question?

If none of that moved, the organization may have adopted agile practices while keeping the old value system: output first, learning later, feedback when convenient.

4. Did delivery outcomes move?

Velocity is too easy to inflate.

Look at flow and quality:

  • cycle-time distribution, especially the 85th and 95th percentile
  • blocked-state age
  • review and integration queue age
  • escaped defects or quality incidents
  • rework, reopen, and revert rates
  • forecast accuracy using probabilistic ranges
  • time from decision needed to decision made

Do not expect every metric to improve at once. Real systems have tradeoffs. A team may slow down briefly while paying down integration debt. Quality may improve before throughput does. A useful audit looks for mechanisms, not vanity.

But if no delivery outcome moves, leaders should stop celebrating adoption.

The management question changes

The old question is:

"Are we agile yet?"

The better question is:

"What changed in the delivery system?"

That question is harder because it cannot be answered by a framework rollout plan. It forces leaders to look at decision rights, funding rules, product involvement, team capability, dependency design, quality practices, and the queues they personally create.

It also protects agile from becoming another management fad.

Naslund and Kale reviewed agile transformation success factors and compared agile with earlier organizational change methods. Their warning is not that agile is doomed. It is that organizations can repeat old change mistakes under a new label. Purpose, process, and people still matter.

That is the practical line for an agile coach or delivery manager.

Do not defend agile as a belief system. Do not sell ceremonies as evidence. Do not let a transformation office confuse adoption with improvement.

Make the work visible.

If decisions are faster, flow is healthier, customers are closer, quality is steadier, teams are more capable, and the organization can explain what changed, the transformation may be real.

If the only thing that improved is the paperwork, it is not a transformation.

It is a report.

Sources

  • Binboga, B., & Gumussoy, C. A. (2024). Factors affecting agile software project success. IEEE Access, 12, 95613–95633. doi.org/10.1109/ACCESS.2024.3384410
  • Carroll, N., Conboy, K., & Wang, X. (2023). From transformation to normalisation: An exploratory study of a large-scale agile transformation. Journal of Information Technology, 38(3), 267–303. doi.org/10.1177/02683962231164428
  • Dikert, K., Paasivaara, M., & Lassenius, C. (2016). Challenges and success factors for large-scale agile transformations: A systematic literature review. Journal of Systems and Software, 119, 87–108. doi.org/10.1016/j.jss.2016.06.013
  • Edison, H., Wang, X., & Conboy, K. (2022). Comparing methods for large-scale agile software development: A systematic literature review. IEEE Transactions on Software Engineering, 48(8), 2709–2731. doi.org/10.1109/TSE.2021.3069039
  • Kalenda, M., Hyna, P., & Rossi, B. (2018). Scaling agile in large organizations: Practices, challenges, and success factors. Journal of Software: Evolution and Process, 30(10), Article e1954. doi.org/10.1002/smr.1954
  • Naslund, D., & Kale, R. (2020). Is agile the latest management fad? A review of success factors of agile transformations. International Journal of Quality and Service Sciences, 12(4), 489–504. doi.org/10.1108/IJQSS-12-2019-0142
  • Scrum.org. (2026). Your agile transformation is a lie you wanted to be true [Blog post]. scrum.org/resources/blog/your-agile-transformation-lie-you-wanted-be-true
  • Tam, C., Moura, E. J. da C., Oliveira, T., & Varajão, J. (2020). The factors influencing the success of on-going agile software development projects. International Journal of Project Management, 38(3), 165–176. doi.org/10.1016/j.ijproman.2020.02.001