Scope of Work
Home
About
Membership
Log In
Subscribe
Please enter at least 3 characters
2023-06-29 • 13 min read
Make Big Plans
Hillary Predko Hillary Predko
Make Big Plans
In How Big Things Get Done, Frank Gehry’s design for the Guggenheim Bilbao Museum is used as a case study for best practices. The city initially proposed an industrial building to be adapted for use as a museum, but Gehry’s team pushed back and determined that increasing tourism was the city’s primary goal. A stunning waterfront site was chosen and through careful planning, the building was completed on time and below budget. Image via Wikimedia.
Executing a megaproject to plan is hard. The Channel Tunnel, which connects the UK to France, had cost overruns of 80%; the Denver International Airport had cost overruns of 200%; the Suez Canal had cost overruns of a spectacular 1900%. Delivering a project on or under budget is so uncommon that Bent Flyvbjerg coined the iron law of megaprojects: "Over budget, over time, under benefits, over and over again."
In How Big Things Get Done: The Surprising Factors that Determine the Fate of Every Project, from Home Renovations to Space Exploration and Everything in Between, Bent Flyvbjerg and co-author Dan Gardner aim to offer a corrective to that iron law. They summarize decades of learning from megaproject management and offer straightforward heuristics and best practices that can be applied to projects at any scale, arguing that successful projects require us to identify and overcome our cognitive biases, relying instead on quality data to guide project planning. The book is underpinned by Bent’s deep research on megaproject management. He is an economic geographer, an emeritus professor at Oxford University, and the executive chairman of Oxford Global Projects. Bent recently joined Scope of Work's Members’ Reading Group for a conversation about project management and execution. What follows is an edited and condensed transcript of our discussion.
Hillary Predko: A throughline connecting so many megaprojects gone awry is tunnel boring machines. There are so many stories where a tunnel boring machine fails and gets stuck underground, pushing out the budget and timeline. It reminded me of the uniqueness bias you write about: Everyone thinks that their tunnel will be different but again, and again, the same problems crop up.
Bent Flyvbjerg: It’s not only tunnels – with any project, people tend to think their project is unique. And shockingly, that’s built into the major project management associations’ definitions of “a project.” PMI, Project Management Institute in the United States, defines a project as a unique venture. The same with APM, the Association for Project Management, the sister organization in the UK. Unique is a keyword in these definitions.
At some early stage, somebody sat down and decided that a project is something unique and that has had all sorts of negative repercussions. If you think something is unique, you don't have much reason to look at other projects, right? You can't learn anything from others. So you stunt your learning right from the outset. With a definition like that, you encourage people not to learn because each project is going to be unique. That's a huge mistake – it's just dead wrong. We prove that with data, there's lots to learn – you don't have to be an engineer or project manager to understand this.
For example, everyone will insist that their children are unique. But at the same time, any person with any common sense will also say that when it comes to medical science, there is a lot to learn from the diseases of other children. If your kid were to get ill, you would immediately draw on this knowledge to get them healthy again. That's the way we need to think about projects.
HP: You mention a database of megaproject data you maintain in the book, and we're all very curious to learn more. How are you gathering this data? And how does it inform your work both as an academic and consultant?
BF: The most difficult part of the whole thing is to get valid and reliable data. I'm an economic geographer, a specialized type of economist that is studying the economics of geography. Any economist will know that if you want to study unemployment, inflation rates, or productivity, and so on, you just contact the national statistical office in your country. There are lots of data that you can draw down, and you'll be in the business of doing research immediately.
The data are there because each nation-state has made the point of collecting the data that they think are important for running the economy. But it turns out that nobody thought that data about projects was worth collecting – even though we are spending trillions of dollars on them around the world. So I found there was no standardized data collection for projects, and as a result, you have all sorts of low-quality professional work and research going on because there is no good information.
I realized this way back when I studied the first megaproject in Danish history, a tunnel and bridge between East and West Denmark that went very badly. I documented the cost overruns, delays, and so on, but when I wanted to compare them to other projects, the data just wasn't there. Nowhere on the planet could we find a large data set that would reliably answer the question of whether the cost overrun and the delay of the Great Belt Tunnel in Denmark were normal.
The Great Belt Fixed Link between the Danish islands of Zealand and Funen. While the project management team claimed cost overruns were 29%, Bent’s research showed they were in fact 55%. This discrepancy, and the discovery that such high overruns are common worldwide, inspired Bent’s decades of research into megaprojects. Image via Wikimedia.
So I figured, okay, that's interesting – this is something that stimulates a scholar like myself. If there's a wide area on the map, something that has never been done before, I want to do it. That's when I started collecting data, and it took several people working around the world five years to collect the first 258 data points for transport infrastructure. And this was the largest database by far at the time: 258.
It showed that the cost overruns we had seen in Denmark were common worldwide. This was such a sensational finding that it got in the New York Times! That's not common for the kind of research that we are doing, but that encouraged me. I was thinking, “Hey, there's something here, and I want to answer more questions here. How big are the cost overruns? How big are the delays? Are we delivering the benefits that we are promising to deliver?”
You asked how we collect the data. Well, the first few hundred were arduous, really mining out the data, nugget by nugget. It was really hard work going into individual projects, getting the accounting out, and so on, to figure out what the real costs were compared to the estimated cost. Often the teams hadn't even done that themselves. You would be surprised to see how little collective memory there is on projects. Nobody cares to stop, look back and ask whether they accomplished what was promised. People are just thinking about the present and the next phase.
At one stage, I was contacted by McKinsey Corporation, the big consultancy, and they wanted us to gather data on IT projects. They contacted me and said, “Bent, we think that we have a way that we can get data more easily from our clients. We will offer to benchmark our client’s projects if they give us their data.” So, we made it into this kind of barter economy. We give something and we get something.
Luckily, quite a few companies agreed to do that and we got data. Of course, we would've been in deep trouble if nobody had wanted to do this, because we wouldn't have any data to do the benchmarking. We have used this methodology in 23 different areas – defense, mining, water, and energy projects – you name it, it's in there.
In consulting, when people ask us to help them, we say we'll do it, but only on the condition that we can use the data that we collect. We sign NDAs and make all the data anonymous which is important because a lot of this stuff is business secrets or government secrets. So they don't want it out there and nobody wants to look foolish. And a lot of these numbers do make people look foolish.
An aerial view of the West Kowloon Station, Guangzhou-Shenzhen-Hong Kong High-Speed Railway under construction. The railway was three years behind schedule and billions over budget when Bent’s consultancy intervened to get the project back on track in 2014. Image via Baycrest on Wikimedia.
Alex Animashaun: I'm a mechanical engineer, and I work on automotive and things like that. Have you got any tips for how we could collect this kind of data to use for benchmarking moving forward?
Read the full story
The rest of this post is for paid members only. Sign up now to read the full post — and all of Scope of Work’s other paid posts.
Make Big Plans
- jemhouston
- Posts: 6557
- Joined: Fri Nov 18, 2022 12:38 am
Make Big Plans
https://www.scopeofwork.net/make-big-pl ... d9a62d46df
Re: Make Big Plans
And there are several reasons that aren't discussed in that article.
1. The upper level managers know that the cost and time estimates are low, but understate them so that the politicians fund the project. Or the politicians know, but think they don't want to upset the public.
2. Military research maskerading as procurement projects
3. Insufficient allowance for the unknown risks that everybody knows will pop up during the project, but they don't know which risks those are. Cheney's known unknowns.
4. Overly optimistic planning in the Gantt chart, assuming that everything will actually follow the desired path. Which could be solved by putting in a task like: "Here's 15 days of float to account for something happening, but we don't know what would happen and are just putting it here in case."
1. The upper level managers know that the cost and time estimates are low, but understate them so that the politicians fund the project. Or the politicians know, but think they don't want to upset the public.
2. Military research maskerading as procurement projects
3. Insufficient allowance for the unknown risks that everybody knows will pop up during the project, but they don't know which risks those are. Cheney's known unknowns.
4. Overly optimistic planning in the Gantt chart, assuming that everything will actually follow the desired path. Which could be solved by putting in a task like: "Here's 15 days of float to account for something happening, but we don't know what would happen and are just putting it here in case."
-
Nik_SpeakerToCats
- Posts: 2417
- Joined: Sat Dec 10, 2022 10:56 am
Re: Make Big Plans
Tunnels !!!
IIRC, Oz hydro-power tunnel team spent many millions on route survey, mapped a brace of scary 'bouncers', yet missed a narrow fault that duly dumped a load into the tunnel. TBM needed best part of year to get clear, hopefully resuming soon.
Another tunnel, where two main bores are trouble-free, but a cross-connect found 'bad ground' which just poured in.
HS2, whose TBM seems to have found a clay-pit or pre-Victorian well, deranged aquifer enough to cause a surface collapse.
And another, where grouting for known 'bad ground' escaped via old tube-well to surface, causing consternation...
Dare we mention Boston's 'Big Dig' ?? Where, IIRC, a 'Swiss Cheese' combo of avoidable omissions and unauthorised changes brought part of roof down...
Oh, and HS2 again, which must 'duck & weave' around old salt-workings lest it vanish into fresh subsidence...
IIRC, Oz hydro-power tunnel team spent many millions on route survey, mapped a brace of scary 'bouncers', yet missed a narrow fault that duly dumped a load into the tunnel. TBM needed best part of year to get clear, hopefully resuming soon.
Another tunnel, where two main bores are trouble-free, but a cross-connect found 'bad ground' which just poured in.
HS2, whose TBM seems to have found a clay-pit or pre-Victorian well, deranged aquifer enough to cause a surface collapse.
And another, where grouting for known 'bad ground' escaped via old tube-well to surface, causing consternation...
Dare we mention Boston's 'Big Dig' ?? Where, IIRC, a 'Swiss Cheese' combo of avoidable omissions and unauthorised changes brought part of roof down...
Oh, and HS2 again, which must 'duck & weave' around old salt-workings lest it vanish into fresh subsidence...
If you cannot see the wood for the trees, deploy LIDAR.