May 11, 2009
Lying And Runaway Costs In Megaprojects

Ever find a diamond on a trash-laden beach?  I haven't, but that's how I felt when I read this Danny Westneat column.  (Those unfamiliar with the Seattle Times columnist may need an explanation for my reaction.   Westneat is not the worst journalist in this area by any means, but he is closed-minded on many subjects, and limited in his range.  His columns on local subjects are often worth reading; his columns on national and international affairs often make me cringe.  And he is no better with numbers than the average journalist, which is to say that he is not very good.)

Somehow, Westneat managed, in a single column, to make an important generalization, apply it to a local project, and introduce me to an academic, Bent Flyvbjerg, who has been doing work that every citizen of a democratic country should know about.  I have no idea how Westneat produced this gem, considering his past work, but I am deeply appreciative.  (Flyvbjerg is pronounced, Westneat tells us, "flew-byair")

But enough of the build-up, let's go to the bottom line.  The very inflated bottom line.

But a professor at Oxford University in England has done a compelling series of studies trying to get at why big public-works projects such as bridges, tunnels and light-rail systems almost always turn out to be far more costly than estimated.

"It cannot be explained by error," sums up one of his papers, matter-of-factly.  "It is best explained by strategic misrepresentation — that is, lying."

That should be enough to get you to read the whole column, especially if you live in this area.   If not, let me urge you to take a few minutes to do so.

And let me go a little farther and suggest that most of you should take the time to read this Flyvbjerg speech, where he presents some of the evidence he has gathered for his unpleasant conclusion, that over-runs on megaprojects are best explained by lying.  (And I plan to go even farther and buy his book on the subject.)

It is not surprising to learn that politicians have been lying to us about the costs of these megaprojects, and it is not entirely surprising to learn that project planners have been lying to us, too.   Disappointing, but not surprising.

If citizens learn how common these lies are, how almost universal they are on megaprojects, we may be able to detect more of those lies in advance, and we may be able to punish some of the politicians and planners who have lied to us.

Cross posted at Jim Miller on Politics.

(Here's Professor Flyvbjerg's web site and here's an article describing his work.)

Posted by Jim Miller at May 11, 2009 01:48 PM | Email This
Comments
1. Please define "lying". On these boards, we have a definition of "lying" as someone saying something which another of the moderators doesn't like. That, by definition is "lying".

Naivete and "Let's Get It Done" bravado is not lying in the public works sense.

Not really taking into account actual costs of similar projects or minimizing potential pitfalls, or properly guessing the inflation rates are all examples of poor planning and estimating.

If these agencies had people (and believe me when I say the pols hammer the expert estimators to produce the desired result) who intentionally gave false information, then I'll go with your definition.

Or, it might be disengenuous when you estimate using today's costs and today's inflation rate when you know that the construction won't happen for five to ten years. Kind of like this year's legislators and governor misestimating the revenues coming in the door.

If they do it on purpose, then yes, it would be "lying" in my book.

Does Flyvbjerg define it as such? Or does he use the local moderators definition of "lying"?

Posted by: swatter on May 11, 2009 02:54 PM
2. Sorry, Jim, but it's time for you to pull out the Strunk and White. "Farther" is strictly limited to distance. "Further" is the word you're looking for.

Posted by: Kent on May 11, 2009 03:03 PM
3. How about we use the Leftist Marxist's definition of lying where simply making an error - even an innocent one - is a lie?

HOPE AND CHANGE!

Wait, is that a lie?

Posted by: Shanghai Dan on May 11, 2009 03:05 PM
4. Kent - If you check the usage note in the American Heritage dictionary, you will find that experts are divided, and that many would accept my usage. I used "farther", after some thought, because I wanted readers to think in terms of a metaphorical distance.

(Incidentally, Strunk and White do not make that rule absolute, saying only that "farther serves best as a distance word, further as a time or quantity word".)

Swatter - I linked to his speech so that you read his definition of lying for yourself.

Posted by: Jim MIller on May 11, 2009 03:20 PM
5. Mega project cost estimates are difficult and variances from estimates should be expected. However, Flyvbjerg's point is that the estimates were ALWAYS low and by large amounts. If the variance was purely due to unforeseen cost changes, then some projects should at or below estimates. This is not the case. The conclusion is that the promoters of the project must be knowingly understating the costs which of course a lie (something presented as fact that is known to be untrue).

Posted by: rjk on May 11, 2009 03:22 PM
6. Sadly, the public doesn't care. Even after the massive cost overruns of Sound Transit, they still voted to expand it. Thank goodness we bought our home outside its taxing district, although we still end up paying some of the additional sales taxes for it.

Posted by: Palouse on May 11, 2009 04:11 PM
7. What is a lie?

Depends on what your definition of "is" is.

Heh heh

Posted by: Sam Adams on May 11, 2009 04:16 PM
8. In my book, a lie is an absolute. Black and white. Westneat's column gives compelling testimony to the fact that these people know what the true costs are, know the risks inherent with cost over-runs and choose to ignore them. They purposefully understate what any knowledgeable person believes are the true costs - they are lying.

What are we going to do? The project is 90% complete, we want our latest toy, so we bail them out. At the end of the day it still comes down to us the taxpayer, shame on us for allowing this to continue.

Posted by: The Duke on May 11, 2009 05:46 PM
9. My favorite paragraph in the article, way down a ways, is where Flyvbjerg is asked to estimate a project for the Dutch using his system - his estimate was significantly higher with a 65% chance of overrun and a 1 in 3 chance the overrun would exceed 50%.

So, it isn't just the estimate per se, but the level of confidence in the estimate based on what level of information is known about the project.

It seems in many public works projects, approval comes at an early phase where little has been designed so the degree of confidence in the estimate is low - and why not? The system now doesn't generally cancel projects as their costs become better known - instead the budgets are adjusted.

Sound Transit had really poor budgeting early, arguably has gotten their act together and now their budgets more closely track costs (and are of course higher to reflect that reality).

They have projects though that could outright be cancelled it costs went up too much and we'd be fine (or at least not much worse than now).

But what if, for example, the 520 floating bridge when fully designed and priced comes in 25% over budget - is it cancelled?

Better yet, what if during construction prices jump dramatically like we witnessed during the last construction boom - is the project left unfinished?

Taking what Flybjerg has found and simplifying it down to "Politicians lie" doesn't do his work justice, nor will it change anything.

Learning from his work that understanding what's known and what's not in budgeting, and what the upside range of potential overruns might be and having a plan to deal with them is the point.

Posted by: BA on May 11, 2009 06:27 PM
10. The conclusion is that the promoters of the project must be knowingly understating the costs which of course a lie (something presented as fact that is known to be untrue).

The promoters don't even have to be knowingly understating the costs. Remember, it's very expensive to do a thorough cost estimate, and a thorough estimate can't even be done until all the construction plans and specifications are completed.

But, the consultants (and of course the political beneficiaries) of the project, having laid out some flowery language of hope and change, now wish for public acquiescence in proceeding to develop those plans and specs and to build the project. So they enter a process of hasty estimates, done on a limited preliminary budget, and of course those hasty estimates don't cover all the details of the final project. But they almost always show optimistic total costs for the project, useful in persuading the rest of us to vote 'yes'. Can we imagine why?

Well, use of those hasty estimates is a hell of a lot more likely to result in a "yes" vote than if enough resources and dollars were laid out to develop a good one. And there's an enormous conflict of interest at this point, in fact, many of them. Those who want the project to proceed (other than the fluffbrained members of the public who think that they will derive services from it that 'others' will pay for) are most likely to be legal firms, consulting engineers, environmental consultants, labor unions etc etc who will be HIRED to do enormous amounts of work on it, and will profit from it directly. And the chances that the initial estimates will turn up an evaluation of "unfeasible" (public benefits of far less than the public costs) are microscopic - since none of the above list of circling vultures would be thought very smart if they didn't go for the project WHATEVER the cost.

That pressure to proceed with the project is no less a natural law than gravity.

The President and the Pelosi Congress have just given us a superb example of this syndrome - their monster 'stimulus' bill, which no one ever had a chance to read before voting 'yes', is just an exaggerated case of the actions of political beneficiaries using a nifty 'emergency' as an excuse to vote in a monster project. Public costs exceeding public benefit? Absulutely. Who cares, as long as the Democratic half of the public get the loot, and the other half gets the shaft?

Posted by: Insufficiently Sensitive on May 11, 2009 06:37 PM
11. BA,

In the private enterprise world, we call that deceptive advertising and bait-and-switch, both of which can land you in jail.

Apparently our Government does not have to hold to the same standards it requires of its subjects...

Posted by: Shanghai Dan on May 11, 2009 06:40 PM
12. I am looking for the day when Dave Ross is going off the air due to the cost overrun on the viaduct project. I heard him talk about a wager with Monson where Ross bet his job (resign from his job) if the viaduct project costs more than the projection.

But then, he may be lying about honoring the wager.

Posted by: DoppioLover on May 11, 2009 06:42 PM
13. #12 above... I meant to say "I am looking forward to the day..."

Posted by: DoppioLover on May 11, 2009 06:46 PM
14. No Shanghai Dan, in the private sector the process by which complex projects are developed works to understand costs and the level of confidence in the estimate of those costs.

Neither of which is deceptive advertising or bait and switch.

Though you might have a point anyway - because many if not most public projects rely on private sector cost estimating to develop project budgets.

So, shouldn't those firms that develop the estimates be jailed? I think that's what you're saying.

Have you ever written a budget that perfectly represented the actual costs of a complex project? Was it dead on? No changes in either scope or cost from beginning to end?

You'd be the first if you have.

Posted by: BA on May 11, 2009 06:53 PM
15. No BA,

If I come to you, looking to sell you products or services for a price, or am looking to get you to invest in my company, I have a requirement to follow through with what I promised as best as I can.

If I tell you that I can get you a 2008 Mercedes S350 for $30,000 and you sign on the line, I can't come back and now tell you "sorry, it's $80,000 so you have to pay me another $50,000".

That is what Government does when it woefully underbids projects.

Doing it once? OK, learning mistake. Move on. Doing it time after time after time? That's a pattern of deception, and in the private enterprise world that will get you hauled into court.

Posted by: Shanghai Dan on May 11, 2009 07:03 PM
16. Have you ever written a budget that perfectly represented the actual costs of a complex project?

Yes. A 24 man-year effort with a $9 million budget that came in ahead of schedule and under budget. Of course, in my 20+ years of engineering and management I've learned to pad schedules and budgets to account for the inevitable "we didn't think of that".

Was it dead on? No changes in either scope or cost from beginning to end?

Scope changes happened. We rolled with them, re-adjusted the budgets and schedules, and when significant changes happened went back to the stakeholders and got them to buy in once again. It's what responsible, ethical business does.

Posted by: Shanghai Dan on May 11, 2009 07:08 PM
17. They teach these KLOWNS one key thing in Progressive Liars school--
Do & Say anything to get the project started. Once it's started, you've got momentum and then defend your lies by all means possible.

Posted by: Mr. Cynical on May 11, 2009 07:09 PM
18. Dan@16, congratulations on meeting your budget, but many $9 million projects come in on budget in the public sector as well. It's the $900 million projects (or, in the case of the Iraq war, the $900 billion projects) that come in way over budget -- in both the private and public sectors. Honestly, I'm not sure which is worse. Sound Transit? Microsoft Vista? The Boeing 787?

And while I applaud Bent Flyvbjerg's work and think we should try to learn from it, it creates a paradox. If we knew the true cost of projects, we'd probably do very few of them, even though ultimately I think most citizens are glad we did projects even with their overruns. I'm not saying we should deliberately let ourselves be deceived. But if we make better estimates of cost, we also need to be sure we've correctly judged all the benefits of a project.


Posted by: Bruce on May 11, 2009 08:35 PM
19. Shanghai Dan - you made my point exactly. In order to meet a budget you "pad it". If that's not enough you go back to your "stakeholders" to alter the project, or budget.

So, use the 520 bridge as an example.

When it goes over budget because materials increase at a rate greater than what might be anticipated from historical trends what do you do?

Go back to the stakeholder (taxpayers) and admit you "lied"?

What are your other options?

Public or private - the estimates that the government uses are generated by the private sector. The projects are built by the private sector. A delivery system that is more like design build might well be more predictable for the government and taxpayers. Whether or not it saves money is a different question and answer.

Posted by: BA on May 11, 2009 09:03 PM
20. The giant transit megaprojects don't pass basic common sense tests, here's why:

Let's just assume for a minute that all of the Progressive transit dreams come true. Even greater urban density. Viable wind and solar as a large percentage of our electric power. A new breed of electric car powered by wind and solar panels installed on every home. Greater use of bicycles, etc. None of that will lead to train ridership. If you give a Progressive that wants to feel good about saving the earth, a nice new battery powered car, they are not going to take the train. They will feel good about using that new environmentally sound car to get where they want to go.

Meanwhile, real market forces will also work against mass transit mega projects. As money is diverted away from roads, and congestion ensues, people will move closer to work. Companies will be forced to fill carbon mandates and they will further incentivize employees to live close. And when they can't, technology will make working remotely more and more feasible and acceptable.

And there are the realities of 21st century life, with a huge number of options for recreation, child activities, community involvement, commuter colleges, second and third incomes, etc. All of these will drive more auto usage, not less. And don't forget terrorism as a psychological force. Is the terrorist going to strike the loan commuter in a car, or even a stretch of roadway or a bridge, to kill a few 100, when he can instead go for a train station? And everyday folks will make that calculus and as much as they can avoid the trains, they will.

It would be one thing if we really lived in the dense urban environs of Europe. And in some of our East Coast cities, long since established mass transit does work well. But here in the Sound with multiple massive geologic barriers of water, hills, mountains, rivers, etc. it is cost prohibitive to build a large and functional train infrastructure that won't be long outmoded before it is ever complete to any truly useful degree. And this area just isn't that densely populated yet so as to require a mega transit system and have the ridership to support it at an even partially self sustaining level.

Lastly, the whole idea of transit hinges on key corridors, but the real daily transit maps of our citizenry look much more like a spiderweb, and much less like a subway map. There are plenty of people commuting between areas that won't get transit for decades.

And yet, through clever manipulation, and largely through very poorly researched and leading media stories like when Danny Westneat rode the Max down in Portland for a few hours to help push Sound Transit proposals through, we still see a false panacea that many deluded people think will become a reality. And don't forget we have not even fully funded the very first minimal phase of the system, with decades of bonds to pay off. And we are simultaneously setting up vastly increased government with many other non-transit, yet grandiose spending plans, and with tax revenue crushing controls on the ultra rich, upper middle class, and middle class, who we are counting on to foot the bill.

Posted by: Jeff B. on May 11, 2009 09:18 PM
21. A lie is willful deception. I work in a legal jurisdiction where people get hit with charges of "false official statement" a lot. In order to be guilty, they have to admit that what they said was false, that they knew it to be false at the time that they said it, and that it was said with the intent to deceive.

Ergo, Bush/WMDs: not a lie; bureaucrats/cost overruns: either willful ignorance or lies.

Posted by: AD on May 11, 2009 09:20 PM
22. Here's some local definitions of a lie:

Sound transit: cost $2.2 billion to get the vote passed.

Almost as soon as it passed, costs shot up to $4 billion for fewer miles of track.

Another one: the gas tax vote.

About 1/3rd of the promised projects have been cut since the gas tax vote, foolishly supported by many here, actually passed.

Another lie: That this silly-assed tunnel will come in anywhere near the cost they're telling us.

Look up "Big Dig."

I will gladly entertain questions until the end of the class period.

Posted by: Hinton on May 11, 2009 09:42 PM
23. Case in point:

Sound Transit Link Light Rail: $179 million/mile
Light Rail National Average: $35 million/mile

Posted by: blindman on May 11, 2009 09:47 PM
24. "It is best explained by strategic misrepresentation — that is, lying."

Same thing happened with the cost of the Iraq war, but on a much bigger scale.

Posted by: Richard Pope on May 11, 2009 10:09 PM
25. Hi all, I appreciate Jeff B's comments # 20, but I differ.

Here's one example: "Even greater urban density" is posited as a "progressive dream."

But actually "even greater urban density" is something the market is trying to accomplish, but government won't let it.

Government has laws in place against density at every turn. The most desirable sites, such as the shore of Lake WA and the Sound here in Seattle are zoned residential. Everywhere there are hieght restrictions, and thanks to neighborhood activists, builders must build parking garages if they want to build residential towers, which removes the entire cost advantage of dense living.

If the market could be set free, it would create the density to make transit profitable* (unfortunately, gov't has a stranglehold on transit management) and those two factors together would blow out the car-loving mindset us older Americans have been forced into.

And it would be the best thing that ever happened to the environment.

*and taxes could be denied roads so they were strictly funded by user-fees, thus leveling the playing field with privately-run mass transit operations.

So ok, it's dreaming, but it's not a progressive dream, it's a true-conservative dream.

Have a great night all,

New Left Conservative # 1

Posted by: new left conservative # 1 on May 11, 2009 10:16 PM
26. As any of you who have ever done a home improvement project yourself know, you estimate the costs involved based on product cost and try to anticipate any curves you might get thrown in the execution of that project. Invariably, the project ends up costing about 30% over your budget. Hardly ever fails. With that knowledge in mind, it's smart to add 30% to 40% to your estimate. If that can be done on such a small scale, then I would call the underestimation of major infrastructure projects, with all the expertise they have available, to be willful deception.

Posted by: katomar on May 11, 2009 10:16 PM
27. Hi all,

I completely forgot to mention:

Thanks for the great blog Jim, 100% perfect, and the kudos to Westneat are well-deserved.

Thx,
nlc 1

Posted by: new left conservative # 1 on May 11, 2009 10:21 PM
28. swatter: Please define "lying". On these boards, we have a definition of "lying" as someone saying something which another of the moderators doesn't like. That, by definition is "lying".

Please provide a single example of this. Thanks in advance!

Posted by: pudge on May 11, 2009 11:21 PM
29. Hinton has it about right. Those folks were so interested in passing a scheme (Sound Transit) that I believe they "lied" in the true definition of the word. When queried if they had sufficient funds in their budgeting "prior to the vote", they said, "you betcha. We have plenty of contingency and you shouldn't have to worry about overruns". I don't think this was the ivory tower "you betcha" but was a calculated lie.

This state's Big Digg was the fiasco perpetuated by a cadre of power companies called WPPSS or Whoops after the costs became unmanageable. What caused these overruns? The proverbial clause stating, "acts of God", or in this case everchanging federal requirements. This coupled with WHOOPS deciding to act as Project Manager, you had the recipe for disaster.

Hopefully, in these new budgets, they don't use today's numbers (I doubt it) and use more practical numbers that will include the huge round of inflation we will be getting in 2011 and 2012 (maybe earlier, maybe later but definitely coming within the scope of this project).

If they aren't using inflationary numbers, and with what we know now, I can say the Staters are "lying" in the strict sense of the word.

Posted by: swatter on May 12, 2009 07:48 AM
30. nlc@25

Government does have laws protecting property rights. Are you suggesting that residential areas be arbitrarily rezoned by fiat so that high rises can be built? This is what caused all the uproar in New England vs. Kelo. Because invariably it's either government looking for more tax revenue, or some lobbyist developer looking for a sweet deal to build. Both are wrong, private property is private property.

Also, Seattle makes every effort to foster permitting and building of the condo/ dense urban buildings we see going up everywhere. So I don't see how you can say that government is not very much working towards that goal. And often, any parking for such building is quite limited, which has been a big problem in attracting buyers, but definitely working towards the goals you envision.

It's not a car loving vision that most have. It's simply a getting from point A to B in the quickest and most convenient manner loving vision. You can't put the cart before the horse. When one wants to get to say, Redmond from Puyallup, the vast majority will choose their cars. And that will be the case for decades as transit focuses on the I-5 and I-90 corridors first.

The simple reality is that it is the geography and vastness of the West, and the density of the West as it grew with respect to current technologies that created the auto boom.

And I predict that it will be a new technology that will ultimately change the game again as well.

Posted by: Jeff B. on May 12, 2009 09:06 AM
31. Had the opportunity recently to get some numbers on the need for Brightwater. And it appears that Maggi Fimia was right!

Here's what I learned.

The Renton Sewage Treatment facility operates at an average daily rate of 100 million gallons. Its peak is around 160 million in heavy weather, but it has a whopping unused potential capacity of up to 280 million gallons of sewage a day, or 120 million gallons not currently being used.

So what are we getting by Ron Sims' forcing Brightwater on us at a cost of a billion, oh no, $2 billion dollars?

Unbelievably, Brightwater is designed to run at only about 35 million gallons a day. And its peak capacity is about 55 million gallons a day, or less than half the unused capacity in Renton!

So Renton has an untapped capacity of 120 million gallons of treatment a day, but we're wasting $2 billion that could be used to improve the overall system, like replacing 100 year old wooden pipes throughout the Puget Sound, so that builders can avoid higher connection costs in north King and south Snohomish counties?

Maggi Fimia fought single handed to expose the lie of Brightwater's desperate need and lost. Sims ultimately got what his builder buddies wanted, and we're going to pay for it long after Sims is done screwing up Hud.

Posted by: Reality on May 12, 2009 09:23 AM
32. You will not find a better book about planning and local government abuses than "The Best-Laid Plans." This from page 253:

A group of Danish researchers led by Bent Flyvbjerg found that U.S. rail transit projects cost an average 41 percent more 10 and attracted fewer than half the riders than originally projected. In contrast, U.S. road projects went only 8 percent over budget and actually underestimated use. Rail cost "underestimation cannot be explained by error," says Flyvbjerg, "and is best explained by strategic misrepresentation, that is, lying." "Undoubtedly, most project proponents believe their projects will benefit society and that they are thus justified in cooking costs and benefits to get projects built," Flyvbjerg adds. "The ends justify the means, or so the players reason." Even after cooking the books, planners analyses nearly always show that rail is the least cost-effective transportation solution. Yet cities and transit agencies usually propose to build new rail lines anyway.

Posted by: xabi on May 12, 2009 09:41 AM
33. Government does have laws protecting property rights.

Wrong, wrong, wrong. The people (see Constitution, US) have property rights, which governments are working as diligently as possible to erode and diminish and in some cases, remove.

Aided and abetted by unelected planners (whose political philosophy accepts as an axiom that far-seeing and wise planners are ever so much more qualified to dispose of property than its mere owners), there's a never-ending stream of proposed legislation toward that erosion.

The only legislation 'protecting' property is that in which a politically powerful entity enters a pact with an owner, in which said owner forever gives up her rights to alter or improve the property, in order to convert it to perpetual scenery for the benefit of others. If anything, it's a protection racket, not a protection of property rights.

Worse, there's a never-ending stream of government 'regulations' that seize and distort and diminish the tattered remnants of the rights of owners over their own property.

If progressives really believed in civil rights, they'd be out in the streets rioting to protect the free use and exchange of property between consenting adults. But the best the progressives can muster for consenting adults is the free exchange of sexual activities, which indicates how dwarfed their conception of a free citizenry has become.

Posted by: Insufficiently Sensitive on May 12, 2009 10:53 AM
34. One means of avoiding public works bait and switch tactics is to mandate design-build projects whenever practicable. Build in bid-rejection protection and you end up with go-no-go decisions for a known cost.

Posted by: Paddy on May 12, 2009 12:35 PM
35. For any big project put forth by the government, I always double the initial cost estimate and start from there. Works amazingly well.

Posted by: Frank Black on May 12, 2009 12:54 PM
36. Paddy,
i would like to see the supporters have to secure a performance bond BEFORE their boondoggle is put on the ballot. If the cost estimate is reasonable the cost of the performance bond will be reasonable - if not so reasonable....then they better keep working on the cost estimate until it is reasonable or you are not going to be able to get on teh ballot. Simple solution to the problem and it will work.

Posted by: JDH on May 12, 2009 12:59 PM
37. JDH that's fine, provided sufficient dollars are first budgeted to produce the design and construction documents to allow for that.

How is that done when a vote first is required to even start the project?

I'm not saying you're wrong in principle - just that our system of funding needs to change to allow for this.

Posted by: BA on May 12, 2009 03:44 PM
38. Lies, Damn Lies, and Washington State estimating.
I'll trot this out again, the EIGHT lane
Arthur Ravenel Jr. bridge project in Charleston, SC
In a nutshell, completed one year ahead of schedule and UNDER the estimated cost. Approx 700 million, completed in 2005. Google Arthur Ravenel Jr. Bridge for the Wikipedia info.
Note the earthquake and high wind design requirements. Why again, is the 520 replacement in the billions of dollars?

PS: They included a bike lane too!! (In addition to the eight lanes of vehicle traffic)

Posted by: Sparkules on May 12, 2009 04:59 PM
39. Since when did "marketeers" not "strategically misrepresent" the truth ?

Posted by: Bobo on May 16, 2009 07:17 AM
Post a comment
Name:


Email Address:


URL:


Comments:


Remember info?