EDITION: U.S.
 
CONNECT    

Tom Loughlin

GET UPDATES FROM Tom Loughlin
 

When Complex Systems Fail

Posted: 8/27/10

As progress continues in efforts to permanently shut down the oil well damaged by the explosion on the Deepwater Horizon oil rig, engineers, policymakers and others must now turn their attention to taking a renewed look at the far-reaching consequences that can occur when complex, human-engineered systems fail. Regardless of whether the complex system in question is an oil rig in deep water, a nuclear power plant, a spacecraft or even a long-haul jet, engineers and others involved in design, regulatory or maintenance processes have a moral imperative to fully examine not only the development and operation of these complex systems, but also their "fault-tolerance," in other words, a design's ability to continue to operate at a reduced level or safely cease operation even in the event of a predictable failure.

Tragedies like Deepwater Horizon, which take a toll on human life and result in catastrophic social, economic and environmental consequences, remind us of both the robust nature of these systems and of their vulnerability. It's precisely because of the overwhelming success and vigor of such systems that we often take their reliability for granted. Most of us rarely consider the safety of an oil rig until something goes awry and it makes the front page.

Likewise, we don't consider the vast efficiencies of modern transportation unless our aircraft gets rerouted and we miss that all-important connecting flight. Most of us don't think much about the power grid unless there is a systems failure and our lights don't respond when we flip the switch. Yet, on January 28, 1986, it was a systems failure that caused the Space Shuttle Challenger to explode 73 seconds into its flight, an incident that nearly brought an end to America's space program.

Two years following the Challenger disaster, the Aeronautics and Space Engineering Board stated that NASA's processes for analyzing failure modes had to include three elements: a comprehensive method to identify potential failure modes and hazards; a specific, quantitative methodology for identifying and assessing the safety risks, and a risk management process "by which the safety risk can be brought to levels (or values) that are acceptable to the final approval authority."

When we look at the Deepwater Horizon tragedy we can see how these steps resonate today -- by recognizing the necessity of establishing appropriate risk levels for the functioning of complex systems and for assuring appropriate certification and stringent quality assurance.

To maintain the public's confidence and trust, engineers and other technologists must remain vigilant and mindful never to test the boundaries of prudent risk management. One untimely decision -- just one misstep -- can change the course of many lives. Our world today is haunted by the specter of risk -- ranging from the technical to the economic to the geopolitical. That's why the time is right for a cross-disciplined approach to reviewing risk-management processes as they relate to complex systems and sound engineering ethics.

In October, the American Society for Mechanical Engineers (ASME) will convene a task force of experts and authorities in risk management processes to begin exploration of experiences across industries, lessons learned, best practices, R&D needs and ethical responsibilities associated with mitigating the consequences of complex system failures.

Assessing risk is a rigorous technical process that involves sophisticated methodologies. Engineers must be vigilant in analyzing and applying protocols and scenarios to thwart events that can cause an undesired consequence. Engineers possess the core competencies both to assess the technical specifications of the components used in complex systems and to ensure that those systems live up to the necessary standards for the life of the project.

All of us -- engineers, policymakers, the media and the public -- have a role to play in ensuring that proper practices are in place to minimize the risks inherent with many critical complex systems.

Thomas G. Loughlin
Executive Director, ASME

 
 
  • Comments
  • 8
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
photo
HUFFPOST SUPER USER
Tyrione
02:25 AM on 09/07/2010
I don't want to denigrate a fellow Mechanical Engineer, but as an Associate Member of ASME I'm very tired of non-techni­cal engineers managing the ship, so-to-spea­k.

``A leader in associatio­n management with a strong track record in strategic planning and organizati­onal assessment­...''

Seriously? His pedigree is all business and his bachelors in M.E. is clearly just a stepping stone to his business career.

When I see a Ph.D in say non-linear dynamics with decades of managing nuclear power systems [like my mentor] I'll be impressed.
05:53 PM on 08/30/2010
The BP disaster is following a familiar path - engineers are going to be found responsibl­e for not fighting the rest of management hard enough. After all, non-techni­cal management can hardly be expected to know the possible consequenc­es of their decisions.

I put it down to Star Trek - a whole culture used to watching Capt. Kirk pushing the SS Enterprise way past Scotty's limits.
08:22 PM on 08/29/2010
Here is a typical project meeting to work out the time line and budget for a new product.

Attendees: Management­, Sales, and Engineerin­g.

Management­: We can apply our experience and make a safe, reliable product. I look forward to your input as we make the schedule.
Sales: We will have a perfect fit in this market segment. We can compete against ABC and take away 45% of their sales.
Management­: Excellent. How long will it take to get done?
Engineerin­g: With hardware, software, prototype, compliance­, sourcing, and field test, we estimate 2 1/2 years.
Sales: That's not acceptable­. Our window will close in 6 months.
Management­: You have one year. Now, how much will it cost?
Engineerin­g: With hardware, software, prototype, compliance­, sourcing, field test, and extra contract engineerin­g to meet a one year schedule, we estimate $5 million dollars.
Sales: That's not acceptable­. We will miss our cost targets.
Management­: Then it's agreed! We will have it done in one year for $1 million dollars. We look forward to this high-quali­ty product being introduced­.
Engineerin­g: (thinking) I should have taken that job picking weeds...
11:40 PM on 08/29/2010
Well done. I might even add a comment from the Marketing Department­:
"That's no good! We told the folks at the Trade Show that we'd have it in eight months!"
03:25 AM on 08/30/2010
They took the one working developmen­t prototype, which they try to sell, even though it doesn't have certificat­ions. Engineerin­g is able to prevent the sale. Alas, Engineerin­g loses by winning.
photo
HUFFPOST SUPER USER
jabailo
(Participant) Texeme.Construct()
02:33 PM on 08/29/2010
Sometimes the problem is the systems aren't complex enough. Think of the human body, and how many complex intertwine­d layers of cortexes go into the perceptual network. Think of how many prcoesses support homeostasi­s.

Our large scale technical systems have only been in place for 60 years or so. We have just been applying informatio­n systems in the last 30...and components­, web service and functional programmin­g in the last decade.

So, sometimes more is more.
09:54 PM on 08/27/2010
"All of us -- engineers, policymake­rs, the media and the public -- have a role to play in ensuring that proper practices are in place to minimize the risks inherent with many critical complex systems."

That may be well and true when the shareholde­rs of vast corporatio­ns are not obsessed with their need for greater profits and immediate results. As in the BP Gulf disaster, complex systems and machinery were modified without authorizat­ion, safety issues were side-stepp­ed and many federal regulation­s were ignored for the sake of production­. It makes no difference how many 'proper practices' are in place to minimize risks if none of those practices are followed.
04:03 PM on 08/27/2010
BP could have dropped concrete slabs on the well, until it crushed all the valves, pipes, and sealed off the hole, on Day 2. Doesn't sound like a complex mechanical engineerin­g decision to me. What, you're looking for a job, or something?