PaintSquare.com


The First Word in Protective & Marine Coatings

A Product of Technology Publishing / PaintSquare
JPCL | PaintSquare News | Durability + Design | Paint BidTracker

Chemical & Petrochemical Plant Coating Systems

Coatings Consult

By Warren Brand
| More

Back to main blog page

About the Blogger

Warren Brand

Coatings Consult by Warren Brand

Warren Brand’s coatings career has ranged from entry-level field painting to the presidency of two successful companies. Over nearly three decades, he has project-managed thousands of coating installations and developed specs for thousands of paint and coating applications. NACE Level 3 and SSPC PCS 2 certified, Brand, an MBA and martial-arts instructor, now heads Chicago Coatings Group, a leading coatings consultancy. Contact Warren.

Blog Archives

Tuesday, November 5, 2013

The Perils of O-Ring Thinking

When it comes to failure, there are causes, and then there are causes.

Take the catastrophic Space Shuttle Challenger explosion—NASA’s deadliest accident ever. What caused the 1986 disaster that claimed seven brilliant lives?

Two reasons:

1.         The direct cause—the smoking gun—was the failure of a Viton 0-ring on the right-side solid rocket booster.

2.         But the root cause—the cause behind the cause—was a systematic failure of NASA’s decision-making process.

The same types of decision-making failures that still pervade our industry today.

Now, like most of the materials in our industry, Viton is a polymer—specifically, a widely used fluoroelastomer developed by DuPont.

Foreman
iStock / dmbaker

In a failure analysis, which cause are you seeking? The smoking gun, or the root cause?

So why did it fail on Jan. 28, 1986? Simple (in hindsight): It was too cold for the launch.

Failure Analysis

The Challenger failure analysis plays out much like a coating failure analysis (although certainly with graver consequences).

Consider these factors examined by the Rogers Commission, which investigated the disaster.

Environmentals: The temperature on launch day was 36°F, or 15 degrees cooler than any other launch.

Substrate surface temperature: The joint surface was about 28°F in the shade; about 50°F on the other side.

Material analysis:  “A compressed O-ring at 75°F is five times more responsive in returning to its uncompressed shape than a cold O-ring at 30°F,” the commission reported.

Contributing cause: “The commission concluded that there was a serious flaw in the decision-making process leading up to the launch of flight 51-L.”

There. That’s the line that, quite literally, keeps me up at night.

Like almost every coating failure analysis I’ve ever encountered, this failure was preventable.

Now, dysfunctional decision making wears several faces.

The Definition of Insanity…

… as we know, is to do the same thing over and over again and expect a different outcome. And yet, many companies still do it.

Icicles on Challenger's launch pad
NASA

In hindsight, it was too cold for the Challenger's Viton O-rings to return to their uncompressed state Jan. 28, 1986, causing failure. But the greater failure was higher up NASA's decision chain.

I just held a webinar for the local facility of a $50 billion chemical company, where the engineer was fuming about ongoing problems with corrosion, paint and coatings. Overruns and premature failures abounded. 

Why? Well, the engineer grumbled, there was only one approved coating applicator, the specifications were 12 years old, and they were probably provided by “the paint salesman who brought the most doughnuts.”

But the root cause of the problems had nothing to do with the specifications or the applicator. Those were just the “O-rings.”

Decisions, Decisions

The root cause was the plant’s decision-making process. What management needed, I said, was a third-party condition survey to determine what needed to be addressed, and when.

It also needed an independent optimal coating identification process. And a specification, RFQ, and QA/QC protocols. Multiple bidders. And inspection services during application. In other words, a whole-process solution.

When I estimated a fee for these additional steps, the engineer said it was “nothing” compared to the costs of their botched coatings.

So, we signed him up and the plant lived corrosion-free ever after, right?

Well, no. In the end, the engineer asked if we could simply “do something” to make the contractor do a better job and said the coating specs were “probably fine.”

I had a similar meeting with one of the world’s largest entertainment companies. I flew out to California for several long meetings where everyone agreed that our process would save them a lot of money and increase the durability of their painting processes.

Ostriches
Wikimedia Commons / Andrew Massyn

Contrary to popular belief, ostriches do not hide their heads in the sand. Nor should project managers, coating consultants or engineers.

Yet no one was willing, or had the authority, to change the decision-making process.

So it didn’t change.

Ego and Arrogance

Then there was the large Midwestern zoo that was beginning a $25 million rehabilitation, including rebuilding its aquarium.

The zoo hired an internationally known architectural firm to specify the coatings for the aquarium.  We were asked, almost as an afterthought, to conduct a peer review of the specifications.

Our conclusion: The specifications were seriously flawed for a variety of reasons. When we presented our findings, the architect was furious. I was reporting data, and he was attacking me personally. There was no interest in a discussion—just in saving face.

“You just don’t understand!” the architect yelled. “This isn’t a coating project!”

Actually, the problem was that he didn’t understand that it was.

In the end, the zoo deferred to our judgment. The other firm still wrote the specifications, but we were hired to review them and are slated to provide inspection services during application.

The Plague of Politics

I just spoke with the engineer of a wastewater treatment plant where a salt holding facility was being painted with a tri-coat system. An outstanding coating company and suitable coating system had been specified.

Challenger explosion
NASA

The Challenger disaster claimed seven lives. Investigators "concluded that there was a serious flaw in the decision-making process leading up to the launch of flight 51-L."

We had been called to see if we could get an inspector to settle a dispute about the blast.

The coating maker had a highly competent rep on site who was concerned that his material was not being installed properly. There was a contractor who had hired a blasting contractor and was going to try to paint himself. Then there was a local, well-known engineering firm that had written the specification.  

We arranged for the inspector, but then the order was cancelled; the engineering firm would handle the dispute.

When I asked the engineer if SCAT testing was included in the specification, he said no, and that no steps were being taken to check or treat the surface for soluble salts.

If this isn’t a premature and catastrophic coating failure waiting to happen, I don’t know what is.

And, when the coating fails, everyone’s going to blame it on the application—the “O-rings.”

Competition over Collaboration

Finally, there's this. Years ago, when I owned my own coating company, we were asked to bid on coating more than 120,000 square feet of previously painted concrete.

The plan was to partner with a much larger coating firm.  The other owner and I looked at the specifications and logistics, which were both fine.

But we also paid close attention to the adversarial environment the GC had created in the process.  The liquidated damages per day approached $20,000.

We decided not to bid. And in the end, the project experienced a massive coating failure during operation.

The O-ring in that case was application issues in the guise of an amine blush.

But the real failure was rooted in the adversarial environment of that early pre-bid meeting.

Now What?

So what’s the answer to this shortsighted, and potentially catastrophic, type of thinking?

Our industry is a family of highly competent, well-intended individuals whose goal is to provide service to our clients.

But is that enough?.

As coating professionals, we must go beyond the O-ring focus on products and services and educate clients to the critical importance of sound decision-making practices.

Structural integrity, and sometimes lives, depends on it.




More items for Program/Project Management
   

Tagged categories: Chicago Coatings Group; Coating failure; Failure analysis; Inspection; Project Management

Comment from Jeffrey Stewart, (11/18/2013, 1:13 PM)

GREAT Article and a needed blast of honesty. There is a lot of "been there, seen that, and lived that" in this article. If there is one other area that I would have liked to see mentioned is, "I know this is wrong, but we don't have time to do it right" which is never remembered when the finger pointing starts after the failure.


Comment Join the Conversation:

Sign in to our community to add your comments.

SAFE Systems, Inc.
Portable Blast &
Recovery Equipment

Trailer or skid mounted blast and recovery equipment. Systems designed for maximum versatility, environmental compliance
and overall cost savings.
Call 1-800-634-7278


Mitsubishi Gas Chemical America
Performance Amine 1,3-BAC

A highly reactive cycloaliphatic diamine offering superior performance. Reasonable cost and curing efficacy makes it suitable for all types of epoxy resin applications.


Minerals Research & Recovery

HIGH PERFORMANCE ABRASIVES


“Made in the USA!”

Why recycle waste from other countries? Go FASTER, CLEANER, at 1/3 THE COST with MR&R “All-American” Sharpshot®HP!!

WATCH THE VIDEO


International Paint LLC

International Paint Engineered Coatings

Learn about our solutions for:
  • Structural Steel
  • Piping & Equipment
  • Storage Tanks
  • Pressure Vessels
  • Secondary Containment


    Blastox/The TDJ Group, Inc.
    Blastox - One Step
    Lead Abatement

    Don't waste $$ on added labor steps with other methods. Don't mix, meter or apply at the job-site. Avoid strict hazardous waste rules.
    Let your painters paint!


    Wasser High-Tech Coatings Inc.
    Wasser Coatings Protect

    some of the most important bridges in the country; learn about our NEPCOAT-approved system and our entire range of MCU & Polyurea coatings. 1-800-627-2968 www.wassercoatings.com


    ITW Binks
    Built for Tough Jobs

    From Epoxies to Urethanes to other high solid coatings, the new Binks Airless 75 delivers a great finish using an ergonomic design. Visit binks.com for more information.

  •  
     
     
    Technology Publishing

    The Technology Publishing Network

    The Journal of Protective Coatings & Linings (JPCL) PaintSquare
    Durability + Design Paint BidTracker JPCL Europe

     
    EXPLORE:      JPCL   |   PaintSquare News   |   Interact   |   Buying Guides   |   Webinars   |   Resources   |   Classifieds
    REGISTER AND SUBSCRIBE:      Free PaintSquare Registration   |   Subscribe to JPCL   |   Subscribe to PaintSquare News
    MORE:      About PaintSquare.com   |   Privacy policy   |   Terms & conditions   |   Site Map   |   Search   |   Contact Us
     

    © Copyright 2000-2014, Technology Publishing / PaintSquare, All rights reserved
    2100 Wharton Street, Suite 310, Pittsburgh PA 15203-1951; Tel 1-412-431-8300; Fax 1-412-431-5428; E-mail webmaster@paintsquare.com