interdictor ([info]interdictor) wrote,
@ 2005-10-28 11:01:00
Previous Entry  Add to memories!  Tell a Friend  Next Entry
FLASHBACK: Assembling the Team to Take on Hurricane Katrina; Part II
Post by Sigmund Solares
Chief Executive Officer
Intercosmos Media Group, Inc.

Editors note: In the Flashback posts, I am going to provided details of what happened before, during and after Hurricane Katrina hit. Today I am going back to Saturday, August 28, 2005, the day before Hurricane Katrina hit. Flashback I is posted at http://www.livejournal.com/users/interdictor/88989.html.

With my team in place, my plan was to sleep late on Sunday morning so that I could stay up when the hurricane hit. I needed to be well rested. From past experience, I knew it could be a real endurance test. I was surprised to be awakened around 7:30 a.m. by Michael Brunson. He called to tell me that Hurricane Katrina had strengthened greatly overnight with winds gusting over 200 MPH -- and that he had decided to evacuate. With the word that Brunson was leaving, I feared that other members of the team would leave as well. I then started making calls to see who from my team still planned to stay at the data center.

Meanwhile, I called Barnett and told him about how the storm had strengthened, and to ask if he was still with us. Barnett responded that he definitely was coming to the office, and that he was packed and ready for adventure, pausing only to ask me if I had my gun and bullet-proof jacket.

I called Donny, knowing that he would already be aware of the storm’s development. Donny had some things to finish around his house to prepare for the storm, but he confirmed that he would join us shortly after.

It then came down to James Macallum. He was in. We still had a core team.

Even with their assurances, I still was quietly nervous that they might decide to evacuate. There was no precedent for what a storm with 200 mph gusts would do to New Orleans. To take the media’s word for it, you’d have to be a madman to stay in town, but, they said they were staying.

Four out of five wasn’t bad, but one more would make me feel a lot more secure.

About that time, James Winston, a programmer, walked past my office, and a moment later he walked by again. He had loaded his truck with some of his belongings and was debating evacuating.

James is a talented programmer, and I knew that he would be able to add to the team. Without trying to pressure him, I told him that we could definitely use his help if he decided to stay. In the end, he did.
Since 1999, when we started InterCosmos, we adhered to the philosophy that individuals should cross-train to a certain extent, especially on mission critical operations. I wouldn’t know for a few more days just how glad I’d be that we adopted that practice.
Perhaps I was a bit overconfident before the worst disaster in the country’s history, but even with only one individual from network operations staying at the data center, I still believed that we had enough experience operating the generator and running the data center to pull through. Donny, especially, had the technical expertise necessary that we would need when our city turned into Ground Zero.
As evening approached, hurricane advisories and news stories predicting gloom and doom started to be passed around by email and instant messenger. The advisories were downright scary. We were advised that, “Every window in downtown New Orleans would blow out.”

Our friends and other employees were telling us how bad it would be. We knew that this was not an ordinary storm. However, we talked about the hype, and as a team we were not intimidated by the advisories.

We definitely didn’t believe the one that said some high-rise buildings in New Orleans would collapse. However, the fact that we even had to consider such a concept added to the gravity of the situation.

We reasoned that the odds were in our favor; if buildings started to collapse in the CBD, our building would not be among the first ones down, as it is wider and shorter than others in the CBD. So we added “keeping watch for falling buildings” to our safety checklist. We then concluded our mental fire drill in agreement that we were in good shape.

At that point, we decided to try to get some sleep before the storm hit. Despite the frantic tone of the media, things seemed pretty calm. It was hard to imagine that total chaos could be just hours away.



(16 comments) - (Post a new comment)

Details on your preparation, Please?
(Anonymous)
2005-10-28 07:37 pm UTC (link)
Sigmund, Thanks for continuing your story. Can you provide details about what food you stocked, how much water, how much diesel you had on hand, how long you thought you would be without utilities? Did you make any arrangements for fuel delivery prior to the storm? Can you weave those details into future installments? Interestingly enough, our Fort Lauderdale POP lost power for about an hour yesterday after the generator's diesel ran out. 500 gallons was not enough. They did get a fuel delivery immediately after.
Router Dan

(Reply to this) (Thread)

Re: Details on your preparation, Please?
[info]interdictor
2005-10-28 08:15 pm UTC (link)
Ouch. Sorry to hear that you ran out of fuel. In an upcoming installment I will definately cover what we had stocked up prior to the storm. Sig.

(Reply to this) (Parent)

Another Flashback, of sorts
[info]wbahny
2005-10-28 08:40 pm UTC (link)
I've been keeping a database of all of your (anyone posting as Interdictor) posts. I'm also working on a webapp to view and edit these in an archive setting. I thought it would be a good thing to have down the road (perhaps looking back 20 years :-) ) for me, as a loyal reader, and those of you actually involved in the "fun". Obviously, I'm still adding to it, but are you or any of your staff interested in a copy as it stands right now? Are any readers interested in a copy?

Wally

(Reply to this) (Thread)

Re: Another Flashback, of sorts
[info]perception8
2005-10-28 08:47 pm UTC (link)
I saved a copy awhile back but I'm not positive I still have it. I think this is one for a book. I'd appreciate a link. Merrily

(Reply to this) (Parent)(Thread)

Re: Another Flashback, of sorts
[info]wbahny
2005-10-28 09:03 pm UTC (link)
I can't give you a link, it's not hosted. If you want a copy of the database, it's about 3MB unzipped. If you give me your e-mail address, I can send it via e-mail.

Wally

(Reply to this) (Parent)

Re: Another Flashback, of sorts
(Anonymous)
2005-10-29 12:28 am UTC (link)
Definately. Send a copy to press@intercosmos.com. Thanks. Sig.

(Reply to this) (Parent)(Thread)

Re: Another Flashback, of sorts
[info]wbahny
2005-10-29 01:13 am UTC (link)
Sure. Do you want a copy of the app as it stands now, or just the database? The app only has an admin page, which I was using to add info the database, I haven't added a view-only section yet. I'm going to continue working on it in my free time (all 1 second of it a week, it seems), and hope to start working on the view-only section next.

Wally

(Reply to this) (Parent)

Re: Another Flashback, of sorts
(Anonymous)
2005-10-29 06:02 am UTC (link)
YES!

soshrin at citlink.net

Thank you!

(Reply to this) (Parent)

Thanks for flashback
[info]perception8
2005-10-28 08:48 pm UTC (link)
I appreciate what you're doing now: filling in some blanks! Good show. And thanks. Merrily

(Reply to this)


[info]alintaflame
2005-10-28 09:15 pm UTC (link)
Although reading through the original crisis was helpful (and entertaining, Barnett as a very engaging and honest writing style). Its interesting to read how you prepared for it and your reactions in hindsight to such a thing.

Any chance you can write them faster?

(Reply to this) (Thread)


(Anonymous)
2005-10-29 12:30 am UTC (link)
I will do what I can to get through the flash backs faster. Unfortunately, this has to take a back seat to the business (directnic.com). Sig.

(Reply to this) (Parent)(Thread)


[info]iluvdaphne
2005-10-29 05:05 am UTC (link)
this is cool to read, thanks :)

(Reply to this) (Parent)


[info]nrs135
2005-10-29 05:09 am UTC (link)
I've been watching this since the early days and was psyched when I read your story in Wired Magazine the other day. Can't wait for the other flashbacks.

(Reply to this) (Thread)

link?
(Anonymous)
2005-10-29 06:01 am UTC (link)
I would love to read the interview.. :)

(Reply to this) (Parent)(Thread)

Re: link?
[info]nrs135
2005-10-29 06:27 am UTC (link)
The story appeared in the Nov issue of Wired. The link on the website is wrong, the correct link is: http://www.wired.com/wired/archive/13.11/posts.html?pg=2

(Reply to this) (Parent)

Re: Another Flashback, of sorts
[info]interdictor
2005-10-29 08:19 pm UTC (link)

Anyone have archived recordings of the video streams? I missed all of that :(

Noah

(Reply to this)


(16 comments) - (Post a new comment)

Create an Account
Forgot your login or password?
Login w/ OpenID
English • Español • Deutsch • Русский…