What Happened at Uncorrupted?

Some of you may have seen my wife’s post about Uncorrupted a few weeks ago. She expressed her view about what happened but I feel like I should provide some technical details.

I typically keep one backup server racked in the datacenter in case of a hardware failure, or configuration issue that would require significant down time to resolve. I was made aware of an issue that was preventing some people from visiting clients websites and was unable to identify the problem. Firewalls were flushed, tests were performed, and I was able to get to the site from test servers in multiple different countries. I threw up a test site on the backup server and one of the folks who couldn’t load the website was able to get in, so I decided to move all the accounts onto this other server.

The migration started at about 3:00am – I started by restoring accounts that had private IP addresses and had them all back online in a matter of 20 minutes. I moved on to the shared IP clients and was unable to get a single one restored. I’m still not entirely sure what the problem was – but atfter about 6 hours of workin on the issue I decided there wasn’t anything I could do without heading down to the datacenter. I was tired, frusterated, and emotionally drained so rather than prolonging my agony, I called up a friend who also runs a hosting company and asked him if he would like some new clients. I was not prepared to leave everyone’s website offline for an extended period and I needed some rest. In the end, I believe I made the right decision… it was a difficult one to make because it basically meant the end of Uncorrupted (as I gave all the clients away), but it was very important for me to get everyone’s website back online.

So that’s what happened… stay tuned to hear where Uncorrupted is headed. It’s exciting.