Unplugged

Well the inevitable happened. We lost power at around 11:00pm EST. My UPS’ at home lasted about 45 minutes, then went down with all the servers. The majority of VA is without power right now, and it’s not expected to be back anytime soon. We’ve been running on generators here since about 11:00pm. My datacenter engineer says that under our current load, we should be able to go at least a week without refueling our generators. That’s pretty fuckin impressive if you ask me. Now if I could figure out a way to run a long ass extension cord the couple of miles to my house 😉 Wanna see just how bad it is? Check out these links.

http://www.dom.com/news/outage_map.jsp
http://www.dom.com/news/outage_sos.jsp

It’s been a good weekend. Friday night before I went to work, I decided to get a new server for stvlive & the rest of our personal sites. I had been in contact with someone who wanted to get rid of his server he was leasing at a company called cyberwurx. They have an excellent reputation, and the price he got on the server was fantastic. So I accepted the offer at about 7:30pm. He wrote me back, and told me he passed my info on to cyberwurx to get the ball rolling.

I expected not to hear from them until Monday. I got an email from them about 10 minutes later telling me that they would go ahead and rekick the server for me right away, and gave me the info I needed to register with them. So I sign up, get all my login info for their support stuff, and go shower. When I came back down, there was an email saying my server was online, and giving me my IP’s and passwords. So I got started configuring stuff Friday night at work.

Saturday afternoon we woke up, and went out to dinner with Kevin & his wife. It’s always nice to go out with friends. We don’t get to enough After dinner we came back, and I got back to work on the new server. By about 3:00am I had everything up and running on the server, and decided to do a final rsync of the data, and switch the DNS over. Everything works great, except a couple of minor things I need to work out.

Sunday afternoon we woke up, and drove to Columbia to have dinner with Steph’s family. It’s been a few months since we all went out, so it was really nice to see them. Food was good too! Been working on some fine tuning of things since we got back (minus a dunkin donuts run at about 3:00am). Now I’m doin some updates on my desktop, and goin to bed.

Pork chop sandwiches!

So I’m still at work fighting a stubborn hozed harddrive. I’m hella tired, and a bit delerious. These movies have been floating around for some time, but I just cant stop watching this one. The audio is not really work safe, so make sure you put the headphones on if you that sort of thing gets you in trouble. The video is safe.

When the grass is cut the snakes will show

Note to self.. Mail server is cursed.

Just a few weeks ago, I had to completely rebuild my mail server due to a hozed HD. Things were running smooth, and I had managed to get all kinds of shit working that I had been meaning to for a while. Fast forward to Monday night.

Got to work at about 10:30pm and tried to ssh into my mail server. Immediately it returned a connection terminated. So I had Steph go look at the console, and sure enough, it had a kernel panic. She rebooted it, and it did it again. Rebooted again, seemed to be okay. I start investigating the panics, and come to the conclusion that it’s probably bad RAM or the swap partition iz fux0red. As I’m looking around, I get some dma errors (a sign of a dying HD). So when I got home in the morning, I brought the server down to test the RAM. All tested fine. The HD however, told me to go take a flying fuck!

So I spent several hours attempting to clone the drive, but it was too far gone, and kept crashing on me. Finally at about 5:00pm I gave up and went to sleep. I woke up at about 3:00am and started a clean install. Luckily I was able to mount the old HD, and copy the maildir’s, and important configs, so everything seems to be in order now.

Covad got dispatched out again today. Even after I tried to explain to the dispatcher that my DSL was up, just not at the right speed. So when the d00d showed up this morning, I was like go away, and fix my shit at the DSLAM! With any luck this will be closed out today.

Aside from that, I’m working on a migration process to move serve-you.net to a new datacenter. Meanwhile Steph seems to be dying from ebola or some shit.