Matrix Games Forums

ORIGINAL: chief

Help !! I need a (SPwaw Depot) FIX, Badly........[:@][8|]

This node was the only one not on RAID and, sadly, was going to make the
transition to RAID in less than a week... talk about bad timing. Our newest
node and the new de facto standard for all of our servers we provision is a
RAID 1+0 setup with 4 hard drives, which would have taken the failure we
experienced last night without issue and without any downtime.

ORIGINAL: David Heath

Hi Guys

Please let Bernie know if there is anything we can do please let me know.  I hope the site back up shortly.

David

Fellow Geeks,


We are continuing work to get service restored to all VPS users on Node1 at this time. We expect service to be back online and operational within 4-6 hours. We are relocating the data from the old drive to the new drive at this time, after which service will be restored immediately.


We understand that this incident was unacceptable and for your trouble, we will be providing you a 1 month hosting credit on any accounts affected by this outage. This credit will automatically be applied and will be visible on your billing account within the next 72 hours.


Unfortunately, when dealing with technology, sometimes it will fail. We are very sorry for the trouble we have caused you and your website during this downtime. We understand that you went Geek to experience superior web hosting and, in the last two days, we have failed you. It’s hard for geeks to face a defeat, but we’ll overcome this hurdle and will continue building the best internet playground there is.


Over the last two days this server experienced a primary hard drive failure and a corrupted superblock on the drive containing account data. Normally, in our past experience, an uncomplicated restore of a failed drive is handled within only a couple of hours and service downtime is kept to a minimal. Unfortunately, nothing about this restore was normal or uncomplicated. Every time we saw progress, we also saw a setback, which was disheartening when we thought of all of the geeks affected by this. The biggest delay you’ve seen in restoration of service is waiting on us to safely recover the data from a corrupted drive. At this time, Geek Support has successfully recovered the data and is in the process of restoring your accounts and files to the server. We had to take our time with some of this delicate work because we wanted to ensure 100% restoration and we are sorry for the delay caused by this. In any incident such as this, there are always lessons to be learned… even by the most experienced of Geek Support system administrators. We take this incident very seriously and we’ve already implemented some changes to the way we manage account data and we’ll be implementing more to ensure the best possible safe haven for you and your website.


If you wish to discontinue your service with Geek Storage, please email billing@geekstorage.com and we’ll issue you a full refund of your hosting service. We hope that you’ll stay, but we understand if you need to leave. In the end, we only want what is best for you and your website.


In closing, we would like to extend our thanks for the patience and understanding you have had through this very trying time.


Regards,


Head Geeks
GeekStorage.com

We have service restored to almost everyone, however, there are going to be issues likely that have popped up for some. If you encounter anything, please let us know and we'll work to resolve it as quick as possible.

Some are still without service while we resolve an issue with python, however, it shouldn't be much longer until that is resolved.