|
Discussion Forums
|
Thread: Amazon EBS sucks I just lost all my data
|
|
|
Replies:
18
-
Pages:
2
[
1
2
| Next
]
-
Last Post:
May 14, 2010 10:10 AM
by: mattcodes
|
|
|
Posts:
8
Registered:
5/8/10
|
|
|
|
Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 12:22 AM PDT
|
|
|
Amazon EBS service sucks, they promise redundancy, it is BS. Here is what I just got in my email:
>>>>>
This is a notification that your volume vol-13c9647a experienced a failure due to multiple failures of
the underlying hardware components and was unable to be recovered. We recommend recovering from your
most recent snapshot.
We regret the loss and inconvenience.
Sincerely,
--- Dave Dopson
Here is except from their EBS description
Each storage volume is automatically replicated within the sameAvailability Zone. This prevents data loss due to failure of any singlehardware component.
|
|
Posts:
8
Registered:
5/8/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 12:29 AM PDT
in response to: apliszka
|
|
|
I am going to post this message all over the net, because Amazon you should warn people about true reliability of your service.
|
|
Posts:
98
Registered:
2/19/07
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 1:32 AM PDT
in response to: apliszka
|
|
|
hi apliszka,
if i read your message they did not over-promise on anything. amazon promises to prevent 'loss due to failure of any single hardware component'. and in the mail you got it says the failure is due to multiple failures of underlying hardware components.
amazon aws clearly states you have to have to design your architecture for these kinds of events. they even have a wonderful way of backing up volumes called a snapshot. as far as i can see this is very unfortunate, but something that occasionally happens.
groet,
jurg.
|
|
Posts:
1
Registered:
5/9/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 10:04 AM PDT
in response to: apliszka
|
|
|
Of course when Amazon loses your data they are ALWAYS going to say "multiple failures". They shouldn't buy equipment so cheap that multiple failures occur more often than once in a billion years.
I hope they aren't running any nuclear plants. Sincerely.
I have used computers for twenty five years. I have run data centers. I rarely experience ANY failure. NEVER multiple failures.
This is simply AMAZON NOT TAKING RESPONSIBILITY. Its cause is probably poor maintenance or under trained or under supervised staff.
If they are going to use crumby equipment they should take responsibility for backing up themselves.
|
|
Posts:
8
Registered:
5/8/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 10:04 AM PDT
in response to: truthtrap
|
|
|
Jurg, the line in Amazon's EBS description
>>>Each storage volume is automatically replicated within thesameAvailability Zone. This prevents data loss due to failure of anysinglehardware component.<<<
is useless, and it should be removed. EBS is either reliable or not. You cannot be a little pregnant. It is misleading.
Amazon did great job communicating the message that EC2 is unreliable, and that users have to architect their solution in the right way. I think Amazon have to communicate the same message about EBS.
|
|
Posts:
8
Registered:
5/8/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 10:13 AM PDT
in response to: Christopher G. ...
|
|
|
Christopher
I totally agree with you.
|
|
Posts:
98
Registered:
2/19/07
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 10:30 AM PDT
in response to: apliszka
|
|
|
honestly guys, you are whining. if you read the rest of the description you see a section on durability. i will not quote it, but it never every claims to be failure proof.
i have had my share of failed volumes, and it sucks. i have also lost some data, because i can't be snapshotting every second. but all in all it has been much much better than all the hardware i have ever used for my services.
read this, to see the opinion of someone else on a related topic
http://alestic.com/2010/05/ec2-move-ebs-boot-instance "but in the time it takes to write a complaint, you might be able to move your server to new hardware within EC2 and go on with your business" the same goes for every other asset available.
amazon never claims to be 100% reliable, so design your stuff with that in mind.
|
|
Posts:
3
Registered:
5/9/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 10:51 AM PDT
in response to: truthtrap
|
|
|
That does suck. I've never had that issue, but I think if the data is important/crucial to your app/business then snapshots are a must. When setting up these environments you should try to remove/handle any single points of failure.
|
|
Posts:
8
Registered:
5/8/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 10:53 AM PDT
in response to: truthtrap
|
|
|
This is what Amazon EBS promises
>>>Amazon
EBS
volumes are designed to be highly available and reliable. Amazon
EBS
volume data is replicated across multiple servers in an AvailabilityZone to prevent the loss of data from the failure of any singlecomponent. The durability of your volume depends both on the size ofyour volume and the percentage of the data that has changed since yourlast snapshot. As an example, volumes that operate with 20 GB or lessof modified data since their most recent Amazon
EBS
snapshot can expect an annual failure rate (AFR) of between 0.1% –0.5%, where failure refers to a complete loss of the volume. Thiscompares with commodity hard disks that will typically fail with an
AFR
of around 4%, making
EBS
volumes 10 times more reliable than typical commodity disk drives.<<<
Looking at past two weeks alone, I do not think they can make these claims anymore, and they should remove them from their website.
Just read the posts many people have EBS problems, it does not look like 0.1% margin to me.
This looks to me like a base for legal actions.
|
|
Posts:
1
Registered:
5/9/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 9, 2010 8:27 PM PDT
in response to: apliszka
|
|
|
take it easy dude. learn from experiences. we living in a inperfect world. hope amazon will improve their service over time. give them a chance.
|
|
Posts:
253
Registered:
7/21/08
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 10, 2010 3:53 AM PDT
in response to: asiancoolz
|
|
|
I've seen on another thread here someone from AWS say that frequent snapshotting automatically makes EBS more durable.
The only vol we ever lost was the one that we never snapshotted.
It is hard for me to imagine multiplen failures at once. I've lost a disk in a RAID 5 array, but never two at once. But, this is the reality of the situation. Snapshot away!
- Don
|
|
Posts:
1
Registered:
5/10/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 10, 2010 7:26 AM PDT
in response to: apliszka
|
|
|
People don't go to forums when things are working great, they usually only pop on when things go wrong. With a .1% failure rate you'll still see a significant amount of failures when you are talking about the scale of something the size of AWS. Figure 1 million volumes, which I'm guessing is a most likely a gross under estimate, and your still looking at 1,000 lost volumes a year.
|
|
Posts:
288
Registered:
8/10/09
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 10, 2010 11:01 AM PDT
in response to: apliszka
|
|
|
Even redundant systems fail, that's why occasionally planes crash. It sucks that you lost data, but if you fail to backup your data using the incredibly easy-to-use snapshot mechanism that AWS provides it's hard to be very sympathetic. Kinda like not using a condom then being upset at your girlfriend when she tells you she's pregnant.
|
|
Posts:
2
Registered:
5/10/10
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 10, 2010 11:48 AM PDT
in response to: apliszka
|
|
|
apliszka - based on this statement by AWS...
The durability of your volume depends both on the size of your volume and the percentage of the data that has changed since your last snapshot.
... then I would have to ask you when the last snapshot of the data that you lost was taken? And as a follow-on, how much of the data has changed since that last snapshot?
If you didn't use snapshots, then 'the percentage of the data that has changed since your last snapshot' is 100%. And since the durability of your volume is based on this percent change, as AWS clearly states, then it is safe to assume that you should expect low durability. If you then lose your data, you can't come back and complain that your volume wasn't as durable as AWS stated. It is EXACTLY as durable as they stated. Well, you CAN complain, just don't expect sympathy from the forum for not using the tools available to you that could have helped prevent this.
|
|
Posts:
50
Registered:
1/30/09
|
|
|
|
Re: Amazon EBS sucks I just lost all my data
Posted:
May 10, 2010 11:50 AM PDT
in response to: apliszka
|
|
|
We lost a volume (vol-05d9726c) in this crash too and with the number of people reading this post, I am sure that the AFR isn't as high as they claim at 0.1% –0.5%. This must have been a rather massive failure.
|
|
|
|
