Question: Cloudman AWS EBS volumes: restore from snapshot?
2
gravatar for cholley
14 months ago by
cholley20
cholley20 wrote:

I have set up a couple of Galaxy instances using CloudMan (c4.8xlarge, 250-1000Gb EBS volumes), and return to them periodically for more analysis. Although the instance shuts down, the EBS volumes persist, and they can easily be restarted. However, given the expense of maintaining EBS volumes, I would like to take a snapshot (S3 storage rates), and simply re-volume from that when I need it. However, this doesn't seem to work. Is there a way to do something like this so that my data can sit on S3 or Glacier until I need it?

cloudman • 472 views
ADD COMMENTlink modified 14 months ago by Enis Afgan690 • written 14 months ago by cholley20
2
gravatar for Enis Afgan
14 months ago by
Enis Afgan690
United States
Enis Afgan690 wrote:

There is no automated/supported method to do this (although work is underway within Galaxy to add this feature but that's still some time out). What you could do is to stop all services via CloudMan, manually create a tarball of /mnt/galaxy directory and upload that to S3. You could then delete the EBS volume via the AWS dashboard. At a later point then, create a new Galaxy CloudMan instance with a new volume of at least the size the stored, uncompressed data is. After the system starts up, stop all services via CloudMan again, replace the contents of /mnt/galaxy with the contents of the earlier created tar file from S3 and reboot the cluster for things to get reloaded.

I've never tried this but it should work pretty easily. I'd certainly try it out once or twice without deleting the EBS volume and make sure all the nuances are accounted for. Feel free to ping with more specific questions if you embark on that route and we'll figure it out.

ADD COMMENTlink written 14 months ago by Enis Afgan690

Thanks - I will give this a try.

ADD REPLYlink written 14 months ago by cholley20
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 16.09
Traffic: 167 users visited in the last hour