Large Transfer Between Cloudman Instances

Question: Large Transfer Between Cloudman Instances

3.5 years ago by

United States

madkisson • 30 wrote:

I've got 2 clusters running TopHat2 for several large data sets in Cloudman. In one, the oldest, TopHat2 takes ~12-13 hours. In the newer one, about 2 hours. Clearly the old cluster is kaput and ready for retirement. I need to transfer 2 histories, both about 30G, but the Export links created from the history settings drop down menu does nothing when pasted into the Import window from the history settings drop down menu. How can I transfer these large data?

data transfer galaxy cloudman • 773 views

ADD COMMENT • link •

modified 3.5 years ago by Dannon Baker ♦ 3.7k • written 3.5 years ago by madkisson • 30

3.5 years ago by

Dannon Baker ♦ 3.7k

United States

Dannon Baker ♦ 3.7k wrote:

For exporting the history via link, you need to have 'made the history accessible', otherwise this link won't work (as you found out). If you publish or make the history available by direct link, it is considered accessible and that link will work without authentication. This is basically a security feature that wasn't previously well described, but it is improved to be much more clear in the newest release of Galaxy.

ADD COMMENT • link written 3.5 years ago by Dannon Baker ♦ 3.7k

Thanks Dannon

So when I hit the link 'Share or Publish' in the 'History Options' dropdown menu, I get a page that reads:

Share or Publish History 'DW181'
Make History Accessible via Link and Publish It
This history is currently accessible via link.
Anyone can view and import this history by visiting the following URL:

http://ec2-52-7-183-116.compute-1.amazonaws.com/u/madkisson/h

You can:
Disable Access To History Link
Disables history's link so that it is not accessible.

Publish History
Publishes the history to Galaxy's Published Histories section, where it is publicly listed and searchable.

Share History with Individual Users
You have not shared this history with any users.
Share with a user

When I copy the above link and go to the other instance of Galaxy and hit 'Import From File' in tht 'History Options' dropdown menu, I get a page reading:

Import a History from an Archive
Archived History URL:

Submit

I paste the URL in the box, hit submit and get:

Importing history from 'http://ec2-52-7-183-116.compute-1.amazonaws.com/u/madkisson/h'. This history will be visible when the import is complete

which does nothing

ADD REPLY • link modified 3.5 years ago • written 3.5 years ago by madkisson • 30

Also, is it normal for clusters to have a shelf life like this? Is it normal to have to move stuff and start new clusters?

ADD REPLY • link written 3.5 years ago by madkisson • 30

Similar posts • Search »