Storage Space/Processor Speed

Heads up! This is a static archive of our support site. Please go to help.galaxyproject.org if you want to reach the Galaxy community. If you want to search this archive visit the Galaxy Hub search

Latest

Open

RNA-Seq

ChIP-Seq

SNP

Assembly

Forum

Planet

All »

Home

Welcome to Galaxy Biostar! User support for Galaxy! about • faq • rss

Community

Log In

Sign Up

Add New Post

Question: Storage Space/Processor Speed

7.7 years ago by

Keith E. Giles • 170

United States

Keith E. Giles • 170 wrote:

I am trying to perform a "join" on two sets of intervals. There are ~20,000 intervals in one dataset and about 13 million on the other. This has been running for about 3 days now, and I'm pretty certain that its not going to work. Is there a way to know if there is enough memory available for a given function to run ahead of time? Also, how much storage space does each account have available? I know that one can access cloud space online, through amazon for example. However that seems to be fairly complicated and a bit out of reach for me for the short term.

• 634 views

ADD COMMENT • link •

modified 7.7 years ago by Jennifer Hillman Jackson ♦ 25k • written 7.7 years ago by Keith E. Giles • 170

7.7 years ago by

Jennifer Hillman Jackson ♦ 25k

United States

Jennifer Hillman Jackson ♦ 25k wrote:

Hello Keith, There are no quotas set at this time, however for very large jobs we do recommend using a cloud instance or your own local instance. Getting Cloudman going should not be overly complicated - did you have trouble with a particular part of the setup/execution we could help with? It is also possible that this job simply was run at a time when the load here was high. Have you been able to run the job successfully since you originally wrote? Does the job complete when you break the larger 13m line file into smaller chunks (could break up, do the join, then merge again). Tools in Text Manipulation and a perhaps a Workflow could be useful for this. Please let us know how we can help, Jen Galaxy team -- Jennifer Jackson http://usegalaxy.org http://galaxyproject.org

ADD COMMENT • link written 7.7 years ago by Jennifer Hillman Jackson ♦ 25k

Please log in to add an answer.

Similar posts • Search »