Question: Over Disk Quota
0
gravatar for GANDRILLON OLIVIER
7.1 years ago by
GANDRILLON OLIVIER70 wrote:
Hello I just received the following message while using Galaxy through the web "You are over your disk quota. Tool execution is on hold until your disk usage drops below your allocated quota." I deleted a couple of files but it didn't helped. I checked the FAQ and could not get the answer. Thank's for your help Olivier
galaxy • 2.7k views
ADD COMMENTlink modified 6.8 years ago by Zack Liu10 • written 7.1 years ago by GANDRILLON OLIVIER70
0
gravatar for Nate Coraor
7.1 years ago by
Nate Coraor3.2k
United States
Nate Coraor3.2k wrote:
Hi Olivier, The FAQ page is out of date and we'll be updating this as soon as possible. Please see the following for information about how to free up disk space: http://wiki.g2.bx.psu.edu/Main http://wiki.g2.bx.psu.edu/Learn/Managing%20Datasets Sorry for the inconvenience, and thanks for using Galaxy. --nate
ADD COMMENTlink written 7.1 years ago by Nate Coraor3.2k
hi,   so i went to options-->saved history-->advanced-->deleted datasets.  then checked all of them, and then hit "permanently delete". but nothign happened.  they still show up as deleted, and they are taking up lots of my quota. how do i get rid of these? rich
ADD REPLYlink written 7.1 years ago by Richard Mark White240
Hi Rich, I'm not sure what's going on here, I'm looking in to it. --nate
ADD REPLYlink written 7.1 years ago by Nate Coraor3.2k
actually, i just waited a bit and now they are deletd. r ________________________________ To: Richard Mark White <whiter3@yahoo.com> Cc: GANDRILLON OLIVIER <olivier.gandrillon@univ-lyon1.fr>; "galaxy- user@bx.psu.edu" <galaxy-user@bx.psu.edu> Subject: Re: permanently delete problem Hi Rich, I'm not sure what's going on here, I'm looking in to it. --nate
ADD REPLYlink written 7.1 years ago by Richard Mark White240
Great, thanks for letting us know.
ADD REPLYlink written 7.1 years ago by Nate Coraor3.2k
0
gravatar for Zack Liu
6.8 years ago by
Zack Liu10
Zack Liu10 wrote:
Dear galaxy admins, I am working on a hi-seq project, where each file is ~ 50G. I have 8 of them. After I uploaded my files, I realized that I have reach my quote limit. Literally, I can't do any mapping or actions on these files since I have no disk space for it. I was wondering if there's anyway I can get more disk storage on galaxy. Thanks! Zack Liu
ADD COMMENTlink written 6.8 years ago by Zack Liu10
Hello Zack, There are a two options: - use the public server Main, but run the data through in batches - use a local or cloud instance, as a whole or in batches http://getgalaxy.org To decide how to batch the data, perhaps use just one of your datasets to make some estimates about how much disk each will use as it moves through your planned analysis pipeline. Then you can decide how many to run at a time. You may also want to consider how much disk needs to be reserved for summary data to be pooled at the end for final steps. It would be good to know if the public instance is going to be the right resource for your project overall before you start. Often a workflow will have many intermediate steps where the same dataset is changed in small ways as it is transformed. These intermediate files are likely not needed and can be purged (permanently deleted) once the processing is past a certain point and confirmed to be OK. Then there are steps where very large raw data is reduced to much smaller summary data - the large data can often be archived then permanently deleted (purged). The optimal workflow would include some phases where processing occurs in a streaming mode and some phases where it pauses to allow for data review and cleanup, to make space for downstream analysis steps or more analysis cycles. Data purged from the public Galaxy instance can be first saved locally to your own computer/servers/cloud resource as individual files or as entire histories for use in local instances or cloud instances as reviewable archives or actionable work environments (to be used at a later time, locally or loaded back up into the public Galaxy instance). For more about data management, please see the guidelines and tips on this wiki. Of most relevance for your case (after Quotas), will be the last section, about "delete" (recoverable, counts towards disk quota) and "permanently delete" (a.k.a. purged, non-recoverable, does not count towards disk quota): http://wiki.g2.bx.psu.edu/Learn/Managing%20Datasets#Data_size_and_disk _Quotas We realize that this is not a simple solution. Quotas were a very difficult, but necessary, project decision. What we can do is try to provide as much support as possible to help our community effectively manage their data. So, if you need more help or have questions, please let us know, Take care, Jen Galaxy team -- Jennifer Jackson http://usegalaxy.org http://galaxyproject.org/wiki/Support
ADD REPLYlink written 6.8 years ago by Jennifer Hillman Jackson25k
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 16.09
Traffic: 172 users visited in the last hour