Over Disk Quota

Question: Over Disk Quota

7.1 years ago by

Hello I just received the following message while using Galaxy through the web "You are over your disk quota. Tool execution is on hold until your disk usage drops below your allocated quota." I deleted a couple of files but it didn't helped. I checked the FAQ and could not get the answer. Thank's for your help Olivier

galaxy • 2.7k views

ADD COMMENT • link •

modified 6.8 years ago by Zack Liu • 10 • written 7.1 years ago by GANDRILLON OLIVIER • 70

7.1 years ago by

Nate Coraor ♦ 3.2k

United States

Nate Coraor ♦ 3.2k wrote:

Hi Olivier, The FAQ page is out of date and we'll be updating this as soon as possible. Please see the following for information about how to free up disk space: http://wiki.g2.bx.psu.edu/Main http://wiki.g2.bx.psu.edu/Learn/Managing%20Datasets Sorry for the inconvenience, and thanks for using Galaxy. --nate

ADD COMMENT • link written 7.1 years ago by Nate Coraor ♦ 3.2k

hi, so i went to options-->saved history-->advanced-->deleted datasets. then checked all of them, and then hit "permanently delete". but nothign happened. they still show up as deleted, and they are taking up lots of my quota. how do i get rid of these? rich

ADD REPLY • link written 7.1 years ago by Richard Mark White • 240

Hi Rich, I'm not sure what's going on here, I'm looking in to it. --nate

ADD REPLY • link written 7.1 years ago by Nate Coraor ♦ 3.2k

actually, i just waited a bit and now they are deletd. r ________________________________ To: Richard Mark White <whiter3@yahoo.com> Cc: GANDRILLON OLIVIER <olivier.gandrillon@univ-lyon1.fr>; "galaxy- user@bx.psu.edu" <galaxy-user@bx.psu.edu> Subject: Re: permanently delete problem Hi Rich, I'm not sure what's going on here, I'm looking in to it. --nate

ADD REPLY • link written 7.1 years ago by Richard Mark White • 240

Great, thanks for letting us know.

ADD REPLY • link written 7.1 years ago by Nate Coraor ♦ 3.2k

6.8 years ago by

Zack Liu • 10

Zack Liu • 10 wrote:

Dear galaxy admins, I am working on a hi-seq project, where each file is ~ 50G. I have 8 of them. After I uploaded my files, I realized that I have reach my quote limit. Literally, I can't do any mapping or actions on these files since I have no disk space for it. I was wondering if there's anyway I can get more disk storage on galaxy. Thanks! Zack Liu

ADD COMMENT • link written 6.8 years ago by Zack Liu • 10

Hello Zack, There are a two options: - use the public server Main, but run the data through in batches - use a local or cloud instance, as a whole or in batches http://getgalaxy.org To decide how to batch the data, perhaps use just one of your datasets to make some estimates about how much disk each will use as it moves through your planned analysis pipeline. Then you can decide how many to run at a time. You may also want to consider how much disk needs to be reserved for summary data to be pooled at the end for final steps. It would be good to know if the public instance is going to be the right resource for your project overall before you start. Often a workflow will have many intermediate steps where the same dataset is changed in small ways as it is transformed. These intermediate files are likely not needed and can be purged (permanently deleted) once the processing is past a certain point and confirmed to be OK. Then there are steps where very large raw data is reduced to much smaller summary data - the large data can often be archived then permanently deleted (purged). The optimal workflow would include some phases where processing occurs in a streaming mode and some phases where it pauses to allow for data review and cleanup, to make space for downstream analysis steps or more analysis cycles. Data purged from the public Galaxy instance can be first saved locally to your own computer/servers/cloud resource as individual files or as entire histories for use in local instances or cloud instances as reviewable archives or actionable work environments (to be used at a later time, locally or loaded back up into the public Galaxy instance). For more about data management, please see the guidelines and tips on this wiki. Of most relevance for your case (after Quotas), will be the last section, about "delete" (recoverable, counts towards disk quota) and "permanently delete" (a.k.a. purged, non-recoverable, does not count towards disk quota): http://wiki.g2.bx.psu.edu/Learn/Managing%20Datasets#Data_size_and_disk _Quotas We realize that this is not a simple solution. Quotas were a very difficult, but necessary, project decision. What we can do is try to provide as much support as possible to help our community effectively manage their data. So, if you need more help or have questions, please let us know, Take care, Jen Galaxy team -- Jennifer Jackson http://usegalaxy.org http://galaxyproject.org/wiki/Support

ADD REPLY • link written 6.8 years ago by Jennifer Hillman Jackson ♦ 25k

Please log in to add an answer.

Similar posts • Search »