3.1 years ago by
United States
Hello,
Data in filename.gz format can be loaded via FTP (See Support#Loading_data). The data will be uncompressed during upload and must be under 50 GB in size (the individual upload file size quota).
If your data is over 50 GB uncompressed, loading portions of it then merging once in Galaxy can be an option. See this prior post for pro/cons of this method: Illumina DNA sequence upload problem
Data with a name like filename.tar.gz may or may not load. Tar archives are not a supported compression format. If such an archive does happen to upload (some will), only the first file in the archive will be extracted by Galaxy. This is generally undesirable. Instead, extract the contents of the archive locally, then upload to Galaxy the individual files you want to work with.
If your data is in filename.gz format, known to be under 50 GB in size uncompressed, and still fails upload - there are a few options for troubleshooting/workarounds:
- Uncompress the file and load it that way. Not all "gz" compressed data uses a consistent archive procedure. This method removes compression variances as a load factor, with the bonus of alerting you to problems with the compressed file itself (it if fails to uncompress locally, then it will probably fail in Galaxy).
- Strongly consider using an FTP client such as FileZilla to manage the load. Resuming interrupted transfers and tracking full load success are just some of the advantages. If one is not comfortable on the command-line, an FTP client aids with accessibility as well.
Hopefully this helps, Jen, Galaxy team
As long as it's within the quota (250 GB on the public instance), it should be fine.
I haven't use any of the quota yet, my history is empty.But I couldn't upload this .gz file using FTP. Is it because the file is compressed?
I think Galaxy should handle that compression. What error are you getting?