Question: FTP upload low speed
1
gravatar for georgess.dan
20 months ago by
georgess.dan40
georgess.dan40 wrote:

Hi! I am currently uploading fastq.gz datasets to the useglaxy.org. My internet upload speed in close to 100 MB/s but the FTP upload speed is 20KB/s, which means I will need weeks to upload the data set. PS: I do not have any other datasets on Galaxy so have not reached the 50GB limit.

How can I speed this up?

Thanks, Dan

upload ftp speed chip-seq • 621 views
ADD COMMENTlink modified 20 months ago by Martin Čech ♦♦ 4.9k • written 20 months ago by georgess.dan40

Hello, What instance of Galaxy are you using?

Cheers, Mo Heydarian

ADD REPLYlink written 20 months ago by Mo Heydarian830

Not sure if usegalaxy.org is a valid answer.

ADD REPLYlink written 20 months ago by georgess.dan40

Hello, That is a very valid answer :) . I asked because you mentioned your limit is 50 GB, users on useGalaxy.org all have a storage limit of 250 GB, and this confused me.

One thing you could try is submitting files individually to your FTP transfer client, instead of one large submission.

ADD REPLYlink written 20 months ago by Mo Heydarian830

I did that and it did not change the rate. If I submit one file, the speed is 20kbs/. If I submit 2 parallel files, the speed is 10kb/s for each file.

ADD REPLYlink written 20 months ago by georgess.dan40
2
gravatar for georgess.dan
20 months ago by
georgess.dan40
georgess.dan40 wrote:

At the risk of sounding like a total idiot: Problem solved... Turns out FileZilla (which I am using for the first time) has a default setting to limit file transfer speed (20 kb/s) and the number of files it can transfer is set to 2. As soon as I changed these ridiculous default settings, my upload speed when through the roof.

Apologies for wasting your time!

ADD COMMENTlink written 20 months ago by georgess.dan40
1
gravatar for Mo Heydarian
20 months ago by
Mo Heydarian830
United States
Mo Heydarian830 wrote:

Thanks for sharing this! This is valuable information to have for our users that may encounter this issue in the future. Your contribution here will likely save others hours (or days) of headache. Thanks for your contribution!

Thanks for using Galaxy!

Cheers, Mo Heydarian

ADD COMMENTlink written 20 months ago by Mo Heydarian830
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 16.09
Traffic: 173 users visited in the last hour