hi, is there a way to transfer in bulk data from the ENA website to galaxy? rather then doing one sample at the time...
thanks ibseq
hi, is there a way to transfer in bulk data from the ENA website to galaxy? rather then doing one sample at the time...
thanks ibseq
Hello,
Not at this time through the data retrieval tool. Also, there are ongoing issues with this tool, please see: https://biostar.usegalaxy.org/p/21066/#21709
It might be possible to copy the links from multiple datasets, save that in a text file, then paste those into the Upload tool. I have not tested that yet today. Will post back to the other post as another workaround if this works.
Thanks! Jen, Galaxy team
Loading with the Upload tool using URLs results in the same sort of failure ("Connection reset by peer"). These are green, empty, datasets, not red - but the problem is declared in the dataset's box.
Once the problems with the data provider are resolved, I would definitely suggest that you test this out as a way to load data in batch. URLs from any server that supports public data retrieval via HTTP or FTP are a valid way to load data into Galaxy with the Upload tool.
As an aside, I did have one transfer with the EBI SRA tool work today when I ran several in batch. Yet that is how this problem has been manifesting - some retrievals are successful, some fail, for the same query, for different queries, at the same time, or different times. This is the root of the problem and what we are hoping to get resolved.