Question: Galaxy + Condor + Docker
0
gravatar for xiao2
2.5 years ago by
xiao210
xiao210 wrote:

Hello,

We know Galaxy support Docker, but it seems I can only run docker containers locally. Condor now has a Docker universe, which can manage docker jobs in a compute node. Is it possible to launch Galaxy's Docker jobs into condor?

Or is there a better way to launch Docker jobs to compute nodes in Galaxy?

Thanks in advance, Mark

galaxy • 1.3k views
ADD COMMENTlink modified 2.5 years ago by Bjoern Gruening5.1k • written 2.5 years ago by xiao210
2
gravatar for Bjoern Gruening
2.5 years ago by
Bjoern Gruening5.1k
Germany
Bjoern Gruening5.1k wrote:

Hi Mark,

in the latest development version of Galaxy has support for HTCondor and the Docker-universe. But we still need real world testers :) Have a look at this PR: https://github.com/galaxyproject/galaxy/pull/2278

Recently the Galaxy team also merged a PR which integrates a Kubernetes job runner, see here: https://github.com/galaxyproject/galaxy/pull/2314

So you have these two options. Docker Swarm I would not recommend it is currently not secure and please keep in mind this is all in Galaxy dev and will be released with Galaxy 16.07. I would really like to see some testing before so please get in touch with us if you find problems.

In a related new we also have merged HTCondor Integration into the Galaxy-Docker Image here: https://github.com/bgruening/docker-galaxy-stable/pull/180

So it should be possible to run Galaxy in Docker and submit via HTCondor Docker containers ;)

Ciao, Bjoern

ADD COMMENTlink written 2.5 years ago by Bjoern Gruening5.1k
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 16.09
Traffic: 182 users visited in the last hour