Has anyone been able to submit jobs on a Docker Galaxy instance to SGE or UGE on a centOS7 machine?
After referring to https://github.com/bgruening/docker-galaxy-stable#Using-an-external-Grid-Engine-cluster we were still not able to have jobs passed on to UGE.
Going into the container, we are able to see that the environment variable was passed in and the act_qmaster file was present. So, these variables should be alright.
Job configuration: we're using the sample docker configuration, except we replaced anything about slurm with UGE and took all the htcondor references out. We're trying to pass in the drmaa library. However, if we use this configuration, it seems like the application will not work and go to a 403 page, so there's something wrong here. Maybe someone could help point out what went wrong?
<job_conf> <plugins workers="2"> <plugin id="sge" type="runner" load="galaxy.jobs.runners.drmaa:DRMAAJobRunner"> <param id="drmaa_library_path">/lib/lx-amd64/libdrmaa.so</param> </plugin> <plugin id="local" type="runner" load="galaxy.jobs.runners.local:LocalJobRunner"/> </plugins> <handlers default_from_environ="GALAXY_HANDLERS_DEFAULT" default="sge"> <handler id="handler0" tags="sge"/> <handler id="handler1" tags="sge"/> <handler id="sge_handler"> <plugin id="sge"/> </handler> </handlers> <destinations default_from_environ="GALAXY_DESTINATIONS_DEFAULT" default="sge"> <destination id="sge" runner="sge"> <param id="nativeSpecification">-V -pe threads 1 -l m_mem_free=1G</param> <env file="/galaxy_venv/bin/activate"/> <param id="docker_enabled" from_environ="GALAXY_DOCKER_ENABLED">False</param> <param id="docker_sudo" from_environ="GALAXY_DOCKER_SUDO">False</param> <!-- The empty volumes from shouldn't affect Galaxy, set GALAXY_DOCKER_VOLUMES_FROM to use. --> <param id="docker_volumes_from" from_environ="GALAXY_DOCKER_VOLUMES_FROM"></param> <!-- For a stock Galaxy instance and traditional job runner $defaults will expand out as: $galaxy_root:ro,$tool_directory:ro,$working_directory:rw,$default_file_path:rw --> <param id="docker_volumes" from_environ="GALAXY_DOCKER_VOLUMES">$defaults</param> </destination> </destinations> <limits> </limits></job_conf>
The next part of the readme says "Your Grid Engine needs to accept job submissions from inside the container." We're not sure how to do this. Does this mean that we have to add the hostname of the container? We tried this and UGE wasn't able to resolve the hostname of the container.
Thanks so much!