Question: How to start job on dynamically started openstack hosted pulsar server?
gravatar for oskar
7 months ago by
Bergen, Norway
oskar10 wrote:

I'm trying to set up a cloud based tool execution function where a job is started on a local galaxy server, but it is executed on a pulsar server that is hosted on a cloud server. So far I am able to start a job if the cloud server is running, but the aim is to be able to start the pulsar server when the job is started, and then shut it down once the job is finished. The pulsar server is hosted on an openstack cloud server, so my idea is to inject the openstack start command before the job is executed on the pulsar server. But before we move any further, perhaps this is already supported by some feature that has been implemented already? If not, then here is an outline of the idea I'm thinking of:

Start job on galaxy -> start openstack server with pulsar running on it -> execute the job -> shut down the openstack server when the job is finished -> done.

I got the idea of putting the openstack command in the tool xml file, but that would try to execute it on the remote server that I'm trying to start. And since the job_conf.xml file has the tool configured to be executed on the pulsar server, I need to somehow sidestep this configuration and execute the openstack locally but the job command remotely.

Is this possible in a clean way?

ADD COMMENTlink modified 7 months ago by Jennifer Hillman Jackson25k • written 7 months ago by oskar10
gravatar for Bjoern Gruening
7 months ago by
Bjoern Gruening5.1k
Bjoern Gruening5.1k wrote:

With start openstack server with pulsar running on it do you mean starting a VM in OpenStack? If so we have a pretty similar setup up and running in Freiburg.

ADD COMMENTlink written 7 months ago by Bjoern Gruening5.1k

Yes, that's exactly what I need, could you perhaps share your solution?

ADD REPLYlink written 7 months ago by oskar10

We have currently not written something up for it. Can you write me a mail and we will see how we can transfer the setup.

ADD REPLYlink written 6 months ago by Bjoern Gruening5.1k
Please log in to add an answer.


Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 16.09
Traffic: 156 users visited in the last hour