Question: migrating datasets to other path
0
gravatar for matthias.desmet
2.8 years ago by
Belgium
matthias.desmet150 wrote:

Hi,

I have a running galaxy instance with 500GB+ datasets. Since the database folder is becoming to large for its current disk, I'm trying to migrate everything to a bigger location.


I've Rsynced the database folder to its new location and edited all needed variables in galaxy.ini.
However, after a reboot, galaxy still goes looking for all files in their old location, it even loads the old configuration for the location of the files, before it even reads the galaxy.ini file.
 

galaxy.objectstore DEBUG 2016-02-04 09:31:26,639 Loading backends for distributed object store from primary
galaxy.objectstore DEBUG 2016-02-04 09:31:26,639 Loaded disk backend 'files1' with weight 1 and file_path: /Shared/galaxy-data/database/files1
galaxy.objectstore DEBUG 2016-02-04 09:31:26,640     Extra directories:
galaxy.objectstore DEBUG 2016-02-04 09:31:26,640         job_work: /Shared/galaxy-data/database/job_working_directory1
galaxy.objectstore DEBUG 2016-02-04 09:31:26,640         temp: /Shared/galaxy-data/database/tmp1
galaxy.objectstore DEBUG 2016-02-04 09:31:26,641 Loaded disk backend 'files2' with weight 1 and file_path: /Shared/galaxy-data/database/files2
galaxy.objectstore DEBUG 2016-02-04 09:31:26,641     Extra directories:
galaxy.objectstore DEBUG 2016-02-04 09:31:26,642         job_work: /Shared/galaxy-data/database/job_working_directory2
galaxy.objectstore DEBUG 2016-02-04 09:31:26,642         temp: /Shared/galaxy-data/database/tmp2
galaxy.app DEBUG 2016-02-04 09:31:26,643 Using "galaxy.ini" config file: /home/galaxy/galaxy-dist/config/galaxy.ini

help..? please? I'm tracking the galaxy master brach managed by supervisor on Ubuntu 14.04.3.

 

 

migration galaxy master • 719 views
ADD COMMENTlink written 2.8 years ago by matthias.desmet150

Hi Matthias

Not a solution to your problem, but a workaround:  What about having a sym-link in place to point from the old location to the new one?

 

Regards, Hans-Rudolf

 

ADD REPLYlink written 2.8 years ago by Hotz, Hans-Rudolf1.8k

Hi Hans-Rudolf,

That's a good workaround, but a workaround nontheless, (we've already fixed it that way). I kinda hoped there would be some kind of migration script to edit the objectstore entries to point to the new path.

Thanks anyway!
Matthias
 

ADD REPLYlink written 2.8 years ago by matthias.desmet150
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 16.09
Traffic: 170 users visited in the last hour