Question: Where Are My Deleted Datasets?
0
gravatar for Erick Antezana
8.7 years ago by
Erick Antezana570 wrote:
Hi, I managed to enable the possibility to 'Add datasets' via the 'Upload directory of files' option for non-admin users. It works fine: I can import (as admin and non-admin user) specific datasets into my history (copy and/or no-copy) so that I could launch some tools over them, etc. However, if I delete a specific dataset (as admin) that was imported as non-admin and then login again as non-admin, I can still see the imported datasets in my history pane. Where is actually located the reference to the (deleted) dataset? I was able to find the copied files at .../database/files/000/* , these will be cleaned out (if deleted) by the purge scripts eventually... I am using SQLAlchemy with mysql for the DB connection. cheers, Erick
• 1.1k views
ADD COMMENTlink modified 8.6 years ago by Greg Von Kuster810 • written 8.7 years ago by Erick Antezana570
0
gravatar for Greg Von Kuster
8.6 years ago by
Penn State University
Greg Von Kuster810 wrote:
Hello Erick, Just to confirm, this option is available only for uploading datasets to a data library ( but not a history ). I assume when you "delete a specific dataset (as admin) that was imported as non-admin" , you are marking the dataset as deleted in the data library. Doing this will not alter (delete) the history item that points to the deleted library dataset. This is why any user that imported the library dataset into their history before it was marked deleted in the library will still see the item in their history that points to the deleted library dataset. When you first upload a file to a data library, an association object (a LibraryDatasetDatasetAssociation object) is created that associates the library dataset with the file on disk (stored in ~/database/files/000/*). At this point, there is only 1 reference to the disk file. However, when you import the library dataset into a history, another association object (a HistoryDatasetAssociation object) is created that associates the history item with the same file on disk. This, of course, creates another reference to the same disk file. In order for the ~/scripts/cleanup_datasets/cleanup_datasets.py script to remove the file from disk, every reference to the disk file must be marked as deleted. In other words, not only the library dataset must be marked as deleted, but every history item that was created by importing the library dataset into a history must be marked as deleted as well. If any of these association objects remain undeleted, the disk file will not be removed. Greg Von Kuster Galaxy Development Team greg@bx.psu.edu
ADD COMMENTlink written 8.6 years ago by Greg Von Kuster810
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 16.09
Traffic: 168 users visited in the last hour