2.5 years ago by
United States
Hello,
The tool Text Manipulation > Unique occurrences of each record will perform a "sort -u" on the existing data. There is no provenance about which original input file donated each row. However, the tool Join, Subtract and Group > Compare two Datasets to find common or distinct rows could be used after to divide the result into two files (compare against the original files). From there you could Add column to an existing dataset for each then merge it all back together again with Concatenate.
There are other possibilities to sort or group the data (replace above or do additional manipulations after sorting uniquely). See these tool groups for options:
- Text Manipulation
- Datamash
- Filter and Sort
- Join, Subtract and Group
Hopefully this helps, Jen, Galaxy team