Question: Text Manipulation: Filter Out Duplicates (Uniq) From An Plain Text File ?
7.6 years ago by
Roman Valls • 130
Roman Valls • 130 wrote:
Hey galaxy users, Thats a fairly good question from one of my colleagues. I've looked through the menus (mainly "Text Manipulation" and "Filter and Sort"(Select)), googled (on the mailing list archives too), but couldn't find an answer: How should I remove duplicates on plain text files without resorting to: "echo file|sort|uniq" before uploading the file/text. or Putting a regexp together to replace the duplicate occurences as in: http://www.regular-expressions.info/duplicatelines.html I'm pretty sure I'm missing some really basic stuff here... is this basic operation something supposed to be done outside galaxy perhaps ? Thanks in advance !
ADD COMMENT • link •