replaced binary unqirs with a plattform independent golang rewrite. gouniq works removes duplicate lines from an unsorted text file thus maintaining the original order of lines
split_linewise.py splits large textfiles into smaller chunks, like 500MB for Uploading into splunk while also making sure each line stays intakt