shell - Remove duplicate entries in a Bash script

Question

This question already has answers here:

Answer 1

You can sort then uniq:

$ sort -u input.txt

Or use awk:

$ awk '!a[$0]++' input.txt