How to Remove or delete duplicate lines or duplicate words from multiple files

"Click here http://www.hothotsoftware.com/videoImage.php?mainname=3 for more details on Remove or delete duplicate lines or duplicate words from multiple files

Remove duplicates, duplicate lines, duplicate words, and more from one or many different text files. Create a backup file, or overwrite the existing file with this software. With this software, you can easily: Select a bunch of files to access recursively and remove duplicates from Specify the type of duplicates to remove Specify a word list and/or character list that you wish to remove Plus much more!"