BASH: Checking if files are duplicates within a directory?

Question

I am writing a house-keeping script and have files within a directory that I want to clean up. I want to move files from a source directory to another, there are many sub-direct

Answer 1

find . -type f -exec md5sum {} \; | sort | uniq -d

That'll spit out all the md5 hashes that have duplicates. then it's just a matter of figuring out which file(s) produced those duplicate hashes.

Answer 2

dupmerge is another such tool...

Answer 3

There's a tool designed for this purpose, it's fdupes :

  fdupes -r dir/