How to overwrite the existing files using hadoop fs -copyToLocal command

Question

Is there any way we can overwrite existing files, while coping from HDFS using:

hadoop fs -copyToLocal  
         


        

Answer 1

You can try with distcp with -update . Main advantage is it will be update the target only when there is change in the file.

hadoop distcp -update file://source hdfs://namenode/target

hadoop distcp -update  file:///home/hduser/pigSample/labfiles/SampleData/books.csv  hdfs://10.184.37.158:9000/yesB