IOException: Rename cannot overwrite non empty destination directory /data/yarn/nm/usercache/hdfs/filecache/16
? ? at org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:716)
? ? at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:228)
? ? at org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:659)
? ? at org.apache.hadoop.fs.FileContext.rename(FileContext.java:909)
? ? at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:364)
? ? at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:60)
? ? at java.util.concurrent.FutureTask.run(FutureTask.java:262)
? ? at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
? ? at java.util.concurrent.FutureTask.run(FutureTask.java:262)
? ? at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
? ? at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
? ? at java.lang.Thread.run(Thread.java:745)
Failing this attempt. Failing the application.
15/06/16 11:41:06 INFO mapreduce.Job: Counters: 0
将cdh2和cdh3机器的/data/yarn/nm/usercache/hdfs/filecache下的文件删除即可。可参考http://stackoverflow.com/questions/30857413/hadoop-complains-about-attempting-to-overwrite-nonempty-destination-directory