Hadoop往hdfs上put file的時候，今天報錯如下：

16/03/12 08:15:17 INFO fs.FSInputChecker: Found checksum error: b[0, ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ??
10240]=3832393432392c302e303133343233360932333031363531312c302e303132393938340932343832393330342c302e303132363637320932343832323132332c302e3031323431363109323438333635
31372c302e303131363036310932333031363531322c302e303130363630370932343832393236342c302e30303933320932343832393330302c302e303039323531330932343832393238352c302e303039313
239350932343832393236382c302e303038373732390932343832393238322c302e3030383036340932343832393237312c302e303037333735370932343832393236372c302e30303731353337093234373839
3235342c302e303033383334370932343738393236322c302e303033343336330932343738393236392c302e303032383033360a3736373534310932343739373732362c302e303830373537390932343136373
732392c302e303636393737390932343831363636362c302e303530363436340932343834323733362c302e303433363435340932343831363436382c302e303334333334330932343832393330382c302e3032
35343833320932333031363531302c302e303233363530330932333031363530382c302e303139373833350932343832393432392c302e303136333435320932333031363531312c302e3031353335343309323
43833363531372c302e303134363435380932333031363531332c302e303134353837320932343832323132332c302e303133323434330932343832393330342c302e303132383139330932333031363531322c
302e3031323130350932343832393236342c302e303131343339340932343832393238352c302e303130313031360932343832393236372c302e303038373232370932343832393236382c302e3030383131313
40932343832393237312c302e303038303239360932343832393238322c302e303037393939350932343832393330302c302e30303734370932343738393235342c302e30303430383635093234373839323632
2c302e303033363332310932343738393236392c302e303033303438360a3736373730330932343739373732362c302e303733373837350932343136373732392c302e303630353336360932343831363636362
c302e303435323438340932343834323733362c302e303434383930310932343831363436382c302e303334323733370932333031363530382c302e303230373538320932333031363531302c302e3032303638
39310932343832393432392c302e303137333238390932343832393330382c302e3031363931330932333031363531312c302e303136343337330932333031363531322c302e303135353138350932333031363
531332c302e3031343131340932343832393330342c302e303132333134350932343832323132332c302e303039383334370932343833363531372c302e303039363834310932343832393236372c302e303039
3235320932343832393236382c302e303038383931350932343832393236342c302e3030383438310932343832393238322c302e3030383334350932343832393237312c302e303038313137360932343832393
238352c302e303037363133310932343832393330302c302e303037303134340932343738393235342c302e3030343435380932343738393236322c302e303033323534370932343738393236392c302e303033
303732330a3737333434350932343739373732362c302e313134323435360932343831363636362c302e303433393031360932343834323733362c302e3034323639380932343831363436382c302e303338313
0360932343832393330382c302e303334373935350932343832393330342c302e3032323631380932343832393432392c302e3032323334350932343832393236342c302e303137313430380932343832323132
332c302e303136373430330932343833363531372c302e3031363535360932343832393330302c302e303135383838340932343832393238352c302e303135363038310932343832393238322c302e303132313
231340932343832393236372c302e303131393538350932343832393236382c302e303131373934380932343832393237312c302e303130343639350932343738393235342c302e303035333435350932343738
393236322c302e303034373138330932343738393236392c302e303033333930340932343738303432382c302e303031353832310a3835373631330932343739373732362c302e3137303030350932343831363
436382c302e313336333039310932343834323733362c302e313230303030360932343831363636362c302e313135363339340932343832393330382c302e303439303738380932343832393432392c302e3034
30383236350932343832323132332c302e3033383735380932343832393330342c302e303336383737320932343833363531372c302e303333313837360932343832393238352c302e303234383434330932343
832393330302c302e303232323534320932343832393236382c302e303232313532390932343832393236372c302e303232303433310932343832393237312c302e303231393837390932343832393238322c30
2e303231373936340932343832393236342c302e303231343335330932343738393235342c302e303131363236320932343738393236322c302e303131333035360932343738393236392c302e3030393433383
90932343738303432382c302e303034343134370a3836343332370932343739373732362c302e313437343336310932343831363436382c302e313235373831330932343834323733362c302e30393636353836
0932343831363636362c302e303931323631380932343832393330382c302e3034393339330932343832393330342c302e303430333632370932343832393432392c302e3034303133303409323438323231323

查原因為：Hadoop在往hdfs上put file的時候，會進行校驗。如果有對應的".XXXX.crc"文件，會與其進行比對校驗。如果不對就會報上面這個錯誤。

crc文件是在getmerge文件夾的時候自動生成的，無參數可以關閉。

所以，修改了HadoopUtil，在put file之前check下crc文件是否存在，存在的話刪掉?；蛘?#xff0c;使用不同的文件名。

參考：

http://www.cnblogs.com/gpcuster/archive/2011/01/26/1945363.html

總結

以上是生活随笔為你收集整理的Hadoop put file 错误：fs.FSInputChecker: Found checksum error的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。