1.讀取單個文件

?

?

[java]?view plain?copy

Date?date?=?DateUtil.getSpecifiedDayBefore();??

String?yesterday?=?DateUtil.dateToStr(date,?"yyyy-MM-dd");??

String?path?=?"hdfs://ip:9000/output_log/output_log_click"?+?yesterday;??

??

?Configuration?conf?=?new?Configuration();??

FileSystem?fs?=?FileSystem.get(URI.create(path),?conf);??

FSDataInputStream?hdfsInStream?=?fs.open(new?Path(path));??

InputStreamReader?isr?=?new?InputStreamReader(hdfsInStream,?"utf-8");??

BufferedReader?br?=?new?BufferedReader(isr);??

String?line;??

//?int?k?=?0;??

while?((line?=?br.readLine())?!=?null)?{??

????System.out.println(line);??

}??

???

?

?

2.讀取文件夾

?

[java]?view plain?copy

Date?date?=?DateUtil.getSpecifiedDayBefore();??

String?yesterday?=?DateUtil.dateToStr(date,?"yyyy-MM-dd");??

String?path?=?"hdfs://ip:9000/output_log/output_log_click"?+?yesterday;??

??

Configuration?conf?=?new?Configuration();??

FileSystem?fs?=?FileSystem.get(URI.create(path),?conf);??

FileStatus[]?status?=?fs.listStatus(new?Path(path));??

for?(FileStatus?file?:?status)?{??

????if?(!file.getPath().getName().startsWith("newsMap"))?{??

??????????????continue;??

??????????}??

????FSDataInputStream?hdfsInStream?=?fs.open(file.getPath());??

????InputStreamReader?isr?=?new?InputStreamReader(hdfsInStream,?"utf-8");??

????BufferedReader?br?=?new?BufferedReader(isr);??

????String?line;??

????//?int?k?=?0;??

????while?((line?=?br.readLine())?!=?null)?{??

????????System.out.println(line);??

????}??

??????

}??

總結

以上是生活随笔為你收集整理的Java 读写 hdfs文件或者目录的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。