MapReduce-Reduce端join操作-Map阶段代码
生活随笔
收集整理的這篇文章主要介紹了
MapReduce-Reduce端join操作-Map阶段代码
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
p0001,小米5,1000,2000
p0002,錘子T1,1000,3000
定義 Mapper
package cn.learn.mapreduce_reduce_join;import org.apache.hadoop.io.LongWritable; import org.apache.hadoop.io.Text; import org.apache.hadoop.mapreduce.InputSplit; import org.apache.hadoop.mapreduce.Mapper; import org.apache.hadoop.mapreduce.lib.input.FileSplit;import java.io.IOException;public class ReduceJoinMapper extends Mapper<LongWritable,Text,Text,Text> {@Overrideprotected void map(LongWritable key, Text value, Context context) throws IOException, InterruptedException {//首先判斷數據來自哪個文件FileSplit fileSplit = (FileSplit) context.getInputSplit();String fileName = fileSplit.getPath().getName();if(fileName.equals("orders.txt")){//獲取pidString[] split = value.toString().split(",");context.write(new Text(split[2]), value);}else{//獲取pidString[] split = value.toString().split(",");context.write(new Text(split[0]), value);}} }?
總結
以上是生活随笔為你收集整理的MapReduce-Reduce端join操作-Map阶段代码的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: MapReduce-Reduce端joi
- 下一篇: MapReduce-Reduce端joi