HBase中怎么将已知表移植到另一张表中
本篇內(nèi)容介紹了“HBase中怎么將已知表移植到另一張表中”的有關(guān)知識,在實際案例的操作過程中,不少人都會遇到這樣的困境,接下來就讓小編帶領(lǐng)大家學(xué)習(xí)一下如何處理這些情況吧!希望大家仔細閱讀,能夠?qū)W有所成!
將已經(jīng)存在某張表,比如 blog,將此表中的數(shù)據(jù)“移植”到另外一張新表中。
/***將HBase中一張表的數(shù)據(jù)移植到另一張表中。**/publicclassHBaseAndMapReduce4{publicstaticvoidmain(String[]args)throwsException{System.exit(run());}publicstaticintrun()throwsException{Configurationconf=newConfiguration();conf=HBaseConfiguration.create(conf);conf.set("hbase.zookeeper.quorum","192.168.226.129");Jobjob=Job.getInstance(conf,"findFriend");job.setJarByClass(HBaseAndMapReduce4.class);//實例化scan對象。Scanscan=newScan();scan.addColumn(Bytes.toBytes("article"),Bytes.toBytes("tags"));scan.addColumn(Bytes.toBytes("author"),Bytes.toBytes("nickname"));TableMapReduceUtil.initTableMapperJob("blog",scan,FindFriendMapper.class,ImmutableBytesWritable.class,ImmutableBytesWritable.class,job);TableMapReduceUtil.initTableReducerJob("friend02",FindFriendReducer.class,job);checkTable(conf);returnjob.waitForCompletion(true)?0:1;}privatestaticvoidcheckTable(Configurationconf)throwsException{Connectioncon=ConnectionFactory.createConnection(conf);Adminadmin=con.getAdmin();TableNametn=TableName.valueOf("friend02");if(!admin.tableExists(tn)){HTableDescriptorhtd=newHTableDescriptor(tn);HColumnDescriptorhcd=newHColumnDescriptor("person");htd.addFamily(hcd);admin.createTable(htd);System.out.println("表不存在,新創(chuàng)建表成功....");}}publicstaticclassFindFriendMapperextendsTableMapper<ImmutableBytesWritable,ImmutableBytesWritable>{@Override//key是hbase中的行鍵//value是hbase中的所行鍵的所有數(shù)據(jù)protectedvoidmap(ImmutableBytesWritablekey,Resultvalue,Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,ImmutableBytesWritable>.Contextcontext)throwsIOException,InterruptedException{ImmutableBytesWritablev=null;String[]kStrs=null;List<Cell>cs=value.listCells();for(Cellcell:cs){if("tags".equals(Bytes.toString(CellUtil.cloneQualifier(cell)))){kStrs=Bytes.toString(CellUtil.cloneValue(cell)).split(",");}elseif("nickname".equals(Bytes.toString(CellUtil.cloneQualifier(cell)))){v=newImmutableBytesWritable(CellUtil.cloneValue(cell));}}for(StringkStr:kStrs){context.write(newImmutableBytesWritable(Bytes.toBytes(kStr.toLowerCase())),v);}}}publicstaticclassFindFriendReducerextendsTableReducer<ImmutableBytesWritable,ImmutableBytesWritable,ImmutableBytesWritable>{@Overrideprotectedvoidreduce(ImmutableBytesWritablekey,Iterable<ImmutableBytesWritable>values,Reducer<ImmutableBytesWritable,ImmutableBytesWritable,ImmutableBytesWritable,Mutation>.Contextcontext)throwsIOException,InterruptedException{System.out.println("key--->"+key.get());Putput=newPut(key.get());StringBuildervStr=newStringBuilder();for(ImmutableBytesWritablevalue:values){System.out.println("value-->"+value.get());vStr.append((vStr.length()>0?",":"")+Bytes.toString(value.get()));}put.addColumn(Bytes.toBytes("person"),Bytes.toBytes("nickname"),Bytes.toBytes(vStr.toString()));context.write(key,put);}}}
“HBase中怎么將已知表移植到另一張表中”的內(nèi)容就介紹到這里了,感謝大家的閱讀。如果想了解更多行業(yè)相關(guān)的知識可以關(guān)注億速云網(wǎng)站,小編將為大家輸出更多高質(zhì)量的實用文章!
總結(jié)
以上是生活随笔為你收集整理的HBase中怎么将已知表移植到另一张表中的全部內(nèi)容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: VirMach黑五套餐价格调整 便宜VP
- 下一篇: NameSilo域名怎么买 购买域名需要