當前位置：首頁 > 编程资源 > 编程问答 >内容正文

编程问答

HBase实现谷粒微博案例

發布時間：2023/12/29 编程问答 43 豆豆

生活随笔收集整理的這篇文章主要介紹了 HBase实现谷粒微博案例小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

HBase實現谷粒微博案例

前言
一、啟動集群
二、功能實現
- 1.創建工程
- 2.constants包
- 3.utils包
- - 3.1 createNameSpace 創建命名空間
  - 3.2 isTableExist 判斷表是否存在
  - 3.3 createTable 創建表
- 4.dao包
- - 4.1 發微博功能
  - 4.2 關注功能
  - 4.3 取消關注
  - 4.4 獲得用戶初始頁
  - 4.5 獲得用戶全部微博內容
- 5 test包測試
總結
參考

前言

最近剛剛在b站上看完了尚硅谷hbase相關課程，在這里記錄一下，完成這個項目遇到的坑，以及案例結果(而且不要吐槽的英語注釋，我是個英語渣，大家盡量意會一下…)。如果博客有什么不對的地方，歡迎大佬指正。

一、啟動集群

由于HBase是基于hadoop的一個非結構化數據庫，所以需要啟動hadoop集群，并且還需要啟動我們的“潤滑器” zookeeper。
我使用的版本是
CentOS 6
Hadoop 3
HBase 3
Zookeeper 3 （每一個虛擬機都要啟動zookeeper）
虛擬機一共三臺，分別是hadoop102，hadoop103，hadoop104
編譯器使用的是IDEA。

二、功能實現

1.創建工程

這里我只是給出代碼以及一些相關解釋，具體的需求分析以及更加詳細的解釋，可以看后面的參考鏈接，我將會給出b站尚硅谷視頻的鏈接，有興趣的可以去看看。
打開IDEA，創建一個新的maven工程，然后進行pom.xml格式如下。這里是需要導入相關的依賴包，以及各種依賴的版本，build一下就會開始進行下載。

<?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0"xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"><parent><artifactId>HBase</artifactId><groupId>org.example</groupId><version>1.0-SNAPSHOT</version></parent><modelVersion>4.0.0</modelVersion><artifactId>guli-weibo</artifactId><dependencies><dependency><groupId>org.apache.hbase</groupId><artifactId>hbase-server</artifactId><version>1.3.1</version></dependency><dependency><groupId>org.apache.hbase</groupId><artifactId>hbase-client</artifactId><version>1.3.1</version></dependency></dependencies><properties><maven.compiler.source>8</maven.compiler.source><maven.compiler.target>8</maven.compiler.target></properties></project>

然后在工程中創建5個文件夾（其中一個是空的，也可以不創建），后續需要添加代碼。如圖：

ok，現在我們就可以快樂的編寫代碼了。

2.constants包

在這里我們定義的是一些常量，例如是命名空間、表明、列名等，以便后面我們需要使用的時候反復重寫，防止寫錯，也可以進行一個解耦合。

package constants;import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.*;public class Constants {public static Configuration CONFIGURATION = null;// HBase setting 這里不知道為什么要這要寫才可以，視頻里面沒有寫這個也可以運行，// 但是我就會報錯，說無法連接，希望有大佬可以解釋一下。// 那個set里面第二個放的是你們集群的名稱，可能會不一樣，看你們自己的命名了。static {CONFIGURATION = HBaseConfiguration.create();CONFIGURATION.set("hbase.zookeeper.quorum", "hadoop102,hadoop103,hadoop104");}// HBase namespace 這個是命名空間public static final String NAMESPACE = "weibo";// weibo content table 這個是內容表public static final String CONTENT_TABLE = "weibo:content";public static String CONTENT_TABLE_CF = "info";public static int CONTENT_TABLE_VERSIONS = 1;// user relationship table 這個是關系表public static final String RELATION_TABLE = "weibo:relation";public static final String RELATION_TABLE_CF1 = "attends";public static final String RELATION_TABLE_CF2 = "fans";public static final int RELATION_TABLE_VERSIONS = 1;// receipt email box 這個是收件表public static final String INBOX_TABLE = "weibo:inbox";public static final String INBOX_TABLE_CF = "info";public static final int INBOX_TABLE_VERSIONS = 2;}

3.utils包

這里主要是進行DDL的操作，例如創建命名空間，以及對表之類的操作。
代碼總覽，下面再分段解釋：

package utils;import constants.Constants; import org.apache.hadoop.hbase.HColumnDescriptor; import org.apache.hadoop.hbase.HTableDescriptor; import org.apache.hadoop.hbase.NamespaceDescriptor; import org.apache.hadoop.hbase.TableName; import org.apache.hadoop.hbase.client.Admin; import org.apache.hadoop.hbase.client.Connection; import org.apache.hadoop.hbase.client.ConnectionFactory; import org.apache.hadoop.hbase.client.Table;import java.io.IOException;/*** 1 create namespace* 2 judge table exist or not* 3 create three tables* 4*/public class HBaseUtil {// 1 create namespacepublic static void createNameSpace(String namespace) throws IOException {// 1 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the admin objectAdmin admin = connection.getAdmin();// 1 create namespace descriptionNamespaceDescriptor build = NamespaceDescriptor.create(namespace).build();// 2 create namespaceadmin.createNamespace(build);// 3 close resourceadmin.close();connection.close();}// 2 judge the table exist or notprivate static boolean isTableExist(String tableName) throws IOException {// 1 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the admin objectAdmin admin = connection.getAdmin();// 3 judge the table exist or notboolean result = admin.tableExists(TableName.valueOf(tableName));// 4 close resourceadmin.close();connection.close();// return valuereturn result;}// 3 create tablepublic static void createTable(String tableName, int versions, String... cfs) throws IOException {// 1 judge the command valueif (cfs.length <= 0) {System.out.println("column information is not available.");return ;}// 2 judge the table exist or notif (isTableExist(tableName)) {System.out.println(tableName + "table is exist.");return;}// 3 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 4 get the admin objectAdmin admin = connection.getAdmin();// 5 create table descriptionHTableDescriptor hTableDescriptor = new HTableDescriptor(TableName.valueOf(tableName));// 6 cycle add column informationfor (String cf : cfs) {HColumnDescriptor hColumnDescriptor = new HColumnDescriptor(cf);// 7 set the versionhColumnDescriptor.setMaxVersions(versions);hTableDescriptor.addFamily(hColumnDescriptor);}// 8 create tableadmin.createTable(hTableDescriptor);// close resourceadmin.close();connection.close();} }

3.1 createNameSpace 創建命名空間

// 1 create namespacepublic static void createNameSpace(String namespace) throws IOException {// 1 get the connection object 創建一個連接的對象Connection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the admin object 創建一個admin的對象，// 對hbase操作基本上通admin來操作Admin admin = connection.getAdmin();// 1 create namespace description 創建一個命名空間的解釋器NamespaceDescriptor build = NamespaceDescriptor.create(namespace).build();// 2 create namespace 創建命名空間admin.createNamespace(build);// 3 close resource 關閉資源admin.close();connection.close();}

3.2 isTableExist 判斷表是否存在

// 2 judge the table exist or notprivate static boolean isTableExist(String tableName) throws IOException {// 1 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the admin objectAdmin admin = connection.getAdmin();// 3 judge the table exist or not. // tableExists這個函數是需要傳入TableName參數的，所以需要轉換。boolean result = admin.tableExists(TableName.valueOf(tableName));// 4 close resourceadmin.close();connection.close();// return valuereturn result;}

3.3 createTable 創建表

這一塊蠻重要的，但是也是固定的套路。

// 3 create tablepublic static void createTable(String tableName, int versions, String... cfs) throws IOException {// 1 judge the command value 判斷一下傳入的參數是否小于等于0if (cfs.length <= 0) {System.out.println("column information is not available.");return ;}// 2 judge the table exist or not 判斷表是否存在if (isTableExist(tableName)) {System.out.println(tableName + "table is exist.");return;}// 3 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 4 get the admin objectAdmin admin = connection.getAdmin();// 5 create table description // 創建表描述器，對表的操作都是通過描述器來操作。HTableDescriptor hTableDescriptor = new HTableDescriptor(TableName.valueOf(tableName));// 6 cycle add column informationfor (String cf : cfs) {// 這里是創建一個列描述器HColumnDescriptor hColumnDescriptor = new HColumnDescriptor(cf);// 7 set the versionhColumnDescriptor.setMaxVersions(versions);// 將列描述器加入到表描述器當中，也就是把列族加進去。hTableDescriptor.addFamily(hColumnDescriptor);}// 8 create tableadmin.createTable(hTableDescriptor);// close resourceadmin.close();connection.close();}

4.dao包

這里是一些DML的操作，例如一些在表中插入數據，或者是刪除數據的操作。
老規矩，先來一個代碼總覽(比較長…)：

package dao;import constants.Constants; import org.apache.hadoop.hbase.Cell; import org.apache.hadoop.hbase.CellUtil; import org.apache.hadoop.hbase.TableName; import org.apache.hadoop.hbase.client.*; import org.apache.hadoop.hbase.filter.CompareFilter; import org.apache.hadoop.hbase.filter.RowFilter; import org.apache.hadoop.hbase.filter.SubstringComparator; import org.apache.hadoop.hbase.util.Bytes;import java.io.IOException; import java.util.ArrayList;/*** 1 send the weibo* 2 delete the weibo* 3 focus the user* 4 check off user* 5 get the user's weibo detail* 6 get the user's initialize page*/ public class HBaseDao {// 1 send the weibopublic static void publishWeiBo(String uid, String content) throws IOException {// 1 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the admin objectAdmin admin = connection.getAdmin();// 1 operate weibo content table// 1.1 get the weibo content table objectTable conTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// 1.2 get the current timelong ts = System.currentTimeMillis();// 1.3 get the RowkeyString rowKey = uid + "_" + ts;// 1.4 create put objectPut conPut = new Put(Bytes.toBytes(rowKey));// 1.5 Assignment the put objectconPut.addColumn(Bytes.toBytes(Constants.CONTENT_TABLE_CF), Bytes.toBytes("content"), Bytes.toBytes(content));// 1.6 execute insert data operationconTable.put(conPut);// 2 operate weibo email box// 2.1 get user relation table objectTable relaTable = connection.getTable(TableName.valueOf(Constants.RELATION_TABLE));// 2.2 get the fans's information of the person who publish weibo in currentGet get = new Get(Bytes.toBytes(uid));get.addFamily(Bytes.toBytes(Constants.RELATION_TABLE_CF2));Result result = relaTable.get(get);// 2.3 create a map, in order to store the put object of weibo content tableArrayList<Put> inboxPuts = new ArrayList<>();// 2.4 traverse the fans listfor (Cell cell : result.rawCells()) {// 2.5 create the put object of weibo infobox tablePut inboxPut = new Put(CellUtil.cloneQualifier(cell));// 2.6 assignment the information to the inbox tableinboxPut.addColumn(Bytes.toBytes(Constants.INBOX_TABLE_CF), Bytes.toBytes(uid), Bytes.toBytes(rowKey));// 2.7 store the put object into the inbox tableinboxPuts.add(inboxPut);}// 2.8 judge fans exist or notif (inboxPuts.size() > 0) {// get the inbox objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// execute the insert operationinboxTable.put(inboxPuts);// close the inbox tableinboxTable.close();}// close the resourcerelaTable.close();conTable.close();connection.close();}// 2 focus the userpublic static void addAttends(String uid, String... attends) throws IOException {// judge if or not exist attendsif (attends.length <= 0) {System.out.println("please choose attention person");return ;}// get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// first, operate user relationship table// 1 get the user relationship table objectTable relaTable = connection.getTable(TableName.valueOf(Constants.RELATION_TABLE));// 2 create a map, in order to store a put object of user relationship tableArrayList<Put> relaPuts = new ArrayList<>();// 3 create an operator put objectPut uidPut = new Put(Bytes.toBytes(uid));// 4 cycle create a put object of attended personfor (String attend : attends) {// 5 assignment value to operator's put objectuidPut.addColumn(Bytes.toBytes(Constants.RELATION_TABLE_CF1), Bytes.toBytes(attend), Bytes.toBytes(attend));// 6 create a put object of attended personPut attendPut = new Put(Bytes.toBytes(attend));// 7 assignment value to attended person's put objectattendPut.addColumn(Bytes.toBytes(Constants.RELATION_TABLE_CF2), Bytes.toBytes(uid), Bytes.toBytes(uid));// 8 put the attended person's put object into maprelaPuts.add(attendPut);}// 9 add operator's put object into maprelaPuts.add(uidPut);// 10 execute user relationship table the insertion operationrelaTable.put(relaPuts);// second operate inbox table// 1 get the weibo content table objectTable contTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// 2 create put object of inbox tablePut inboxPut = new Put(Bytes.toBytes(uid));// 3 cycle attends, get the every attended person current published weibofor (String attend : attends) {// 4 get the attended person's current published weibo -> map resultScannerScan scan = new Scan(Bytes.toBytes(attend + "_"), Bytes.toBytes(attend + "|"));ResultScanner resultScanner = contTable.getScanner(scan);// define a time stamplong ts = System.currentTimeMillis();// 5 traverse the valuefor (Result result : resultScanner) {// 6 assignment the value into the inbox tableinboxPut.addColumn(Bytes.toBytes(Constants.INBOX_TABLE_CF), Bytes.toBytes(attend), ts++, result.getRow());}}// judge the put object exist or notif (!inboxPut.isEmpty()) {// get the inbox table objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// insert datainboxTable.put(inboxPut);// close inboxTable connectioninboxTable.close();}// close resourcerelaTable.close();contTable.close();connection.close();}// 3 delete attentionpublic static void deleteAttends(String uid, String... dels) throws IOException {if (dels.length <= 0) {System.out.println("please choose deletion person");return;}// get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// first operate user relationship table// 1 get the user relationship table objectTable relatTable = connection.getTable(TableName.valueOf(Constants.RELATION_TABLE));// 2 create a map, in order to store the delete object of user relationship tableArrayList<Delete> relatDelete = new ArrayList<>();// 3 create the delete object of operatorDelete uidDelete = new Delete(Bytes.toBytes(uid));// 4 cycle create the delete object of delete attentionfor (String del : dels) {// 5 assignment value to operator's delete objectuidDelete.addColumns(Bytes.toBytes(Constants.RELATION_TABLE_CF1), Bytes.toBytes(del));// 6 create the conceal person's(取關者...) deletion objectDelete delDelte = new Delete(Bytes.toBytes(del));// 7 assignment value to the conceal person's deletion objectdelDelte.addColumns(Bytes.toBytes(Constants.RELATION_TABLE_CF2), Bytes.toBytes(uid));// 8 add the conceal person's deletion object into the maprelatDelete.add(delDelte);}// 9 add the operator's deletion object into the maprelatDelete.add(uidDelete);// 10 delete the data in user relationship tablerelatTable.delete(relatDelete);// second operate inbox table// 1 get the inbox table objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// 2 create the deletion object of operatorDelete inboxDelete = new Delete(Bytes.toBytes(uid));// 3 assignment value to operator's deletion objectfor (String del : dels) {inboxDelete.addColumns(Bytes.toBytes(Constants.INBOX_TABLE_CF), Bytes.toBytes(del));}// 4 delete data in inbox tableinboxTable.delete(inboxDelete);// close resourcerelatTable.close();inboxTable.close();connection.close();}// 4 get the initial page datapublic static void getInit(String uid) throws IOException {// 1 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get inbox table objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// 3 get the content table objectTable conTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// 4 create inbox get object, and get the data max versionGet inboxGet = new Get(Bytes.toBytes(uid));inboxGet.setMaxVersions();Result result = inboxTable.get(inboxGet);// 5 traverse the datafor (Cell cell : result.rawCells()) {// 6 construct the content table get objectGet conGet = new Get(CellUtil.cloneValue(cell));// 7 get the object dataResult conResult = conTable.get(conGet);// 8 print datafor (Cell conCell : conResult.rawCells()) {System.out.println("RK:" + Bytes.toString(CellUtil.cloneRow(conCell)) +", CF:" + Bytes.toString(CellUtil.cloneFamily(conCell)) +", CN:" + Bytes.toString(CellUtil.cloneQualifier(conCell)) +", Value:" + Bytes.toString(CellUtil.cloneValue(conCell)));}}// 9 close resourceinboxTable.close();conTable.close();connection.close();}// 5 get the all the content of somebody weibopublic static void getWeibo(String uid) throws IOException {// 1 get the connectionConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the weibo content tableTable conTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// construct scan objectScan scan = new Scan();// construct filterRowFilter rowFilter = new RowFilter(CompareFilter.CompareOp.EQUAL, new SubstringComparator(uid + "_"));scan.setFilter(rowFilter);// 4 get the dataResultScanner resultScanner = conTable.getScanner(scan);// 5 printf datafor (Result result : resultScanner) {for (Cell cell : result.rawCells()) {System.out.println("RK:" + Bytes.toString(CellUtil.cloneRow(cell)) +", CF:" + Bytes.toString(CellUtil.cloneFamily(cell)) +", CN:" + Bytes.toString(CellUtil.cloneQualifier(cell)) +", Value:" + Bytes.toString(CellUtil.cloneValue(cell)));}}// 6 close resourceconTable.close();connection.close();} }

4.1 發微博功能

這一個功能比較難，因為不僅對于當前發布微博的人的內容表需要進行更新，并且需要對當前這個人的粉絲的收件表也需要更新，因為粉絲需要看到關注的人的最新動態。所以這里需要對兩張表，多個人進行操作。

// 1 publish the weibopublic static void publishWeiBo(String uid, String content) throws IOException {// 1 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the admin objectAdmin admin = connection.getAdmin();// 1 operate weibo content table 對微博內容表進行操作// 1.1 get the weibo content table objectTable conTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// 1.2 get the current timelong ts = System.currentTimeMillis();// 1.3 get the RowkeyString rowKey = uid + "_" + ts;// 1.4 create put object 將需要put的內容對象先創建好Put conPut = new Put(Bytes.toBytes(rowKey));// 1.5 Assignment the put object 給put對象賦值conPut.addColumn(Bytes.toBytes(Constants.CONTENT_TABLE_CF), Bytes.toBytes("content"), Bytes.toBytes(content));// 1.6 execute insert data operation// 執行put操作，即對表進行插入數據conTable.put(conPut);// 2 operate weibo email box 操作微博收件表// 2.1 get user relation table objectTable relaTable = connection.getTable(TableName.valueOf(Constants.RELATION_TABLE));// 2.2 get the fans's information of the person who publish weibo in current// 得到最近發布微博的被關注者的粉絲的信息Get get = new Get(Bytes.toBytes(uid));get.addFamily(Bytes.toBytes(Constants.RELATION_TABLE_CF2));Result result = relaTable.get(get);// 2.3 create a map, in order to store the put object of weibo content table// 創建一個集合為了存儲微博的內容ArrayList<Put> inboxPuts = new ArrayList<>();// 2.4 traverse the fans list// 遍歷uid的粉絲for (Cell cell : result.rawCells()) {// 2.5 create the put object of weibo infobox table// 創建粉絲的單元格Put inboxPut = new Put(CellUtil.cloneQualifier(cell));// 2.6 assignment the information to the inbox table// 對粉絲的收件表進行賦值，更新關注的人的最新微博inboxPut.addColumn(Bytes.toBytes(Constants.INBOX_TABLE_CF), Bytes.toBytes(uid), Bytes.toBytes(rowKey));// 2.7 store the put object into the inbox tableinboxPuts.add(inboxPut);}// 2.8 judge fans exist or not// 判斷當前發布微博的人是否有粉絲if (inboxPuts.size() > 0) {// get the inbox objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// execute the insert operationinboxTable.put(inboxPuts);// close the inbox tableinboxTable.close();}// close the resourcerelaTable.close();conTable.close();connection.close();}

4.2 關注功能

關注某個人之后，需要獲得這個人的最近發布的微博，以及在微博關系表當中需要添加新的關系。代碼也比較長…

// 2 focus the userpublic static void addAttends(String uid, String... attends) throws IOException {// judge if or not exist attendsif (attends.length <= 0) {System.out.println("please choose attention person");return ;}// get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// first, operate user relationship table// 操作微博關系表// 1 get the user relationship table objectTable relaTable = connection.getTable(TableName.valueOf(Constants.RELATION_TABLE));// 2 create a map, in order to store a put object of user relationship table// 創建關注的集合，因為有可能一次性關注多個人。ArrayList<Put> relaPuts = new ArrayList<>();// 3 create an operator put objectPut uidPut = new Put(Bytes.toBytes(uid));// 4 cycle create a put object of attended personfor (String attend : attends) {// 5 assignment value to operator's put objectuidPut.addColumn(Bytes.toBytes(Constants.RELATION_TABLE_CF1), Bytes.toBytes(attend), Bytes.toBytes(attend));// 6 create a put object of attended person// 這是被關注者對象Put attendPut = new Put(Bytes.toBytes(attend));// 7 assignment value to attended person's put objectattendPut.addColumn(Bytes.toBytes(Constants.RELATION_TABLE_CF2), Bytes.toBytes(uid), Bytes.toBytes(uid));// 8 put the attended person's put object into maprelaPuts.add(attendPut);}// 9 add operator's put object into maprelaPuts.add(uidPut);// 10 add data into user relationship tablerelaTable.put(relaPuts);// second operate inbox table// 1 get the weibo content table objectTable contTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// 2 create put object of inbox tablePut inboxPut = new Put(Bytes.toBytes(uid));// 3 cycle attends, get the every attended person current published weibofor (String attend : attends) {// 4 get the attended person's current published weibo -> map resultScanner// 獲得被關注者最近發布的微博Scan scan = new Scan(Bytes.toBytes(attend + "_"), Bytes.toBytes(attend + "|"));ResultScanner resultScanner = contTable.getScanner(scan);// define a time stamplong ts = System.currentTimeMillis();// 5 traverse the valuefor (Result result : resultScanner) {// 6 assignment the value into the inbox table// 循環放入粉絲的收件表中inboxPut.addColumn(Bytes.toBytes(Constants.INBOX_TABLE_CF), Bytes.toBytes(attend), ts++, result.getRow());}}// judge the put object exist or notif (!inboxPut.isEmpty()) {// get the inbox table objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// insert datainboxTable.put(inboxPut);// close inboxTable connectioninboxTable.close();}// close resourcerelaTable.close();contTable.close();connection.close();}

4.3 取消關注

// 3 delete attentionpublic static void deleteAttends(String uid, String... dels) throws IOException {if (dels.length <= 0) {System.out.println("please choose deletion person");return;}// get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// first operate user relationship table// 1 get the user relationship table objectTable relatTable = connection.getTable(TableName.valueOf(Constants.RELATION_TABLE));// 2 create a map, in order to store the delete object of user relationship tableArrayList<Delete> relatDelete = new ArrayList<>();// 3 create the delete object of operatorDelete uidDelete = new Delete(Bytes.toBytes(uid));// 4 cycle create the delete object of delete attentionfor (String del : dels) {// 5 assignment value to operator's delete objectuidDelete.addColumns(Bytes.toBytes(Constants.RELATION_TABLE_CF1), Bytes.toBytes(del));// 6 create the conceal person's(取關者...) deletion objectDelete delDelte = new Delete(Bytes.toBytes(del));// 7 assignment value to the conceal person's deletion objectdelDelte.addColumns(Bytes.toBytes(Constants.RELATION_TABLE_CF2), Bytes.toBytes(uid));// 8 add the conceal person's deletion object into the maprelatDelete.add(delDelte);}// 9 add the operator's deletion object into the maprelatDelete.add(uidDelete);// 10 delete the data in user relationship tablerelatTable.delete(relatDelete);// second operate inbox table// 1 get the inbox table objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// 2 create the deletion object of operatorDelete inboxDelete = new Delete(Bytes.toBytes(uid));// 3 assignment value to operator's deletion objectfor (String del : dels) {inboxDelete.addColumns(Bytes.toBytes(Constants.INBOX_TABLE_CF), Bytes.toBytes(del));}// 4 delete data in inbox tableinboxTable.delete(inboxDelete);// close resourcerelatTable.close();inboxTable.close();connection.close();}

4.4 獲得用戶初始頁

// 4 get the initial page datapublic static void getInit(String uid) throws IOException {// 1 get the connection objectConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get inbox table objectTable inboxTable = connection.getTable(TableName.valueOf(Constants.INBOX_TABLE));// 3 get the content table objectTable conTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// 4 create inbox get object, and get the data max versionGet inboxGet = new Get(Bytes.toBytes(uid));inboxGet.setMaxVersions();Result result = inboxTable.get(inboxGet);// 5 traverse the datafor (Cell cell : result.rawCells()) {// 6 construct the content table get objectGet conGet = new Get(CellUtil.cloneValue(cell));// 7 get the object dataResult conResult = conTable.get(conGet);// 8 print datafor (Cell conCell : conResult.rawCells()) {System.out.println("RK:" + Bytes.toString(CellUtil.cloneRow(conCell)) +", CF:" + Bytes.toString(CellUtil.cloneFamily(conCell)) +", CN:" + Bytes.toString(CellUtil.cloneQualifier(conCell)) +", Value:" + Bytes.toString(CellUtil.cloneValue(conCell)));}}// 9 close resourceinboxTable.close();conTable.close();connection.close();}

4.5 獲得用戶全部微博內容

// 5 get the all the content of somebody weibopublic static void getWeibo(String uid) throws IOException {// 1 get the connectionConnection connection = ConnectionFactory.createConnection(Constants.CONFIGURATION);// 2 get the weibo content tableTable conTable = connection.getTable(TableName.valueOf(Constants.CONTENT_TABLE));// construct scan objectScan scan = new Scan();// construct filterRowFilter rowFilter = new RowFilter(CompareFilter.CompareOp.EQUAL, new SubstringComparator(uid + "_"));scan.setFilter(rowFilter);// 4 get the dataResultScanner resultScanner = conTable.getScanner(scan);// 5 printf datafor (Result result : resultScanner) {for (Cell cell : result.rawCells()) {System.out.println("RK:" + Bytes.toString(CellUtil.cloneRow(cell)) +", CF:" + Bytes.toString(CellUtil.cloneFamily(cell)) +", CN:" + Bytes.toString(CellUtil.cloneQualifier(cell)) +", Value:" + Bytes.toString(CellUtil.cloneValue(cell)));}}// 6 close resourceconTable.close();connection.close();}

5 test包測試

在test包當中，編寫測試代碼，相對簡單。

package test;import constants.Constants; import dao.HBaseDao; import utils.HBaseUtil;import java.io.IOException;public class TestWeiBo {public static void init() {try {// create namespaceHBaseUtil.createNameSpace(Constants.NAMESPACE);// create weibo content tableHBaseUtil.createTable(Constants.CONTENT_TABLE, Constants.CONTENT_TABLE_VERSIONS, Constants.CONTENT_TABLE_CF);// create user relationship tableHBaseUtil.createTable(Constants.RELATION_TABLE, Constants.RELATION_TABLE_VERSIONS,Constants.RELATION_TABLE_CF1, Constants.RELATION_TABLE_CF2);// create inbox tableHBaseUtil.createTable(Constants.INBOX_TABLE, Constants.INBOX_TABLE_VERSIONS, Constants.INBOX_TABLE_CF);} catch (IOException e) {e.printStackTrace();}}public static void main(String[] args) throws IOException, InterruptedException {// initializeinit();System.out.println("init done");// 1001 publish weiboHBaseDao.publishWeiBo("1001","這是1001的微博，Hello World");System.out.println("publish done");// 1002 attend 1001, 1003HBaseDao.addAttends("1002", "1001", "1003");System.out.println("attend done");// get the 1002 initial pageHBaseDao.getInit("1002");System.out.println("*********************111**********************");// 1003 publish 3 weibo, at the same time 1002 publish 2 weiboHBaseDao.publishWeiBo("1003", "快結束了HBase了！！");Thread.sleep(10);HBaseDao.publishWeiBo("1001", "那你還是個弟弟啊！！");Thread.sleep(10);HBaseDao.publishWeiBo("1003", "哦，不我要當哥哥！！");Thread.sleep(10);HBaseDao.publishWeiBo("1001", "弟弟！！");Thread.sleep(10);HBaseDao.publishWeiBo("1003", "叫哥哥！！");// get 1002 initial pageHBaseDao.getInit("1002");System.out.println("*********************222***********************");// 1002 conceal 1003HBaseDao.deleteAttends("1002", "1003");// get the 1002 initial pageHBaseDao.getInit("1002");System.out.println("*********************333***********************");// 1002 attend 1003 againHBaseDao.addAttends("1002", "1003");// get the 1002 initial pageHBaseDao.getInit("1002");System.out.println("*********************444***********************");// get 1001 detail initial pageHBaseDao.getWeibo("1001");System.out.println("*********************555***********************");} }

總結

不知道為什么在configuration配置的時候總是存在問題，最后參考以前寫的測試API的代碼，加上了configuration.set()，才可以跑通。否則一直顯示的是連接超時，不存在zookeeper的master。具體問題還不清楚，感覺像是代碼找不到連接zookeeper的端口了。
最后我這個弱雞終于成功跑通了代碼，感覺還是蠻不錯的，記錄一下遇到的坑。
1、編寫代碼的時候，需要記住addColumns()函數里面是需要對列進行操作，好幾次寫成了table，忘了加CF了，然后報錯。并且還需要轉換成字節的形式。
2、需要弄清楚業務的邏輯，因為里面只是設計了三張表所以邏輯相對簡單。但是盡可能的還是多考慮考慮一些解耦合的操作或者是需求分析的時候對創建表考慮清楚。

最后，加油吧，諸君。

參考

b站尚硅谷的hbase視頻

總結

以上是生活随笔為你收集整理的HBase实现谷粒微博案例的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。

上一篇： CAS客户端整合（三） Otrs
下一篇： Cisco思科交换机WS-C2960X-