Hbase JMX 监控 - Region
獲取Region監(jiān)控信息頁面:
http://regionServerName:16030/jmx?qry=Hadoop:service=HBase,name=RegionServer,sub=Regions
?獲得數(shù)據(jù)如下
參數(shù)代表含義
*** 為前綴代表:Namespace_${namespace}_table_${tableName}_region_${regionName}
?
| ***_metric_storeCount | 當(dāng)前region中store個(gè)數(shù),即列簇個(gè)數(shù) |
| ***_metric_storeFileCount | 當(dāng)前region中storeFile個(gè)數(shù) |
| ***_metric_memStoreSize | 當(dāng)前region的MemStoreSize,該值達(dá)到某一特定條件會(huì)flush到磁盤,生成一個(gè)storefile,每次MemStore Flush時(shí),會(huì)對Store進(jìn)行檢驗(yàn),如果Store中的StoreFile數(shù)量大于hbase.hstore.compactionThreshold 時(shí),就會(huì)觸發(fā)Compaction |
| ***_metric_storeFileSize | 當(dāng)前region storeFIles 大小,即每個(gè)region大小,單位為byte(字節(jié)) |
| ***_metric_compactionsCompletedCount | 完成Compaction次數(shù) |
| ***_metric_compactionsFailedCount | Compaction失敗次數(shù) |
| ***_metric_numBytesCompactedCount | 完成Compaction總大小 |
| ***_metric_numFilesCompactedCount | 完成Compaction總文件數(shù)量 |
| ***_metric_readRequestCount | 讀請求數(shù)量,scan 1000條數(shù)據(jù),該值會(huì)增加1000;get獲取數(shù)據(jù)該數(shù)據(jù)存在會(huì)增加1,數(shù)據(jù)不存在不會(huì)增加;count 數(shù)據(jù)也會(huì)增加該值,count數(shù)據(jù)量多少,則增加多少 |
| ***_metric_filteredReadRequestCount | 使用過濾的讀請求數(shù) |
| ***_metric_writeRequestCount | 寫請求數(shù)量 |
| ***_metric_compactionsQueuedCount | 壓縮隊(duì)列大小 |
| ***_metric_maxCompactionQueueSize | 該region最大一次Compaction隊(duì)列大小 |
| ***_metric_maxFlushQueueSize | 該region最大一次MemStore刷新隊(duì)列數(shù)量 |
| ***_metric_flushesQueuedCount | 當(dāng)前MemStore Flush 隊(duì)列數(shù)量 |
| ***_metric_maxStoreFileAge | storeFile存在最大時(shí)間,單位ms |
| ***_metric_minStoreFileAge | storeFile存在最小時(shí)間,單位ms |
| ***_metric_avgStoreFileAge | storeFile存在平均時(shí)間,單位ms |
| ***_metric_lastMajorCompactionAge | 最后一次執(zhí)行MajorCompaction時(shí)間距離現(xiàn)在多久,單位毫秒 |
| ***_metric_putCount | put數(shù)據(jù)次數(shù),重復(fù)數(shù)據(jù)也會(huì)增加該值 |
| ***_metric_deleteCount | 刪除數(shù)據(jù)次數(shù) |
| ***_metric_scanCount | scan數(shù)據(jù)次數(shù);count也會(huì)增加該值,注意是后臺(tái)查詢的次數(shù),比如 count 'tbName',{CACHE=>500},count 'tbName',{CACHE=>1000}執(zhí)行的次數(shù)是不同的 |
| ***_metric_getCount | get查詢數(shù)據(jù)次數(shù) |
| ***_metric_appendCount | ? |
| ***_metric_incrementCount | ? |
?
?
更多參數(shù)獲取邏輯可閱讀源碼
實(shí)現(xiàn)類:org.apache.hadoop.hbase.regionserver.MetricsRegionWrapperImpl
http://hbase.apache.org/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionWrapperImpl.html
舉例:獲取 maxStoreFileAge,在org.apache.hadoop.hbase.regionserver.HStroe 類中
@Override public long getMaxStoreFileAge() {long earliestTS = Long.MAX_VALUE;for (StoreFile s: this.storeEngine.getStoreFileManager().getStorefiles()) {StoreFile.Reader r = s.getReader();if (r == null) {LOG.warn("StoreFile " + s + " has a null Reader");continue;}if (!s.isHFile()) {continue;}long createdTS = s.getFileInfo().getCreatedTimestamp();earliestTS = (createdTS < earliestTS) ? createdTS : earliestTS;}long now = EnvironmentEdgeManager.currentTime();return now - earliestTS; }?
總結(jié)
以上是生活随笔為你收集整理的Hbase JMX 监控 - Region的全部內(nèi)容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: ubuntu16.04安装PCL
- 下一篇: ros(5)service client