Yarn metrics參數(shù)說明

獲取Yarn jmx信息：
curl -i http://xxx:8088/jmx

Hadoop:service=ResourceManager,name=FSOpDurations
Hadoop:service=ResourceManager,name=JvmMetrics
Hadoop:service=ResourceManager,name=ClusterMetrics
Hadoop:service=ResourceManager,name=RpcActivityForPort8033
Hadoop:service=ResourceManager,name=MetricsSystem,sub=Stats
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=user02
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=A,q2=C
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=A
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=A,q2=B
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=default
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=user01

#QueueMetrics
running_0
running_60
running_300
running_1440
FairShareMB Fair share of memory in MB
FairShareVCores Fair share of CPU in vcores
SteadyFairShareMB Steady fair share of memory in MB
SteadyFairShareVCores Steady fair share of CPU in vcores
MinShareMB Minimum share of memory in MB
MinShareVCores Minimum share of CPU in vcores
MaxShareMB Maximum share of memory in MB
MaxShareVCores Maximum share of CPU in vcores
AppsSubmitted application提交個(gè)數(shù)
AppsRunning 正在運(yùn)行的application個(gè)數(shù)
AppsPending 掛起的application個(gè)數(shù)
AppsCompleted 完成的application個(gè)數(shù)
AppsKilled 被殺死的application個(gè)數(shù)
AppsFailed 失敗的application個(gè)數(shù)
AllocatedMB 已分配的內(nèi)存量
AllocatedVCores 分配給正在運(yùn)行的應(yīng)用的虛擬core
AllocatedContainers 已分配容器數(shù)
AggregateContainersAllocated Aggregate # of allocated containers
AggregateContainersReleased Aggregate # of released containers
AvailableMB 可用內(nèi)存量
AvailableVCores 可用虛擬Core數(shù)
PendingMB Pending memory allocation in MB
PendingVCores Pending CPU allocation in virtual cores
PendingContainers # of pending containers
ReservedMB 預(yù)留內(nèi)存量
ReservedVCores 預(yù)留虛擬Core數(shù)
ReservedContainers 預(yù)留容器數(shù)
ActiveUsers 激活用戶數(shù)
ActiveApplications 激活的應(yīng)用數(shù)
AppAttemptFirstContainerAllocationDelayNumOps 為應(yīng)用分配容器延遲數(shù)
AppAttemptFirstContainerAllocationDelayAvgTime 為應(yīng)用分配容器延遲時(shí)間
#FSOpDurations
ContinuousSchedulingRunNumOps Duration for a continuous scheduling run
ContinuousSchedulingRunAvgTime
ContinuousSchedulingRunStdevTime
ContinuousSchedulingRunIMinTime
ContinuousSchedulingRunIMaxTime
ContinuousSchedulingRunMinTime
ContinuousSchedulingRunMaxTime
NodeUpdateCallNumOps Duration to handle a node update
NodeUpdateCallAvgTime
NodeUpdateCallStdevTime
NodeUpdateCallIMinTime
NodeUpdateCallIMaxTime
NodeUpdateCallMinTime
NodeUpdateCallMaxTime
UpdateThreadRunNumOps Duration for a update thread run
UpdateThreadRunAvgTime
UpdateThreadRunStdevTime
UpdateThreadRunIMinTime
UpdateThreadRunIMaxTime
UpdateThreadRunMinTime
UpdateThreadRunMaxTime
UpdateCallNumOps Duration for an update call
UpdateCallAvgTime
UpdateCallStdevTime
UpdateCallIMinTime
UpdateCallIMaxTime
UpdateCallMinTime
UpdateCallMaxTime
PreemptCallNumOps Duration for a preempt call
PreemptCallAvgTime
PreemptCallStdevTime
PreemptCallIMinTime
PreemptCallIMaxTime
PreemptCallMinTime
PreemptCallMaxTime
#ClusterMetrics
NumActiveNMs active NMs
NumDecommissionedNMs decommissioned NMs
NumLostNMs lost NMs
NumUnhealthyNMs unhealthy NMs
NumRebootedNMs Rebooted NMs
AMLaunchDelayNumOps AM container launch delay
AMLaunchDelayAvgTime
AMRegisterDelayNumOps AM register delay
AMRegisterDelayAvgTime
#RpcActivityForPort8033
ReceivedBytes Total number of received bytes
SentBytes Total number of sent bytes
RpcQueueTimeNumOps Total number of RPC calls
RpcQueueTimeAvgTime Average queue time in milliseconds
RpcProcessingTimeNumOps Total number of RPC calls (same to RpcQueueTimeNumOps)
RpcProcessingTimeAvgTime Average Processing time in milliseconds
RpcAuthenticationFailures Total number of authentication failures
RpcAuthenticationSuccesses Total number of authentication successes
RpcAuthorizationFailures Total number of authorization failures
RpcAuthorizationSuccesses Total number of authorization successes
RpcClientBackoff
NumOpenConnections NumOpenConnections
CallQueueLength Current length of the call queue

jmx hadoop部分參數(shù)

curl http://10.116.100.2:50070/jmx?qry=Hadoop:service=NameNode,name=RpcActivityForPort8020

NameNode

NameNode:50070

Hadoop:service=NameNode,name=JvmMetrics

• MemHeapMaxM
• MemMaxM

Hadoop:service=NameNode,name=FSNamesystem

• CapacityTotal
• CapacityTotalGB
• CapacityRemaining
• CapacityRemainingGB
• TotalLoad
• FilesTotal

Hadoop:service=NameNode,name=FSNamesystemState

• NumLiveDataNodes

Hadoop:service=NameNode,name=NameNodeInfo

• LiveNodes

java.lang:type=Runtime

• StartTime

Hadoop:service=NameNode,name=FSNamesystemState

• TopUserOpCounts:timestamp

---

DataNode

DataNode:50075

Hadoop:service=DataNode,name=DataNodeActivity-slave-50010

• BytesWritten
• BytesRead
• BlocksWritten
• BlocksRead
• ReadsFromLocalClient
• ReadsFromRemoteClient
• WritesFromLocalClient
• WritesFromRemoteClient
• BlocksGetLocalPathInfo

---

HDFS

NameNode:50070

Hadoop:service=NameNode,name=NameNodeActivity

• CreateFileOps
• FilesCreated
• FilesAppended
• FilesRenamed
• GetListingOps
• DeleteFileOps
• FilesDeleted

Hadoop:service=NameNode,name=FSNamesystem

• CapacityTotal
• CapacityTotalGB
• CapacityUsed
• CapacityUsedGB
• CapacityRemaining
• CapacityRemainingGB
• CapacityUsedNonDFS

---

Yarn

ResourceManager:8088

Hadoop:service=ResourceManager,name=ClusterMetrics

• NumActiveNMs
• NumDecommissionedNMs

Hadoop:service=ResourceManager,name=JvmMetrics

• MemHeapUsedM

?

轉(zhuǎn)載于:https://www.cnblogs.com/xinfang520/p/10740934.html

總結(jié)

以上是生活随笔為你收集整理的Hadoop记录-JMX参数的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。