Yarn metrics参数说明

获取Yarn jmx信息：
curl -i http://xxx:8088/jmx

Hadoop:service=ResourceManager,name=FSOpDurations
Hadoop:service=ResourceManager,name=JvmMetrics
Hadoop:service=ResourceManager,name=ClusterMetrics
Hadoop:service=ResourceManager,name=RpcActivityForPort8033
Hadoop:service=ResourceManager,name=MetricsSystem,sub=Stats
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=user02
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=A,q2=C
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=A
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=A,q2=B
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=default
Hadoop:service=ResourceManager,name=QueueMetrics,q0=root,q1=user01

#QueueMetrics
running_0
running_60
running_300
running_1440
FairShareMB Fair share of memory in MB
FairShareVCores Fair share of CPU in vcores
SteadyFairShareMB Steady fair share of memory in MB
SteadyFairShareVCores Steady fair share of CPU in vcores
MinShareMB Minimum share of memory in MB
MinShareVCores Minimum share of CPU in vcores
MaxShareMB Maximum share of memory in MB
MaxShareVCores Maximum share of CPU in vcores
AppsSubmitted application提交个数
AppsRunning 正在运行的application个数
AppsPending 挂起的application个数
AppsCompleted 完成的application个数
AppsKilled 被杀死的application个数
AppsFailed 失败的application个数
AllocatedMB 已分配的内存量
AllocatedVCores 分配给正在运行的应用的虚拟core
AllocatedContainers 已分配容器数
AggregateContainersAllocated Aggregate # of allocated containers
AggregateContainersReleased Aggregate # of released containers
AvailableMB 可用内存量
AvailableVCores 可用虚拟Core数
PendingMB Pending memory allocation in MB
PendingVCores Pending CPU allocation in virtual cores
PendingContainers # of pending containers
ReservedMB 预留内存量
ReservedVCores 预留虚拟Core数
ReservedContainers 预留容器数
ActiveUsers 激活用户数
ActiveApplications 激活的应用数
AppAttemptFirstContainerAllocationDelayNumOps 为应用分配容器延迟数
AppAttemptFirstContainerAllocationDelayAvgTime 为应用分配容器延迟时间
#FSOpDurations
ContinuousSchedulingRunNumOps Duration for a continuous scheduling run
ContinuousSchedulingRunAvgTime
ContinuousSchedulingRunStdevTime
ContinuousSchedulingRunIMinTime
ContinuousSchedulingRunIMaxTime
ContinuousSchedulingRunMinTime
ContinuousSchedulingRunMaxTime
NodeUpdateCallNumOps Duration to handle a node update
NodeUpdateCallAvgTime
NodeUpdateCallStdevTime
NodeUpdateCallIMinTime
NodeUpdateCallIMaxTime
NodeUpdateCallMinTime
NodeUpdateCallMaxTime
UpdateThreadRunNumOps Duration for a update thread run
UpdateThreadRunAvgTime
UpdateThreadRunStdevTime
UpdateThreadRunIMinTime
UpdateThreadRunIMaxTime
UpdateThreadRunMinTime
UpdateThreadRunMaxTime
UpdateCallNumOps Duration for an update call
UpdateCallAvgTime
UpdateCallStdevTime
UpdateCallIMinTime
UpdateCallIMaxTime
UpdateCallMinTime
UpdateCallMaxTime
PreemptCallNumOps Duration for a preempt call
PreemptCallAvgTime
PreemptCallStdevTime
PreemptCallIMinTime
PreemptCallIMaxTime
PreemptCallMinTime
PreemptCallMaxTime
#ClusterMetrics
NumActiveNMs active NMs
NumDecommissionedNMs decommissioned NMs
NumLostNMs lost NMs
NumUnhealthyNMs unhealthy NMs
NumRebootedNMs Rebooted NMs
AMLaunchDelayNumOps AM container launch delay
AMLaunchDelayAvgTime
AMRegisterDelayNumOps AM register delay
AMRegisterDelayAvgTime
#RpcActivityForPort8033
ReceivedBytes Total number of received bytes
SentBytes Total number of sent bytes
RpcQueueTimeNumOps Total number of RPC calls
RpcQueueTimeAvgTime Average queue time in milliseconds
RpcProcessingTimeNumOps Total number of RPC calls (same to RpcQueueTimeNumOps)
RpcProcessingTimeAvgTime Average Processing time in milliseconds
RpcAuthenticationFailures Total number of authentication failures
RpcAuthenticationSuccesses Total number of authentication successes
RpcAuthorizationFailures Total number of authorization failures
RpcAuthorizationSuccesses Total number of authorization successes
RpcClientBackoff
NumOpenConnections NumOpenConnections
CallQueueLength Current length of the call queue

jmx hadoop部分参数

curl http://10.116.100.2:50070/jmx?qry=Hadoop:service=NameNode,name=RpcActivityForPort8020

NameNode

NameNode:50070

Hadoop:service=NameNode,name=JvmMetrics

  • MemHeapMaxM
  • MemMaxM

Hadoop:service=NameNode,name=FSNamesystem

  • CapacityTotal
  • CapacityTotalGB
  • CapacityRemaining
  • CapacityRemainingGB
  • TotalLoad
  • FilesTotal

Hadoop:service=NameNode,name=FSNamesystemState

  • NumLiveDataNodes

Hadoop:service=NameNode,name=NameNodeInfo

  • LiveNodes

java.lang:type=Runtime

  • StartTime

Hadoop:service=NameNode,name=FSNamesystemState

  • TopUserOpCounts:timestamp

DataNode

DataNode:50075

Hadoop:service=DataNode,name=DataNodeActivity-slave-50010

  • BytesWritten
  • BytesRead
  • BlocksWritten
  • BlocksRead
  • ReadsFromLocalClient
  • ReadsFromRemoteClient
  • WritesFromLocalClient
  • WritesFromRemoteClient
  • BlocksGetLocalPathInfo

HDFS

NameNode:50070

Hadoop:service=NameNode,name=NameNodeActivity

  • CreateFileOps
  • FilesCreated
  • FilesAppended
  • FilesRenamed
  • GetListingOps
  • DeleteFileOps
  • FilesDeleted

Hadoop:service=NameNode,name=FSNamesystem

  • CapacityTotal
  • CapacityTotalGB
  • CapacityUsed
  • CapacityUsedGB
  • CapacityRemaining
  • CapacityRemainingGB
  • CapacityUsedNonDFS

Yarn

ResourceManager:8088

Hadoop:service=ResourceManager,name=ClusterMetrics

  • NumActiveNMs
  • NumDecommissionedNMs

Hadoop:service=ResourceManager,name=JvmMetrics

  • MemHeapUsedM

转载于:https://www.cnblogs.com/xinfang520/p/10740934.html

Hadoop记录-JMX参数相关推荐

  1. Hadoop平台作业参数设置关于mapreduce.job.split.metainfo.maxsize的说明

    Hadoop平台作业参数设置关于mapreduce.job.split.metainfo.maxsize的说明 1.MR程序时执行时报错:    YarnRuntimeException: java. ...

  2. git log 查看提交记录，参数：

    git log 查看提交记录,参数: -n (n是一个正整数),查看最近n次的提交信息 $ git log -2 查看最近2次的提交历史记录 -- fileName fileName为任意文件名,查看 ...

  3. 【无标题】Hadoop HA文件参数配置和HA启动

    Hadoop HA文件参数配置 1.hadoop环境变量 vim /etc/profile #hadoop enviromentexport HADOOP_HOME=/usr/local/src/ha ...

  4. 区块链项目/比特币/币圈管理后台/OTC系统管理后台/虚拟数字货币OTC场外交易平台/交易币种管理/币种配置/用户资产/充币记录/划转记录/币种参数/商家管理/rp原型/Axure后台管理原型

    区块链项目/比特币/币圈管理后台/OTC系统管理后台/虚拟数字货币OTC场外交易平台/交易币种管理/币种配置/用户资产/充币记录/划账记录/币种参数/商家管理/rp原型/Axure后台管理原型/币圈O ...

  5. Hadoop记录-metastore jmx配置

    参考:http://www.lixiuliang.cn/categories/%E5%A4%A7%E6%95%B0%E6%8D%AE/ 1.修改bin/hive文件 添加jvm启动参数: if [ $ ...

  6. Hadoop常用命令参数介绍

    常用命令 - help 功能:输出这个命令参数手册 - ls 功能:显示目录信息 示例:hadoop fs -ls hdfs://hadoop-hello/ 备注:这些参数中,所有的hdfs路径都可以 ...

  7. Hadoop Yarn配置参数整理（非常全面）

    RM与NM相关参数 ResourceManager 参数名称 作用 默认值 yarn.resourcemanager.address ResourceManager 对客户端暴露的地址.客户端通过该地 ...

  8. Linux记录-mysql参数优化

    1.参数优化 show variables like '' /etc/my.cnf [mysqld] Max_connections =1024 #请求的最大连接数 back_log =1024 #m ...

  9. Hadoop YARN配置参数剖析—RM与NM相关参数

    注意,配置这些参数前,应充分理解这几个参数的含义,以防止误配给集群带来的隐患.另外,这些参数均需要在yarn-site.xml中配置. 1.    ResourceManager相关配置参数 (1) ...

最新文章

  1. CORS-跨域资源共享 解决跨域问题
  2. Java jpa 字段限制_Java-JPA：仅更新特定字段
  3. python怎么设置颜色深浅变化_机器学习中减弱不同图像数据色调及颜色深浅差异...
  4. 第六周java实验报告四
  5. 我俩也组了个队，找到一个苹果RCE 0day，获 $5 万奖金
  6. c语言图片添加水印程序,[求助]C语言 bmp文件加上水印
  7. 最大似然估计（MLE）的一些公式与定理（python实践）
  8. iOS 快捷下载和安装并使用CocoaPods
  9. java滚动条调整数值_急..JAVA 在画布上画拖动滚动条可扩大缩小的长方形
  10. expdp导出表结构_Oracle用exp导出部分表和expdp
  11. layui radio 赋初始值
  12. python获取交互式ssh shell
  13. js 将小数转为科学记数法
  14. 2017计算机一级教学进度表,2016--2017年度第二学期16职高一年级《计算机应用基础》教学进度表...
  15. linux桌面应用软件,ubuntu16.04-18.04 桌面应用软件推荐系列（一）
  16. 地图附近名片流量主小程序开发
  17. js制作12进制的时钟特效
  18. php查询google pr值接口api介绍,最新 google pr值查询 接口 php版 示例
  19. 通过代理刷网页点击量
  20. 再也不用担心重装VSCode了

热门文章

  1. js除法与C语言除法,JS算术运算符及用法
  2. mysql初始化root 密码是多少_Mysql初始化root密码和允许远程访问
  3. java jna_Java中jna的用法
  4. python和revit_如何在Python中产生新的RevitAPI对象
  5. 阿里云 Serverless 助力企业全面拥抱云原生
  6. ECS 选款利器！PTS助您快速上云！
  7. OpenKruise v0.7.0 版本发布：新增周期任务分发控制器
  8. 常见 Serverless 架构模式
  9. 阿里云重磅发布云原生裸金属方案：裸金属+容器，解锁云计算的新方式
  10. Serverless 风起云涌，为什么阿里，微软，AWS 却开始折腾 OAM？