本文主要向大家介绍了MySQL数据库之Dr.Elephant mysql connection error ,通过具体的内容向大家展现,希望对大家学习MySQL数据库有所帮助。

This is the first time I try to use english to write my blog, so don't jeer at the mistake of my grammar and spelling.

Because of multi threaded drelephant will cause JobHistoryServer’s Loads very high, so I stopped it for a strench of time. Until last week, a period pull from JHS patch merge request from github was released. I re-compiled dr. elephant and deploy the new dr. elephant on the cluster. It seems stable, but on this Monday morning, my leader told me that there were no more counters and any information about cluster jobs in dr. elephant.  So I logged in to the server, and check log, then I found this message below.[error] c.j.b.ConnectionHandle - Database access problem. Killing off this connection and all remaining connections in the connection pool. SQL State = HY000

And then, I found two things will cause this issue, one of them is selinux config is set to enforcing, change this config value to disabled and reboot the server, it seem good, but still got same error, only not too many.

Then I review the code of dr. elephant, I  find out that in mysql create table in mysql initializing script of play framework has an issue. the index is too long, I change the index to 250 previously, but if an url is longer then 250, it gone wrong.create index yarn_app_result_i4 on yarn_app_result (flow_exec_id(250));create index yarn_app_result_i5 on yarn_app_result (job_def_id(250));create index yarn_app_result_i6 on yarn_app_result (flow_def_id(250));

So I delete this index limitation, and rewrite the sql like this, add a innodb_large_prefix and row_format=dynamic to the table creation script, and finally, no more error log appears…SET GLOBAL innodb_file_format=Barracuda;SET GLOBAL innodb_large_prefix = ON;CREATE TABLE yarn_app_result (  id               VARCHAR(50)   NOT NULL              COMMENT 'The application id, e.g., application_1236543456321_1234567',  name             VARCHAR(100)  NOT NULL              COMMENT 'The application name',  username         VARCHAR(50)   NOT NULL              COMMENT 'The user who started the application',  queue_name       VARCHAR(50)   DEFAULT NULL          COMMENT 'The queue the application was submitted to',  start_time       BIGINT        UNSIGNED NOT NULL     COMMENT 'The time in which application started',  finish_time      BIGINT        UNSIGNED NOT NULL     COMMENT 'The time in which application finished',  tracking_url     VARCHAR(255)  NOT NULL              COMMENT 'The web URL that can be used to track the application',  job_type         VARCHAR(20)   NOT NULL              COMMENT 'The Job Type e.g, Pig, Hive, Spark, HadoopJava',  severity         TINYINT(2)    UNSIGNED NOT NULL     COMMENT 'Aggregate severity of all the heuristics. Ranges from 0(LOW) to 4(CRITICAL)',  score            MEDIUMINT(9)  UNSIGNED DEFAULT 0    COMMENT 'The application score which is the sum of heuristic scores',  workflow_depth   TINYINT(2)    UNSIGNED DEFAULT 0    COMMENT 'The application depth in the scheduled flow. Depth starts from 0',  scheduler        VARCHAR(20)   DEFAULT NULL          COMMENT 'The scheduler which triggered the application',  job_name         VARCHAR(255)  NOT NULL DEFAULT ''   COMMENT 'The name of the job in the flow to which this app belongs',  job_exec_id      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to a specific execution of the job/action(job in the workflow). This should filter all applications (mapreduce/spark) triggered by the job for a particular execution.',  flow_exec_id     VARCHAR(255)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to a specific flow execution. This should filter all applications fired by a particular flow execution. Note that if the scheduler supports sub-workflows, then this ID should be the super parent flow execution id that triggered the the applications and sub-workflows.',  job_def_id       VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to the job in the entire flow independent of the execution. This should filter all the applications(mapreduce/spark) triggered by the job for all the historic executions of that job.',  flow_def_id      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to the entire flow independent of any execution. This should filter all the historic mr jobs belonging to the flow. Note that if your scheduler supports sub-workflows, then this ID should reference the super parent flow that triggered the all the jobs and sub-workflows.',  job_exec_url     VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the job execution on the scheduler',  flow_exec_url    VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the flow execution on the scheduler',  job_def_url      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the job definition on the scheduler',  flow_def_url     VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the flow definition on the scheduler',  PRIMARY KEY (id)) ENGINE=InnoDB DEFAULT CHARSET=utf8 ROW_FORMAT=DYNAMIC;create index yarn_app_result_i1 on yarn_app_result (finish_time);create index yarn_app_result_i2 on yarn_app_result (username,finish_time);create index yarn_app_result_i3 on yarn_app_result (job_type,username,finish_time);create index yarn_app_result_i4 on yarn_app_result (flow_exec_id);create index yarn_app_result_i5 on yarn_app_result (job_def_id);create index yarn_app_result_i6 on yarn_app_result (flow_def_id);create index yarn_app_result_i7 on yarn_app_result (start_time);CREATE TABLE yarn_app_heuristic_result (  id                  INT(11)       NOT NULL AUTO_INCREMENT COMMENT 'The application heuristic result id',  yarn_app_result_id  VARCHAR(50)   NOT NULL                COMMENT 'The application id',  heuristic_class     VARCHAR(255)  NOT NULL                COMMENT 'Name of the JVM class that implements this heuristic',  heuristic_name      VARCHAR(128)  NOT NULL                COMMENT 'The heuristic name',  severity            TINYINT(2)    UNSIGNED NOT NULL       COMMENT 'The heuristic severity ranging from 0(LOW) to 4(CRITICAL)',  score               MEDIUMINT(9)  UNSIGNED DEFAULT 0      COMMENT 'The heuristic score for the application. score = severity * number_of_tasks(map/reduce) where severity not in [0,1], otherwise score = 0',  PRIMARY KEY (id),  CONSTRAINT yarn_app_heuristic_result_f1 FOREIGN KEY (yarn_app_result_id) REFERENCES yarn_app_result (id));create index yarn_app_heuristic_result_i1 on yarn_app_heuristic_result (yarn_app_result_id);create index yarn_app_heuristic_result_i2 on yarn_app_heuristic_result (heuristic_name,severity);CREATE TABLE yarn_app_heuristic_result_details (  yarn_app_heuristic_result_id  INT(11) NOT NULL                  COMMENT 'The application heuristic result id',  name                          VARCHAR(128) NOT NULL DEFAULT ''  COMMENT 'The analysis detail entry name/key',  value                         VARCHAR(255) NOT NULL DEFAULT ''  COMMENT 'The analysis detail value corresponding to the name',  details                       TEXT                              COMMENT 'More information on analysis details. e.g, stacktrace',  PRIMARY KEY (yarn_app_heuristic_result_id,name),  CONSTRAINT yarn_app_heuristic_result_details_f1 FOREIGN KEY (yarn_app_heuristic_result_id) REFERENCES yarn_app_heuristic_result (id));create index yarn_app_heuristic_result_details_i1 on yarn_app_heuristic_result_details (name);

At last I send a pull request to linkedin on github.com…

本文由职坐标整理并发布,希望对同学们学习MySQL有所帮助,更多内容请关注职坐标数据库MySQL数据库频道!

connection error mysql_MySQL数据库之Dr.Elephant mysql connection error相关推荐

  1. 怎么看数据库版本mysql_MySQL数据库之如何查看MySQL的版本?

    本文主要向大家介绍了MySQL数据库之如何查看MySQL的版本? 通过具体的内容向大家展现,希望对大家学习MySQL数据库有所帮助. 查看MySQL的版本,主要有以下几个方法: 1. 没有连接到MyS ...

  2. mysql error report,ECSHOP网店系统提示MYSQL SERVER ERROR REPORT的解决方法

    cshop(V 2.7.2)网站访问突然提示:"MySQL server error report MySQL server error report:Array ( [0] => A ...

  3. 创建数据库 mysql 1044_mysql ERROR 1044 (42000): Access denied for user ''@'localhost' to database...

    1. 问题描述: 在MySQL控制台下创建数据库出现以下信息: mysql> CREATE DATABASE python; ERROR 1044 (42000): Access denied ...

  4. mysql数据库备份报错145_mysql数据库导出时报错mysqldump: Got error: 145的解决方法

    在给mysql数据库备份时,报错:mysqldump: Got error: 145: Table './jxzhtopenfire/ofoffline' is marked as crashed a ...

  5. ldd /usr/bin/mysql_mysql客户端登录时报mysql: relocation error错误

    在安装了xtrabackup后,再用下列命令登录时报下列错误 [root@localhost ~]# mysql -u root -p mysql: relocation error: mysql: ...

  6. mysql数据库导出时报错mysqldump: Got error: 145的解决方法

    在给mysql数据库备份时,报错:mysqldump: Got error: 145: Table './jxzhtopenfire/ofoffline' is marked as crashed a ...

  7. 关于逆向工程,解决mysql数据库遇到的1406问题,ERROR 1062 (23000): Duplicate entry '0' for key 'PRIMARY'

    先说逆向过程,先是在PowerDesginer这个软件上生成数据表,然后生成sql脚本, 生成sql脚本: 然后在命令行进行数据生成. 1.连接mysql数据库 2.use 数据库(其中一个空数据库) ...

  8. 数据库连接10060_Navicat MySQL 数据库连接报:10060 “Unknow error” 错误 – DEFCON笔记...

    今日安装 Navicat Premium 后,使用 root 账号无法连接到数据库,提示:10060 "Unknow error" 错误. 首先查看防火墙状态:systemctl ...

  9. Java连接Mysql数据库警告:Establishing SSL connection without server's identity

    Java连接Mysql数据库警告:Establishing SSL connection without server's identity verification is not recommend ...

最新文章

  1. C/C++ VS java
  2. Nginx-场景实践篇
  3. 配置java环境变量
  4. Python进阶(2)
  5. retargeting PHP,Retargeting the Animation 教学
  6. java 并发 线程安全_Java并发教程–线程安全设计
  7. 埋点技术:“呵呵,你在网上的一举一动,都在我眼皮子底下”
  8. SpringApplication:SpringBoot程序启动的一站式解决方案
  9. git 本地项目上传
  10. Onedark风格配色方案
  11. Layui自定义表单校验规则
  12. 测试图片真假软件,如何找出照片的PS痕迹__如何检测一张图片是否被PS过_飞翔教程...
  13. 思古解析js静态逆向分析
  14. [芦半山]Android native分析工具ASAN和HWASAN原理解析
  15. 聊聊那些专为算法设计的模式——模板方法模式
  16. android calendar 24小时制,Android 使用SimpleDateFormat以及Calendar转换时间为12小时制和24小时制时间格式...
  17. composer镜像源切换
  18. 【2020-07】字节跳动面试凉经(年轻人的第一场 技术面试)
  19. CF1527D MEX Tree(mex树容斥)
  20. ORB - (Oriented Fast and Rotated BRIEF)算法

热门文章

  1. Lucene5学习之FuzzyQuery使用
  2. 服务器性能测试方法,服务器性能测试方法
  3. 20180929 北京大学 人工智能实践:Tensorflow笔记08
  4. 每日优鲜前置仓“一生三”的背后
  5. 广告ctr中几个问题
  6. 为什么很多大学生的生活费都不够花?
  7. 雕刻机6轴usb控制卡源码RTCP算法双源码含pcb图
  8. 借VR产业东风,江西抢滩布局“元宇宙”
  9. C++智能指针3——弱指针weak_ptr详解
  10. org.springframework.dao.DataIntegrityViolationException错误