hcymysql's recent timeline updates
hcymysql's repos on GitHub
PHP · 156 watchers
mysql_monitor
MySQL Monitor面向研发人员图形可视化监控工具
PHP · 156 watchers
slowquery
Slowquery图形化显示MySQL慢日志工具
Python · 92 watchers
MHA-Re-Edition
MySQL (MHA)重构版
Python · 85 watchers
reverse_sql
Binlog数据恢复,生成反向SQL语句
Python · 78 watchers
sql_helper
输入SQL自动给出索引优化建议和SQL重写建议
Python · 69 watchers
mysqlstat
MySQL命令行监控工具 - mysqlstat
Shell · 68 watchers
mysql_install
MySQL 8.0 MGR自动安装配置脚本
PHP · 62 watchers
sqlops
SQL自动审核-自助上线平台
PHP · 46 watchers
pt-archiver
Percona pt-archiver重构版--大表数据归档工具
Python · 44 watchers
mysql_sniffer
mysql_sniffer 是一个基于 MySQL 协议的抓包工具,实时抓取 MySQL 服务端的请求,并格式化输出,输出内容包括访问时间、来源 IP、执行的SQL语句。以便检测升级到MySQL 8.0的SQL语法兼容性。
Python · 43 watchers
pt-slave-repair
自动修复MySQL主从同步数据
Perl · 33 watchers
mongo_monitor
MongoDB ReplSet Monitor面向研发人员图形可视化监控工具
PHP · 31 watchers
pt-kill
Percona PT-kill重构版(PHP)
PHP · 29 watchers
mongo_slowquery
MongoDB Slowquery平台可视化慢日志工具
Perl · 21 watchers
redis_monitor
PHP · 20 watchers
mgr_failover_vip
MySQL 8.0 MGR(组复制)高可用VIP故障转移脚本
Python · 19 watchers
binlog_parse_sql
将 binlog 解析为 SQL 并将其存入数据库
Perl · 17 watchers
os_monitor
傻瓜式免安装-Centos操作系统资源 图形可视化监控工具
PHP · 9 watchers
imprison_rg
囚禁慢SQL
Python · 9 watchers
redis_find_bigkey
自定义阀值查找Redis Big Key(占用内存较多的Value)的工具
6 watchers
data_mask_function
身份证号、住址、手机号、邮箱、姓名、银行卡号 - 脱敏函数
5 watchers
mysql_book
MySQL运维进阶指南
Python · 5 watchers
mysql_repl
轻便型的MySQL binlog replication tool
PHP · 5 watchers
PMongo-HotBackup
Percona MongoDB3.4 HotBackup PHP Script
Shell · 5 watchers
summarize_binlogs
MySQL Binlog分析统计概述
Shell · 4 watchers
batch_sshkey
SSH主机批量互信认证
Python · 3 watchers
ansible-simple
ansible简易版
Shell · 3 watchers
mariadb_install
mariadb自动安装脚本
C++ · 3 watchers
mysql-component-uuid_v7
MySQL Component to generate UUID_v7
Python · 3 watchers
mysql_to_clickhouse_sync
MySQL to ClickHouse data synchronization
Perl · 3 watchers
orzdba_remote
3 watchers
RollbackTimeCalc
估算 MySQL 已取消事务的回滚时间
Python · 2 watchers
binlog_analysis
Binlog分析利器-binlog_analysis.py
Python · 2 watchers
find_key
在不知道表名和字段名的情况下,查找出哪些字段里包含“关键字”的数据。
2 watchers
hcymysql
Config files for my GitHub profile.
Python · 2 watchers
mongodb_process_checker
Tools used for MySQL and MongoDB Operations
2 watchers
mysql-system-schema
基于MySQL 5.7的ps,is,sys,mysql库的明细文档
2 watchers
mysql_TenDB-Cluster
TenDB Cluster分部署数据库部署使用
Perl · 2 watchers
os
centos6 系统初始化脚本
1 watchers
dbsake
Collection of mysql tools
Python · 1 watchers
MongoDB-Log-Plotter
A simple script to plot slow queries and other data from MongoDB versions above 4.4 based on the log file.
Shell · 1 watchers
mongo_install
MongoDB 副本集安装配置脚本
1 watchers
ps8039
Percona Server 8.0.39 For Centos7
1 watchers
python-mysql-replication
Pure Python Implementation of MySQL replication protocol build on top of PyMYSQL
Python · 1 watchers
update_10w
循环分批次批量更改数据10万行记录
0 watchers
advcpmv
A patch for GNU Core Utilities cp, mv to add progress bars
0 watchers
AnotherRedisDesktopManager
🚀🚀🚀A faster, better and more stable Redis desktop manager [GUI client], compatible with Linux, Windows, Mac.
0 watchers
awesome-free-chatgpt
🆓免费的 ChatGPT 镜像网站列表,持续更新。List of free ChatGPT mirror sites, continuously updated.
0 watchers
chatgpt-web
使用 express 和 vue3 搭建的 ChartGPT 演示网页
0 watchers
cobalt
save what you love
0 watchers
dev-example-nosql-listener
This repository contains information on how to create and use a MariaDB MaxScale NoSQL Listener with MariaDB Community Server.
0 watchers
dolphie
Your single pane of glass for real-time analytics into MySQL/MariaDB & ProxySQL
0 watchers
duckdb
DuckDB is an in-process SQL OLAP Database Management System
0 watchers
gocron
定时任务管理系统
0 watchers
gt-checksum
gt-checksum是GreatSQL社区开源的一款静态数据库校验修复工具,支持MySQL、Oracle等主流数据库。
0 watchers
hatchet
MongoDB JSON Log Analyzer
HTML · 0 watchers
hcymysql.github.io
0 watchers
ibd2sql
parse mysql ibd file to sql for learn or recovery data
0 watchers
ibdNinja
A powerful C++ tool for parsing and analyzing MySQL 8.0 (.ibd) data files
0 watchers
jc
CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.
0 watchers
kvrocks
Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.
0 watchers
mariadb-columnstore-sample-data
Example queries and dataset for use with MariaDB ColumnStore
0 watchers
mo-sql-parsing
Let's make a SQL parser so we can provide a familiar interface to non-sql datastores!
0 watchers
MongoShake
MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具,可以满足迁移和同步的需求,进一步实现灾备和多活功能。
0 watchers
mysql_random_data_load
MySQL random data loader
0 watchers
pandora
潘多拉,一个让你呼吸顺畅的ChatGPT。Pandora, a ChatGPT that helps you breathe smoothly.
Perl · 0 watchers
percona-toolkit
Percona Toolkit: a collection of advanced open source command-line tools.
0 watchers
proxysql
High-performance MySQL proxy with a GPL license.
0 watchers
proxyweb
Open Source Web Interface for ProxySQL
0 watchers
python3-cookbook
《Python Cookbook》 3rd Edition Translation
0 watchers
qstudio
qStudio - Free SQL Analysis Tool
0 watchers
readyset
Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.
0 watchers
schemadiff
Declarative schema diffing, normalization, validation and manipulation via command line
0 watchers
slim
Slim(toolkit): Don't change anything in your container image and minify it by up to 30x (and for compiled languages even more) making it secure too! (free and open source)
0 watchers
spirit
Online Schema Change Tool for MySQL 8.0+
0 watchers
sql-metadata
Uses tokenized query returned by python-sqlparse and generates query metadata
0 watchers
sqlfluff
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
0 watchers
sysbench-tpcc
Sysbench scripts to generate a tpcc-like workload for MySQL and PostgreSQL
0 watchers
TenDBCluster-TSpider
TSpider is the proxy node of TenDB Cluster.
0 watchers
think-sql
SQL query for MySQL
0 watchers
trdsql
CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats.
0 watchers
valkey
A new project to resume development on the formerly open-source Redis project. We're calling it Valkey, since it's a twist on the key-value datastore.
0 watchers
vanna
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.
hcymysql

hcymysql

🏢  DBA
V2EX member #661159, joined on 2023-11-08 11:30:45 +08:00
DBA
hcymysql's recent replies
Nov 24, 2023
Replied to a topic by hcymysql MySQL MySQL 误操作闪回工具 - reverse_sql
这个必须连接数据库获取 binlog
Nov 24, 2023
Replied to a topic by hcymysql MySQL MySQL 命令行监控工具 - mysqlstat
2023-11-24 更新:mysqlstat 工具版本号: 1.0.12 - 修复 binlog 统计 BUG
MySQL (MHA)重构版
https://github.com/hcymysql/MHA-Re-Edition

由于 MHA ( mha4mysql-manager )工具 2018 年已经停止维护更新,且不支持 Gtid 复制模式,在原版基础上增补功能难度较大,固考虑将其重构。

参考了原版 MHA 的故障切换思路,改进的地方如下:

1 )无需打通 ssh 公私钥互信认证,只需在 app1.cnf 配置文件里提供用户名和密码( root 权限)即可,这一步的作用是漂移 VIP ,工具会直接进入远程主机上执行 ip addr add VIP

2 )目前主流版本 MySQL 5.7 和 8.0 的复制模式是基于 Gtid ,因事务号是唯一的,更改同步复制源不需要知道 binlog 文件名和 position 位置点,固简化了在客户端部署 agent 做数据补齐。

3 )无需安装,就两个文件,一个是(环境配置检查)可执行文件 masterha_check_repl_mysql ,一个是(故障自动转移 autofailover 和在线平滑切换 online switch )可执行文件 masterha_manager_mysql

4 ) 基于主从复制( Gtid 复制模式)才可以运行,masterha_check_repl_mysql 工具会检测,如果是基于 binlog 和 position (位置点复制模式)不能运行。可开启半同步复制确保切换以后数据完整性(至少有一个从库确认已接收到所有事件)。

5 ) masterha_manager_mysql 守护进程主控文件,集成了 ( masterha_master_switch + master_ip_failover + masterha_secondary_check + shutdown_script + weixin_alarm )捆绑在一起

6 ) AutoFailover 自动故障切换(转移) VIP 后,会发送微信公众号报警通知​

7 )支持远控卡重启服务器(避免脑裂问题)。例如删除 VIP 失败,主机已经 hang 住,只能通过远程管理卡去重启机器。在这里你可以调用远控卡命令,比如 DELL 服务器的 ipmitool 命令​https://www.cnblogs.com/EricDing/p/8995263.html

8 )增补对 MariaDB Gtid 的支持
performance-schema = 1
performance-schema-instrument = wait/lock/metadata/sql/mdl=ON ,这样就可以了,兼顾性能。
About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   3501 Online   Highest 6679   ·     Select Language
创意工作者们的社区
World is powered by solitude
VERSION: 3.9.8.5 · 24ms · UTC 04:45 · PVG 12:45 · LAX 21:45 · JFK 00:45
♥ Do have faith in what you're doing.