A Mysql data to file/elasticsearch/kafka/redis/redis-cluster/mongodb(audit and normal)/TiDB/postgresql with binlog tool.
A Mysql data to file/elasticsearch/kafka/redis/redis-cluster with binlog tool.
High Performance
xxx.toml (canal config file)
xxx.pos (binlog pos file)
config.toml (Output source config file)
691944436
The answer is zero
Test Machine : 4C 8G
Total Binlog Raw Count:1 Million
Bulksize: 1000
Resource utilization
CPU: 250%
Mem:3%
Duration:178s
Total Binlog Raw Count:1 Million
Bulksize: 1000
Resource utilization
CPU: 230%
Mem:0.5%
Duration:27s
Total Binlog Raw Count:1 Million
Bulksize: 1000
Resource utilization
CPU: 230%
Mem:0.5%
Duration:21s
Total Binlog Raw Count:1 Million
Bulksize: 1000
Resource utilization
CPU: 90%
Mem:0.5%
Duration:62s
Total Binlog Raw Count:1 Million
Bulksize: 1000
Resource utilization
CPU: 230%
Mem:1%
Duration:24s
Total Binlog Raw Count:1 Million
Bulksize: 1000
Resource utilization
CPU: 280%
Mem:0.5%
Duration:38s