MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写
鍋巴哥的個人建議:cluster叫電信運營商版本,所以基本上在很大的用戶并發量的情況下才會用到,對連接數的線性增長要求高的場景,千兆就不用想了, 沒萬兆就不用玩了。
很不幸,我的就是千兆網絡,我的數據節點是16 core,32G內存,sql節點是16core,16G內存,做了raid10
PS: 水平所限,環境所限,測試結果僅供參考,歡迎大家一起交流提出寶貴的意見,讓我更進一步。
【】一:測試
20.30.50.107 3307
mysql -utim -mcgxxxxx -P3307 -h20.30.50.107 --default-character-set=utf8?
1 查詢測試 100W
1.1 ?ndbcluster ?100W測試,并發分別為--concurrency=800,1200,1500?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-guid-primary ?--concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read ? ) 1> r101.log 2> r102.log
-- 20.30.50.31
(time mysqlslap --engine=ndbcluster --auto-generate-sql-guid-primary ?--concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=rdb10 --auto-generate-sql-load-type=read ? ) 1> /root/r101.log 2> /root/r102.log
1.2 innodb ?100W測試,并發分別為--concurrency=800,1200,1500?
-- 20.30.50.37
(time mysqlslap --engine=innodb -h20.30.50.37 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-guid-primary ?--concurrency=800,1200,1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=idb10 --auto-generate-sql-load-type=read ? ) 1> /root/rin101.log 2> /root/rin102.log
mixed 混合讀寫壓力測試
2 ?ndbcluster 10W
【===================10W 寫 =================】
2.1 ?ndbcluster 在集群里面測試,并發分別為--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write) ?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write) ?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb10 –-commint=100 --auto-generate-sql-load-type=write)?
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 3.735 seconds
? ? ? ? Minimum number of seconds to run all queries: 3.629 seconds
? ? ? ? Maximum number of seconds to run all queries: 3.841 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 200
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 3.577 seconds
? ? ? ? Minimum number of seconds to run all queries: 3.535 seconds
? ? ? ? Maximum number of seconds to run all queries: 3.619 seconds
? ? ? ? Number of clients running queries: 1000
? ? ? ? Average number of queries per client: 100
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 7.998 seconds
? ? ? ? Minimum number of seconds to run all queries: 7.513 seconds
? ? ? ? Maximum number of seconds to run all queries: 8.483 seconds
? ? ? ? Number of clients running queries: 1500
? ? ? ? Average number of queries per client: 66
2.2 innodb 在20.30.50.52里面測試,并發分別為--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 ?-uadmin -pMBpassw0rd --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500,1000,1500 --number-of-queries=100000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indbw2 –-commint=100 --auto-generate-sql-load-type=write) 1> idb11w.log ?2> indb12w.log
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 14.494 seconds
? ? ? ? Minimum number of seconds to run all queries: 13.995 seconds
? ? ? ? Maximum number of seconds to run all queries: 14.994 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 200
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 15.575 seconds
? ? ? ? Minimum number of seconds to run all queries: 15.427 seconds
? ? ? ? Maximum number of seconds to run all queries: 15.724 seconds
? ? ? ? Number of clients running queries: 1000
? ? ? ? Average number of queries per client: 100
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 14.275 seconds
? ? ? ? Minimum number of seconds to run all queries: 13.989 seconds
? ? ? ? Maximum number of seconds to run all queries: 14.561 seconds
? ? ? ? Number of clients running queries: 1500
? ? ? ? Average number of queries per client: 66
3【===================50W 寫 =================】
3.1 ndbcluster,并發分別為--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-500.log 2> 52-500.log?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1000.log 2> 52-1000.log?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb50 –-commint=100 --auto-generate-sql-load-type=write) 1> 51-1500.log 2> 52-1500.log?
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 15.950 seconds
? ? ? ? Minimum number of seconds to run all queries: 15.797 seconds
? ? ? ? Maximum number of seconds to run all queries: 16.104 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 1000
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 16.325 seconds
? ? ? ? Minimum number of seconds to run all queries: 16.080 seconds
? ? ? ? Maximum number of seconds to run all queries: 16.570 seconds
? ? ? ? Number of clients running queries: 1000
? ? ? ? Average number of queries per client: 500
?Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 25.563 seconds
? ? ? ? Minimum number of seconds to run all queries: 24.996 seconds
? ? ? ? Maximum number of seconds to run all queries: 26.130 seconds
? ? ? ? Number of clients running queries: 1500
? ? ? ? Average number of queries per client: 333
3.2 innodb,并發分別為--concurrency=500,1000,1500
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 ?-uadmin -pMBpassw0rd ?--auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-500.log ?2> idb52-500.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 ?-uadmin -pMBpassw0rd ?--auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1000.log ?2> idb52-1000.log
(time mysqlslap --engine=innodb -h127.0.0.1 -P3307 ?-uadmin -pMBpassw0rd ?--auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=500000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb52 –-commint=100 --auto-generate-sql-load-type=write) 1> idb51-1500.log ?2> idb52-1500.log
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 72.366 seconds
? ? ? ? Minimum number of seconds to run all queries: 72.271 seconds
? ? ? ? Maximum number of seconds to run all queries: 72.461 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 1000
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 75.593 seconds
? ? ? ? Minimum number of seconds to run all queries: 75.500 seconds
? ? ? ? Maximum number of seconds to run all queries: 75.687 seconds
? ? ? ? Number of clients running queries: 1000
? ? ? ? Average number of queries per client: 500
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 70.388 seconds
? ? ? ? Minimum number of seconds to run all queries: 69.999 seconds
? ? ? ? Maximum number of seconds to run all queries: 70.777 seconds
? ? ? ? Number of clients running queries: 1500
? ? ? ? Average number of queries per client: 333
4【===================100W 寫 =================】
4.1 ndbcluster,并發分別為--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-500.log 2> 102-500.log?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1000.log 2> 102-1000.log?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb100 –-commint=100 --auto-generate-sql-load-type=write) 1> 101-1500.log 2> 102-1500.log?
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 72.162 seconds
? ? ? ? Minimum number of seconds to run all queries: 71.001 seconds
? ? ? ? Maximum number of seconds to run all queries: 73.323 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 2000
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 33.083 seconds
? ? ? ? Minimum number of seconds to run all queries: 32.924 seconds
? ? ? ? Maximum number of seconds to run all queries: 33.243 seconds
? ? ? ? Number of clients running queries: 1000
? ? ? ? Average number of queries per client: 1000
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 50.789 seconds
? ? ? ? Minimum number of seconds to run all queries: 50.629 seconds
? ? ? ? Maximum number of seconds to run all queries: 50.949 seconds
? ? ? ? Number of clients running queries: 1500
? ? ? ? Average number of queries per client: 666
4.2 innodb,并發分別為--concurrency=500,1000,1500
(time mysqlslap --engine=innodb ?-h127.0.0.1 -P3307 ?-uadmin -pMBpassw0rd ?--auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-500.log ?2> idb102-500.log
(time mysqlslap --engine=innodb ?-h127.0.0.1 -P3307 ?-uadmin -pMBpassw0rd ?--auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1000.log ?2> idb102-1000.log
(time mysqlslap --engine=innodb ?-h127.0.0.1 -P3307 ?-uadmin -pMBpassw0rd ?--auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=indb100 –-commint=100 --auto-generate-sql-load-type=write) 1> idb101-1500.log ?2> idb102-1500.log
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 144.806 seconds
? ? ? ? Minimum number of seconds to run all queries: 144.262 seconds
? ? ? ? Maximum number of seconds to run all queries: 145.350 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 2000
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 152.853 seconds
? ? ? ? Minimum number of seconds to run all queries: 152.369 seconds
? ? ? ? Maximum number of seconds to run all queries: 153.337 seconds
? ? ? ? Number of clients running queries: 1000
? ? ? ? Average number of queries per client: 1000
Benchmark
? ? ? ? Running for engine innodb
? ? ? ? Average number of seconds to run all queries: 146.931 seconds
? ? ? ? Minimum number of seconds to run all queries: 140.731 seconds
? ? ? ? Maximum number of seconds to run all queries: 153.132 seconds
? ? ? ? Number of clients running queries: 1500
? ? ? ? Average number of queries per client: 666
5 100W write壓力,并發分別為--concurrency=600,800,1000
【===================100W 更新 =================】
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=600,800,1000 --number-of-queries=1000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=udb100 –-commint=100 --auto-generate-sql-load-type=update) 1> u101.log 2> u102.log?
6【===================200W 寫 =================】
6.1 ndbcluster,并發分別為--concurrency=500,1000,1500
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log?
(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log?
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 62.062 seconds
? ? ? ? Minimum number of seconds to run all queries: 60.812 seconds
? ? ? ? Maximum number of seconds to run all queries: 63.313 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 4000
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 65.292 seconds
? ? ? ? Minimum number of seconds to run all queries: 64.708 seconds
? ? ? ? Maximum number of seconds to run all queries: 65.876 seconds
? ? ? ? Number of clients running queries: 1000
? ? ? ? Average number of queries per client: 2000
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 101.242 seconds
? ? ? ? Minimum number of seconds to run all queries: 99.702 seconds
? ? ? ? Maximum number of seconds to run all queries: 102.783 seconds
? ? ? ? Number of clients running queries: 1500
? ? ? ? Average number of queries per client: 1333
6.2 innodb ,并發分別為--concurrency=600,800,1000
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201.log 2> 202.log?
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1000.log 2> 202-1000.log?
(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb200 –-commint=100 --auto-generate-sql-load-type=write) 1> 201-1500.log 2> 202-1500.log?
卡住了,長時間無結果,所以我果斷ctrl + c
7【===================400W 寫 =================】
7.1 ndbcluster,并發分別為--concurrency=500,1000,1500
?(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log?
? (time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log?
? ?(time mysqlslap --engine=ndbcluster -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log?
Benchmark
? ? ? ? Running for engine ndbcluster
? ? ? ? Average number of seconds to run all queries: 125.639 seconds
? ? ? ? Minimum number of seconds to run all queries: 124.601 seconds
? ? ? ? Maximum number of seconds to run all queries: 126.677 seconds
? ? ? ? Number of clients running queries: 500
? ? ? ? Average number of queries per client: 8000
PS:只執行了500的并發,1000,1500的卡住了,沒有結果,果斷ctrl + C
7.2 innodb,并發分別為--concurrency=500,1000,1500
?(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-500.log 2> 402-500.log?
? (time mysqlslap --engine=innodb -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1000 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1000.log 2> 402-1000.log?
? ?(time mysqlslap --engine=innodb -h20.30.50.107 -P3307 ?-utim -mcgxxxxx --auto-generate-sql-write-number=1000 --auto-generate-sql-guid-primary ?--concurrency=1500 --number-of-queries=4000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb400 –-commint=100 --auto-generate-sql-load-type=write) 1> 401-1500.log 2> 402-1500.log?
卡住了,長時間無結果,所以我果斷ctrl + c
8 一些調試過程中的報錯紀錄
8.1?
time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary ?--concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000 ?
報錯如下:
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),1124366589,1668402834,788193961,693240337,710453914,1431628572,249499286,1957253341,731708400,1783032263,'lFEughGHyWDXctISMOyE500yda24R2J4HZyp6674cCb5ymPKAGQ7GQxts0pK29GCa7th5sdi55fvr4FtKhsSzpMrh33k4KofJhCOapyXuTQdaZMm6E75wLodOsDT4t','0FbCf11eOo7iPZ7oCDuJAigyCwiHPmBP1eTZXX3vB2TcSSGYh3rrlNhxBOFd2QuwwOTRnOEyQjQuBbQke9RNO8DcOK5JmrFaFc1usFkIq351eNd8P4Xh4c9LwEgayn','85F907OcHEfM79ekHvghcd9my6sWgqHpwYqoX7OoLw3L5hxFSeo4Fxi53bbcHsHDGztn6IRK6Wh33eIX8ycFwACrlnJvXc0fcuIi4muAGbDC6Oj6MBEAMQ2zEDudqv','HIhbslLnnWM0iKGPRXTZhrzbqDhdjXY0hDRZqhKdBbTlne269XfiMfA5kriRE6JvJnS1Shef8zGvdI2mqZL4CN9pEjGKpcF0Fb1j8XEGXW48oynWX0bcNcPTKZp994','2GX3zgR5oybsyGideEdDi0i7TugIviExyetqAKvyANj8XPm9XNFDGxClrtwmR2cPgTFqp3hzQOzxhly51DAH2Nut8iYbl80PT88I3p9LD0Ame8rfM2oOPaAZHa02as','J3sRDvGEGLEQ8sRzNptB5Am7bvhbxFSGAKkNGsdOEkjMcADsrz3w9hwdcTCPdgantA312YPGG8WlAcd1RYqS6m5aFI0sqaYjkbke72nG291DdeE4AwZGiWrqgjaX9y','6lZjNZlApnKqspK7uWvJfWpMKWxmt6lzrAi6jJHY7TEzIay45mNcG5qSRnEKlrBc2mad5jA4COwNzmRwYjOogE87tFJe6W608geEOgASwyjnlBj9mzqQ5yPyDkSC6a','4F7iLNENjBMRyzWa0GZqaXhzTmbyqhOvwNT9mkZWnnxdmJBebdT1820TgbJX8kIxzn6eNX8AAxowGrRjSokSqcyM39t3tB0lrzNEMNPZC5LKwo3HcflI7bhAlaDWe6','FL5ebR1ssDpEZm2S3fzgx68WGt5MFbSXoP1Fkv8d0prQblmWOmBEsBk14hNB8jio0c4kN4LNt4pLqcr6MuC65p71MMDNxnBxNFimJv2DsraiJHgZClY9aXBouOBjBN','hReF5qA7vurLS2e9Sim0sKX38HJC1Mbip5pnnzmimT3EYaNsG9s8LF3MZMaal18QyxDmo0KaTGptq4l66TFJlIhIZ7kI0kkrZyTDqpgB5TxvPiuXC1jpBOzkOb2OJn')?
ERROR : Got temporary error 1221 'REDO buffers overloaded (increase RedoBuffer)' from NDBCLUSTER
【】設置值
RedoBuffer=1024M
8.2?
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),493003739,1094004845,2043467988,1553979924,1267424138,2013801552,1873938704,1783263123,1384180838,447107163,'1MPJh2d9MOvi9GCrzc6vAxsqMXvyQPuJnJfLL8MbPHHaaMHPqFCsDxjRSWHmvB5aMcvbdHA2RKStilAYtFOyCzPYTaAGm7j8kWcDgm776bsgCu4x9TvDKClinnyZvZ','ZX49kkorjmQRRWLXSNsNcDcEvF1lgwJDRFF3zvuahC10bMY3dGIELmKG1LuhA5ndK2hBpRlWgeX7svAWBKcZ7wh8HRqROdxkXWnKxYiT2Dcv0eP4z1T6p2E6MwQmZN','XwtIGijzCd4gYxJptIiMOXGWWeRwPsJop46xmhoqBlXjiqPb07pOf5m9cDx1y8pnCncqLPhYA4FkmgBmg02BxoCZu9asHFXL373GOkoagvIQSTC8LEBJvNkpYBZhQ4','uL3xdSaHuEDDZhalhossznFjcfu1CDx6Q0vwKTDFcQK9zmugaeYZPf9tIvuM0rSRkON4lSBLnNMmA9Jcnj2DNByZ6to7kGQKYhPA9SNosmbunmMaTOfkbeAaNyZ76z','KXYdhh5wWpixjLb6w4MRhq5jOShpSfooAKPjtMgFCE4ncflOc8r9ypsE9Z3dCjHFvayopWw1lsoDYad0aK9Y91mJQpoWYylRYc7L6vEjovoCLPCveDRnE56gun2Ilo','d9OcNMYdyCYmOl4Sgih7Ln4KJy7L8s1dtPEGgemWqAG6wCQcu7cGmgc5XbIfJKHCdNLH17njHwpD8FivEIB0qfxLEFtZb2dDHyMI52tFyaKyh2tnC4n3bcGpj1EB3s','OKqeWogN3WpNTWIMHWJwPuOic8jqJfabrH5M5md08JNTpZsz43vTxK3PKfGfAi61zBFwploy4CRtdBshEg34syTCddjnKphB0w0qhoglszXW3F39v6Df5jraCaEONv','cGrSyPGW21LZXOhaaSZf8eEz4RQIrhDJxxnnMwHOxXqKvXuLzJ17p7zuaHCIyIdoFHbT5lt28bM368HySAxHHw3kDG24QXshgJAlwvf4N10L2HJMJHXc5bCJj6F9e7','iAQkwFXbJuTBGNKblfkG8qjK1QRGRxF9zZtvoPN0BkBR7YvkBfsJLcYMuzWMolNnJ9b7aq7laB5Zj09mX16tTWFOTee9N1wi2NicDhEfsBCRBLEiFCRkib03DeCcY0','BaOl3dI9HBKLWNjkxywPae0bh55lZTmkwALzng0wjKIDjtygjmxHHxkq2qccBMC7OayB6y0pAIul3sQmXFvoDge7MEbZSohsEfwCWw1g6vI9gcn3rir4ML4kSfIwJr')?
ERROR : Got temporary error 1218 'Send Buffers overloaded in NDB kernel' from NDBCLUSTER
【】設置值
在sql節點的my.cnf里面去掉binlog
8.3
?time mysqlslap --engine=ndbcluster --auto-generate-sql-write-number=100000 --auto-generate-sql-guid-primary ?--concurrency=200,400,600 --number-of-queries=2000000 --iterations=2 --number-char-cols=10 --number-int-cols=10 --auto-generate-sql --create-schema=ndb –-commint=1000 --auto-generate-sql-load-type=write ??
mysqlslap: Cannot run query INSERT INTO t1 VALUES (uuid(),100669,332702450,660916487,67974802,573556837,75245562,1390598089,1028363610,1531585205,1260995960,'kXdTjGCh2PNzLoeR0527frpQDQ8uw67Ydk1K06uuNHtkxYBxT5w8plb2BbpzhwYBgPNYX9RmICWGkZD6fAESvhMzH3yqzMtXoH4BQNylbK1CmEIPGYlC6zBN3152Gz','a4GW7atxJKACYwJqDbFynLxqc0kh30YTwgz3FktQ43XTrqJ4PQ25frn7kXhfXD8RuzN1j8Rf3y8ugKy6es3IbqPJM6ylCyD6xS7YcQCfHKZxYNvB7yTahmu3lkoxjt','vgLu5xKHSTTtJuGE5F5QqmCcppCTmvFZScRZQgim93gSxwb24gKmIPEzEQStMjQiCu7WapGbkw4ilXch3xRLMhKSzgLDOovSi2qGj6rKvnuYAWDDJgaZDu24bNIrBD','Bl81tjzdvuOpQRCXgX37xGtzLKEXBIcE3k7xK7aFtqxC99jqYnpTviK83bf6lGDgsKd4R3KLmHPnI8TqnIKj1gjw7N2sXFZNS2Svyg8cpZN7atxL39w4igspvnaQuz','hMt1IrZIJMkbLAKBNNKKK2sCknzI5uHeGAgQuDd5SLgpN0smODyc7qorTo1QaI5qLl97qmCIzl0Mds81x7TxpIoJyqlY0iEDRNKA1PS0AKEn5NhuMAr3KgEIMsqMa5','SuKo4M5OM7ldvisSc6WK9rsG9E8sSixocHdgfa5uiiNTGFxkDJ4EAwWC2e4NL1BpAgWiFRcp1zIH6F1BayPdmwphatwnmzdwgzWnQ6SRxmcvtd6JRYwEKdvuWri8qB','5MAR1caTvNFXB00HKShGa1uToGCMP2ZMHjpABFg6fnTioTz8pZGNQAkEJwckr9y0kfAvvq1QWM8IkzIZOaprdPxwMaY5bW5C977wy1MKNMe7EwZeWET7fRv1tRyKpv','Yr3YntZ2DoGrwWfL91bW9Epw8iO6vDuR4xrkqOe3Dum1PPEQQpwRvmO3Kg2FtobqlQQRj4Woq8hFZvhrkWBX8bRSFLc09BiuT0L44jsvrZ2GKczwyAS6dvakGAlPDJ','BbKOfG7O3qp66Aa5yY8QelD4WL77eKIpneDJnCbq2Oo0QM6Pm6jOrxLDASCpgXWS1cnooMXjeJj5ahMCnxTXuqkxIxmyK8QLk52PJZ8ykjvAP9N46sbtiKq09SqTcH','iLEkea9eOuLJweKJjQ3IJlW1dXTSs6dbJjJpHTRZFgkBJ4XuNQ4iCRchy51r3WQEEdvNyMxDvZHEeg0164bINBsM9l54GNBM06lrTa4G8LWe1Mf8I6IiA24Jo1FwOQ')?
ERROR : Got temporary error 1234 'REDO log files overloaded (increase disk hardware)' from NDBCLUSTER
【】清理磁盤data節點37的磁盤滿了
/home/ndb_4_fs文件夾占據了22G,清理掉。
8.4
【】
ERROR : Got temporary error 410 'REDO log files overloaded (decrease TimeBetweenLocalCheckpoints or increase NoOfFragmentLogFiles)' from NDBCLUSTER
vim /usr/local/mysql/cluster-conf/config.ini
TimeBetweenLocalCheckpoints=10 (原值20)
NoOfFragmentLogFiles=32 (原值8)
ERROR : Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER
?
轉載于:https://www.cnblogs.com/suncoolcat/p/3289811.html
總結
以上是生活随笔為你收集整理的MySQL Cluster 4个数据节点压力测试--mysqlslap工具压400W写的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: autotools入门笔记(一)
- 下一篇: 百万数据下几种SQL性能测试