Hi, My personnal favorites when Prometheus is not there and/or insufficient are: - iostat -> log all disk metrics volume by volume - nmon -> logs all metrics, but cannot see volume by volume IOPS - nmonvisualizer
Regards JL # Monitor ## install dstat nmon iostat ioperf sar ## install nmonvisualizer java app : it parses nmon and iostat logs -------- dstat -tcndylpm --top-cpu --disk-tps iotop sar -d 10 export S_TIME_FORMAT=ISO; iostat -tNxm 10 180 > iostat.$HOSTNAME.log nmon -f -t -r test -s 10 -c 180 https://nmonvisualizer.github.io/nmonvisualizer/ ------- # Disk smartctl -a /dev/sda fio --name write_zookeeperlike --rate_iops=1 --eta-newline=5s --filename=fio-tempfile-$(uuidgen).dat --rw=randwrite --size=1g --blocksize=4k --ioengine=libaio --fsync=1 --iodepth=1 --direct=1 --numjobs=1 --runtime=60 --group_reporting fio --name write_hdfslike --eta-newline=5s --filename=fio-tempfile-$(uuidgen).dat --rw=randwrite --size=20g --io_size=1024g --blocksize=128m --ioengine=libaio --fsync=1 --iodepth=1 --direct=1 --numjobs=8 --runtime=180 --group_reporting ------------------- sudo iptables -L Now to add a rule to the INPUT chain to drop 3% of incoming packets on computer B: $ sudo iptables -A INPUT -m statistic --mode random --probability 0.03 -j DROP iperf -c 192.168.1.5 -u -t 60 This rule should drop packet 100, 300, 500, 700, ... for only one of the connections (with source port 39912): $ sudo iptables -A INPUT -p udp --sport 39912 -m statistic --mode nth --every 200 --packet 100 -j DROP ------------------------------------------------------------ Network delay OVERALL : echo "simulating slowdown infrastructure on interface $DEV to IP:$IP for port:$PORT"; tc qdisc del dev $DEV root tc qdisc add dev $DEV handle 1: root htb tc class add dev $DEV parent 1: classid 1:15 htb rate 1000Mbps tc qdisc add dev $DEV parent 1:15 handle 11 netem delay 4000ms 2000ms distribution normal tc filter add dev $DEV parent 1:0 prio 1 protocol ip handle 11 fw flowid 1:15 # for all port : # iptables -A OUTPUT -t mangle -d "$IP" -j MARK --set-mark 11 # for specific port iptables -A OUTPUT -t mangle -d "$IP" -p tcp --dport ${PORT} -j MARK --set-mark 11 ((the undo script is here:)) iptables -D OUTPUT -t mangle -d "$IP" -j MARK --set-mark 11 tc qdisc del dev $DEV root Le sam. 27 juil. 2019 à 11:45, Paul Chandler <p...@redshots.com> a écrit : > I have always found Amy's Cassandra 2.1 tuning guide great for the Linux > performance tuning: > https://tobert.github.io/pages/als-cassandra-21-tuning-guide.html > > Sent from my iPhone > > On 26 Jul 2019, at 23:49, Krish Donald <gotomyp...@gmail.com> wrote: > > Any one has Cheat Sheet for Unix based OS, Performance troubleshooting ? > >
