1. free total used free shared buff/cache available Mem: 8025436 1255616 6457736 11780 312084 6512296 Swap: 1425404 0 1425404
2. cat /proc/spl/kstat/zfs/arcstats 12 1 0x01 98 26656 4085867100 20862566338548 name type data hits 4 8977275 misses 4 20770 demand_data_hits 4 7154775 demand_data_misses 4 13760 demand_metadata_hits 4 1810210 demand_metadata_misses 4 4292 prefetch_data_hits 4 112 prefetch_data_misses 4 719 prefetch_metadata_hits 4 12178 prefetch_metadata_misses 4 1999 mru_hits 4 4041554 mru_ghost_hits 4 0 mfu_hits 4 4923504 mfu_ghost_hits 4 0 deleted 4 31 mutex_miss 4 0 access_skip 4 9 evict_skip 4 124 evict_not_enough 4 0 evict_l2_cached 4 0 evict_l2_eligible 4 396800 evict_l2_ineligible 4 8192 evict_l2_skip 4 0 hash_elements 4 20337 hash_elements_max 4 22033 hash_collisions 4 82157 hash_chains 4 196 hash_chain_max 4 2 p 4 2054511616 c 4 4109023232 c_min 4 256813952 c_max 4 4109023232 size 4 1856513648 compressed_size 4 1349638144 uncompressed_size 4 1738882048 overhead_size 4 446370304 hdr_size 4 7828496 data_size 4 1709473792 metadata_size 4 86534656 dbuf_size 4 9437376 dnode_size 4 23086368 bonus_size 4 20152960 anon_size 4 438411264 anon_evictable_data 4 0 anon_evictable_metadata 4 0 mru_size 4 1186710528 mru_evictable_data 4 908280320 mru_evictable_metadata 4 4658688 mru_ghost_size 4 0 mru_ghost_evictable_data 4 0 mru_ghost_evictable_metadata 4 0 mfu_size 4 170886656 mfu_evictable_data 4 134954496 mfu_evictable_metadata 4 3134976 mfu_ghost_size 4 0 mfu_ghost_evictable_data 4 0 mfu_ghost_evictable_metadata 4 0 l2_hits 4 0 l2_misses 4 0 l2_feeds 4 0 l2_rw_clash 4 0 l2_read_bytes 4 0 l2_write_bytes 4 0 l2_writes_sent 4 0 l2_writes_done 4 0 l2_writes_error 4 0 l2_writes_lock_retry 4 0 l2_evict_lock_retry 4 0 l2_evict_reading 4 0 l2_evict_l1cached 4 0 l2_free_on_write 4 0 l2_abort_lowmem 4 0 l2_cksum_bad 4 0 l2_io_error 4 0 l2_size 4 0 l2_asize 4 0 l2_hdr_size 4 0 memory_throttle_count 4 0 memory_direct_count 4 0 memory_indirect_count 4 0 memory_all_bytes 4 8218046464 memory_free_bytes 4 5230358528 memory_available_bytes 3 5101953024 arc_no_grow 4 0 arc_tempreserve 4 0 arc_loaned_bytes 4 0 arc_prune 4 0 arc_meta_used 4 147039856 arc_meta_limit 4 3081767424 arc_dnode_limit 4 308176742 arc_meta_max 4 152895280 arc_meta_min 4 16777216 async_upgrade_sync 4 59 demand_hit_predictive_prefetch 4 484 demand_hit_prescient_prefetch 4 0 arc_need_free 4 0 arc_sys_free 4 128406976 arc_raw_size 4 0 This behavior was observed on more than one machine, both small and large (the large was on AWS). Thanks, Andrey Gelman On Mon, Jul 13, 2020 at 5:45 PM Colin Ian King <1883...@bugs.launchpad.net> wrote: > It would be interesting in knowing the following data: > > 1. How much memory does the machine have when booted? > > run: free > > 2. What the arcstats look like when it goes slowly > > use: cat /proc/spl/kstat/zfs/arcstats > > thanks > > ** Changed in: zfs-linux (Ubuntu) > Status: Confirmed => Incomplete > > -- > You received this bug notification because you are subscribed to the bug > report. > https://bugs.launchpad.net/bugs/1883676 > > Title: > ZFS performance drops suddenly > > Status in zfs-linux package in Ubuntu: > Incomplete > > Bug description: > Run Phoronix Flexible IO / Random write benchmark. > After running the benchmark repeatedly multiple times (occasionally it > can be 30 minutes or 8 hours), the performance drops suddenly. The only way > (I know of) to get back to high performance is reboot. > --- > $ for i in $(seq 1 1000); do printf "2\n4\n2\n1\n1\n1\nn\n" | > phoronix-test-suite run fio | awk '/Average.*IOPS/ {print $2}' >> > /tmp/iops; done > $ less /tmp/iops > ... > 2095 > 2095 > 2093 > 783 > 388 > 389 > ... > > ProblemType: Bug > DistroRelease: Ubuntu 18.04 > Package: zfsutils-linux 0.7.5-1ubuntu16.9 > ProcVersionSignature: User Name 5.3.0-1023.25~18.04.1-aws 5.3.18 > Uname: Linux 5.3.0-1023-aws x86_64 > NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair > ApportVersion: 2.20.9-0ubuntu7.15 > Architecture: amd64 > Date: Tue Jun 16 08:55:01 2020 > Ec2AMI: ami-06fd83ae47b05282f > Ec2AMIManifest: (unknown) > Ec2AvailabilityZone: us-east-1f > Ec2InstanceType: c4.xlarge > Ec2Kernel: unavailable > Ec2Ramdisk: unavailable > SourcePackage: zfs-linux > UpgradeStatus: No upgrade log present (probably fresh install) > modified.conffile..etc.sudoers.d.zfs: [deleted] > > To manage notifications about this bug go to: > > https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1883676/+subscriptions > -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1883676 Title: ZFS performance drops suddenly To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zfs-linux/+bug/1883676/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs