We've been testing using vector search in 9.4 recently, and whilst the quality of searches is looking good, we're concerned by what we're seeing in core size/disk use.
The core we're testing is typically around 2.5GB in size. In the test instance with vectors added, it's typically hovering around 13GB, but sometimes spikes up to over 20GB for no apparent reason we can see. I get why having a thousand-odd floats per entry would make for a bigger core, but we'd hoped there would be some cleverness in the storage mechanism to stop it being quite so drastic; and we're very concerned by the way the needed storage space seems to spike up to double the normal usage from time to time. Are there any settings we're missing that might reduce the amount of space vectors take up? And does anyone know why we're seeing such big fluctuations? Thanks Dominic
