Re: [PERFORM] Testing in AWS, EBS

2016-05-26 Thread Rayson Ho
Thanks Yves for the clarification! It used to be very important to pre-warm EBS before running benchmarks in order to get consistent results. Then at re:Invent 2015, the AWS engineers said that it is not needed anymore, which IMO is a lot less work for us to do benchmarking in AWS, because pre-wa

Re: [PERFORM] Testing in AWS, EBS

2016-05-26 Thread Rayson Ho
r, storage blocks on volumes that were restored from snapshots must be > initialized (pulled down from Amazon S3 and written to the volume) before > you can access the block" > > Quotation from: > http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-initialize.html > > 2

Re: [PERFORM] Testing in AWS, EBS

2016-05-26 Thread Rayson Ho
On Thu, May 26, 2016 at 10:00 AM, Artem Tomyuk wrote: > > 2016-05-26 16:50 GMT+03:00 Rayson Ho : > >> Amazon engineers said that EBS pre-warming is not needed anymore. > > > but still if you will skip this step you wont get much performance on ebs > created from sna

Re: [PERFORM] Testing in AWS, EBS

2016-05-26 Thread Rayson Ho
Rayson == Open Grid Scheduler - The Official Open Source Grid Engine http://gridscheduler.sourceforge.net/ http://gridscheduler.sourceforge.net/GridEngine/GridEngineCloud.html > 2016-05-26 15:53 GMT+03:00 Yves Dorfsman : >> >> On 2016-0

Re: [PERFORM] Testing in AWS, EBS

2016-05-25 Thread Rayson Ho
imum network > throughput. Those difference are very significant, do tests on the same > volume > between two different type of instances, both with enough cpu and memory > for > the I/O to be the bottleneck, you will be surprised! > > > On 2016-05-25 17:02, Rayson Ho wrote: &g

Re: [PERFORM] Testing in AWS, EBS

2016-05-25 Thread Rayson Ho
There are many factors that can affect EBS performance. For example, the type of EBS volume, the instance type, whether EBS-optimized is turned on or not, etc. Without the details, then there is no apples to apples comparsion... Rayson == Open Grid

[PERFORM] cache false-sharing in lwlocks

2010-01-11 Thread Rayson Ho
Hi, LWLockPadded is either 16 or 32 bytes, so modern systems (e.g. Core2 or AMD Opteron [1]) with cacheline size of 64 bytes can get false-sharing in lwlocks. I changed LWLOCK_PADDED_SIZE in src/backend/storage/lmgr/lwlock.c to 64, and ran sysbench OLTP read-only benchmark, and got a slight impro