Re: AWS EFS

2016-07-11 Thread Pete Wright
that it was trivial to saturate the network interface the EFS volume is mounted on. I am personally evaluating EFS for usecases where I need to share data for content delivery or as a scratch space for PostgreSQL WAL logs for for example. Cheers, -pete -- Pete Wright Lead System

Re: [DISCUSS] Java 8 as a minimum requirement

2016-07-11 Thread Pete Wright
removed Java 7 support. > > > I agree with this as well - I've actually seen performance degredation in some use-cases with Java8 vs Java7 on both CentOS and FreeBSD. IMHO - removing support for JRE7 as part of a minor release would be very disruptive and I would personally prefer to

Re: [DISCUSS] Java 8 as a minimum requirement

2016-07-11 Thread Pete Wright
Until these issues have been addressed, this would cause some serious issues > for us. > I can second this on the FreeBSD front. -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Introducing Dory

2016-06-13 Thread Pete Wright
cluster. I could see this being something worth persuing if you are handling data that is critical for financial reasons (as opposed to data used for non-financial reporting or metrics). -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Using lz4 compression

2016-03-21 Thread Pete Wright
super familiar with the lz4 code as implemented in kafka, but i would assume the java implementation is pretty solid. hope this helps, -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: LVM overhead

2016-02-11 Thread Pete Wright
the stripe in software as opposed to hardware. Hope this helps! -pete On 02/11/16 07:24, yazgoo wrote: > Hi everyone, > > I have multiple disks on my broker. > Do you know if there's a noticeable overhead using LVM versus multiple > log.dirs ? > > Thanks >

Re: Kafka and Btrfs

2015-10-28 Thread Pete Wright
is ZFS support for Linux here: http://zfsonlinux.org/ http://open-zfs.org/wiki/Main_Page Hope this helps - and doesn't start a huge bikeshed discussion :) Cheers, -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

noticing blocking of kafka-network-thread

2015-06-18 Thread Pete Wright
this, and if not - is there an easy way to determine which object these threads are seeing contention on? Thanks in advance! -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Design questions related to kafka

2015-04-15 Thread Pete Wright
after that offset to ensure your consumer does not consume the same message twice? Cheers, -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Updates To cwiki For Producer

2015-03-23 Thread Pete Wright
> > Gwen > > On Fri, Mar 20, 2015 at 11:24 AM, Pete Wright > wrote: > >> Thanks that's helpful. I am working on an example producer using the >> new API, if I have any helpful notes or examples I'll share that. >> >> I was basically trying

Re: Updates To cwiki For Producer

2015-03-20 Thread Pete Wright
t; > Guozhang > > On Thu, Mar 19, 2015 at 4:37 PM, Pete Wright > wrote: > >> Hi, >> Is there a plan to update the producer documentation on the wiki located >> here: >> >> https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example >&g

Updates To cwiki For Producer

2015-03-19 Thread Pete Wright
this or other docs available for reference that would be helpful as well. Thanks! -pete -- Pete Wright Lead Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Database Replication Question

2015-03-10 Thread Pete Wright
MV there. The one suggestion for AIX would be to use IBM's JDK/JRE as I am sure it has been optimized for Power processors. Obviously this precludes doing extensive load and failover testing before even considering running it in production - but I did not run into any issues using FreeB

Re: Sizing Cluster

2014-10-22 Thread Pete Wright
cumentation refer to: > https://kafka.apache.org/08/configuration.html Thanks Istvan - this is helpful. Cheers, -pete -- Pete Wright Systems Architect Rubicon Project pwri...@rubiconproject.com 310.309.9298

Re: Sizing Cluster

2014-10-21 Thread Pete Wright
> > I. > > On Tue, Oct 21, 2014 at 11:12 AM, Pete Wright > wrote: > >> Hi There, >> I have a question regarding sizing disk for kafka brokers. Let's >> say I >> have systems capable of providing 10TB of storage, and they act as Kafka &

Sizing Cluster

2014-10-21 Thread Pete Wright
or my producers to write to? Is there any overhead I should be concerned with? I guess I am just wanting to make sure that there are not any major pitfalls in deploying a two-node cluster, versus say a 3-node cluster. Any advice or best-practices would be very helpful! Thanks in advance, -pete --