Re: About Kafka08Fetcher and Kafka010Fetcher

2018-01-04 Thread Tzu-Li (Gordon) Tai
Hi Jaxon, The threading model is implemented differently between the Kafka08Fetcher and all other fetcher versions higher than 0.9+ because the Kafka Java clients used between these versions have different abstraction levels. The Kafka08Fetcher still uses the low-level `SimpleConsumer` API, whi

Re: About Kafka08Fetcher and Kafka010Fetcher

2018-01-02 Thread Timo Walther
Maybe Gordon (in CC) can answer your question. Am 1/1/18 um 3:36 PM schrieb Jaxon Hu: In Kafka08Fetcher, it use  Map to manage multi-threads. But I notice in Kafka09Fetcher or Kafka010Fetcher, it's gone. So how Kafka09Fetcher implements multi-threads read partitions from kafka?