Re: Supported Kafka version by Samza

2019-06-05 Thread QiShu
. > Here is the Kafka client support matrix for our releases > > Dependency Supported versions Not supported version Samza version > > Kafka > 0.11.* > 1.*, 2.* > 1.0 > 1.1 > 2.0.* 1.* and below 1.2(Upcoming release) > Hope it helps. > > Thanks, > Bharath

Supported Kafka version by Samza

2019-06-04 Thread QiShu
Hi, Running environment: Samza version: 2.12-1.1.0 Kafka cluster version: 2.12-1.1.0 Hadoop version: 3.1.0 When using Kafka_2.12-1.1.0.jar, Samza job failed to run when retrieving coordinator stream meta info from Kafka: 2019-06-03 17:26:11.176 [main] KafkaSystemAdmin [INFO] Fetc

Re: Can't start app in Yarn

2019-06-03 Thread QiShu
t; right before the exception? > > I am guessing here since I don't have access to the source code of > *InfluxDBSystemFactory*. If you can share the source code of > InfluxDBSystemFactory, it will help me confirm my theory. > > Let me know how it goes. > > Th

Re: Can't start app in Yarn

2019-05-29 Thread QiShu
> 在 2019年5月30日,上午3:41,Bharath Kumara Subramanian 写道: > > Hi Qi, > > Can you share your application configuration? Especially the systems your > application consumes and produces to and its related configuration. > Also, would it be possible for to attach the entire log? > &

Can't start app in Yarn

2019-05-28 Thread QiShu
Hi, Below is the running environment: Hadoop version 3.1.0 java version “1.8.0_151" samza-api-1.1.0.jar samza-core_2.12-1.1.0.jar samza-kafka_2.12-1.1.0.jar samza-kv_2.12-1.1.0.jar samza-kv-inmemory_2.12-1.1.0.jar samza-kv-rocksdb_2.12-1.1.0.jar samza-log4j_2.12-1.1.0.jar samza-shell-1.1.0

Re: Question about too much log on resource manager and node manager

2018-12-28 Thread QiShu
the 0.14.1 release, since it includes multiple > critical fixes <https://issues.apache.org/jira/browse/SAMZA-1484> to run > stateful jobs on YARN. > > Best, > Jagadish > > On Wed, Dec 26, 2018 at 6:00 PM QiShu wrote: > >> Hi Guys, >> >>Now I u

Question about too much log on resource manager and node manager

2018-12-26 Thread QiShu
Hi Guys, Now I use Samza 0.12.0 with HDP-3.0.0.0(Hadoop3.1.0). And everything is fine, except the ResourceManager and NodeManager log some infomations repeatedly and very quickly, like belows: ===ResourceManager log=== 2018-12-27 09:51:05,433 INFO capacity.CapacityScheduler (C

Re: Question about auto created Kafka topics

2017-12-14 Thread QiShu
-Jake On Thu, Dec 14, 2017 at 4:35 AM, QiShu wrote: > Hi, > > > >Coordinator and checkpoint topic will be created automatically by > Samza when a task started, but these 2 topics only have one replica, how > can

Question about auto created Kafka topics

2017-12-14 Thread QiShu
Hi,    Coordinator and checkpoint topic will be created automatically by Samza when a task started, but these 2 topics only have one replica, how can I set the num of replicas?    Thanks. QiShu