Re: KafkaInputDStream mapping of partitions to tasks

2014-05-04 Thread Aries
Hi, Has anyone work on this? Best Aries 在 2014年3月30日,3:22,Nicolas Bär 写道: > Hi > > Is there any workaround to this problem? > > I'm trying to implement a KafkaReceiver using the SimpleConsumer API [1] of > Kafka and handle the partition assignment manually. Th

Class not found in Kafka-Stream due to multi-thread without correct ClassLoader?

2014-03-07 Thread Aries Kong
Hi, I'm trying to run a kafka-stream and get a strange exception. The streaming is created by following code: val lines = KafkaUtils.createStream[String, VtrRecord, StringDecoder, VtrRecordDeserializer](ssc, kafkaParams.toMap, topicpMap, StorageLevel.MEMORY_AND_DISK_SER_2) 'VtrRecord' i

Class not found in Kafka-Stream due to multi-thread without correct ClassLoader?

2014-03-07 Thread Aries Kong
Hi, I'm trying to run a kafka-stream and get a strange exception. The streaming is created by following code: val lines = KafkaUtils.createStream[String, VtrRecord, StringDecoder, VtrRecordDeserializer](ssc, kafkaParams.toMap, topicpMap, StorageLevel.MEMORY_AND_DISK_SER_2) 'VtrRecord' i

Class not found in Kafka-Stream due to multi-thread without correct ClassLoader?

2014-03-07 Thread Aries Kong
Hi, I'm trying to run a kafka-stream and get a strange exception. The streaming is created by following code: val lines = KafkaUtils.createStream[String, VtrRecord, StringDecoder, VtrRecordDeserializer](ssc, kafkaParams.toMap, topicpMap, StorageLevel.MEMORY_AND_DISK_SER_2)