Error specifying Kafka params from Java

[Paul Mogren]

Hi all,

I get the following exception when trying to build a Kafka input DStream with 
custom properties from Java. I am wondering if it's a problem with the Java to 
Scala binding - I am at a loss for what I could be doing wrong.

14/04/10 16:46:28 ERROR NetworkInputTracker: De-registered receiver for network 
stream 0 with message java.lang.NoSuchMethodException: 
java.lang.Object.<init>(kafka.utils.VerifiableProperties)

Where java.lang.Object is referenced in the error, I expect it should be using 
kafka.serializer.StringDecoder.

Here is my invocation:

  Map<String, String> kafkaParams = new HashMap<>();
        kafkaParams.put("zookeeper.connect", kafkaZooKeepers);
        kafkaParams.put("zookeeper.connection.timeout.ms", "10000");
        kafkaParams.put("group.id", kafkaConsumerGroup);
        kafkaParams.put("auto.offset.reset", "smallest");

        // The Spark processing stages
        JavaPairDStream<String, String> messages = KafkaUtils.createStream(jssc,
                String.class, String.class, StringDecoder.class, 
StringDecoder.class,
                kafkaParams, kafkaTopicMap, 
StorageLevel.MEMORY_AND_DISK_SER_2());


Thanks for any insight,
Paul.


P.S. I would like to see a method in KafkaUtils that accepts kafkaParams 
without requiring to specify the four data/decoder types.