Currently, Kafka Connect experiences a spike in CPU usage which causes Kafka Connect to crash. There is really no useful information from the logs to help me understand what is causing this to happen. Is this a known issue? If it matters, my configuration settings are as follows:
format.class":"com.trulia.footprint.eventexportkafkaconnect.SequenceFileFormat", (our custom Sequence File format output) "connector.class":"io.confluent.connect.s3.S3SinkConnector", "tasks.max":"10", "topics":"truliaTopic", "flush.size":"150000", "s3.part.size":"5242880", "s3.bucket.name":"truliaBucket", "storage.class":"io.confluent.connect.s3.storage.S3Storage", "partitioner.class":"com.trulia.footprint.eventexportkafkaconnect.FootprintEventPartitioner", (our custom partitioner) "schema.generator.class": "io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator", "schema.compatibility": "NONE", "topics.dir":"truliaOutput"