[ https://issues.apache.org/jira/browse/KAFKA-2626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14967544#comment-14967544 ]
ASF GitHub Bot commented on KAFKA-2626: --------------------------------------- GitHub user ewencp opened a pull request: https://github.com/apache/kafka/pull/345 KAFKA-2626: Handle null keys and value validation properly in OffsetStorageWriter. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ewencp/kafka kafka-2626-offset-storage-writer-null-values Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/345.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #345 ---- commit b89f1f9bc214169b232e592ce1126d25c4e6e9da Author: Ewen Cheslack-Postava <m...@ewencp.org> Date: 2015-10-21T17:47:14Z KAFKA-2626: Handle null keys and value validation properly in OffsetStorageWriter. ---- > Null offsets in copycat causes exception in OffsetStorageWriter > --------------------------------------------------------------- > > Key: KAFKA-2626 > URL: https://issues.apache.org/jira/browse/KAFKA-2626 > Project: Kafka > Issue Type: Sub-task > Components: copycat > Reporter: Ewen Cheslack-Postava > Assignee: Ewen Cheslack-Postava > Fix For: 0.9.0.0 > > > {quote} > [2015-10-07 16:20:39,052] ERROR CRITICAL: Failed to serialize offset data, > making it impossible to commit offsets under namespace wikipedia-irc-source. > This likely won't recover unless the unserializable partition or offset > information is overwritten. > (org.apache.kafka.copycat.storage.OffsetStorageWriter:152) > [2015-10-07 16:20:39,053] ERROR Cause of serialization failure: > (org.apache.kafka.copycat.storage.OffsetStorageWriter:155) > java.lang.NullPointerException > at > org.apache.kafka.copycat.storage.OffsetUtils.validateFormat(OffsetUtils.java:34) > at > org.apache.kafka.copycat.storage.OffsetStorageWriter.doFlush(OffsetStorageWriter.java:141) > at > org.apache.kafka.copycat.runtime.WorkerSourceTask.commitOffsets(WorkerSourceTask.java:223) > at > org.apache.kafka.copycat.runtime.WorkerSqourceTask.stop(WorkerSourceTask.java:100) > at org.apache.kafka.copycat.runtime.Worker.stopTask(Worker.java:188) > at > org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.removeConnectorTasks(StandaloneHerder.java:210) > at > org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stopConnector(StandaloneHerder.java:155) > at > org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stop(StandaloneHerder.java:60) > at org.apache.kafka.copycat.runtime.Copycat.stop(Copycat.java:66) > at > org.apache.kafka.copycat.runtime.Copycat$ShutdownHook.run(Copycat.java:88) > [2015-10-07 16:20:39,055] ERROR Failed to flush > org.apache.kafka.copycat.runtime.WorkerSourceTask$2@12782f6 offsets to > storage: (org.apache.kafka.copycat.runtime.WorkerSourceTask:227) > java.lang.NullPointerException > at > org.apache.kafka.copycat.storage.OffsetUtils.validateFormat(OffsetUtils.java:34) > at > org.apache.kafka.copycat.storage.OffsetStorageWriter.doFlush(OffsetStorageWriter.java:141) > at > org.apache.kafka.copycat.runtime.WorkerSourceTask.commitOffsets(WorkerSourceTask.java:223) > at > org.apache.kafka.copycat.runtime.WorkerSourceTask.stop(WorkerSourceTask.java:100) > at org.apache.kafka.copycat.runtime.Worker.stopTask(Worker.java:188) > at > org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.removeConnectorTasks(StandaloneHerder.java:210) > at > org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stopConnector(StandaloneHerder.java:155) > at > org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stop(StandaloneHerder.java:60) > at org.apache.kafka.copycat.runtime.Copycat.stop(Copycat.java:66) > at > org.apache.kafka.copycat.runtime.Copycat$ShutdownHook.run(Copycat.java:88) > [2015-10-07 16:20:39,055] INFO Starting graceful shutdown of thread > WorkerSourceTask-wikipedia-irc-source-0 > (org.apache.kafka.copycat.util.ShutdownableThread:119) > [2015-10-07 16:20:39,056] INFO Herder stopped > (org.apache.kafka.copycat.runtime.standalone.StandaloneHerder:64) > [2015-10-07 16:20:39,056] INFO Worker stopping > (org.apache.kafka.copycat.runtime.Worker:104) > [2015-10-07 16:20:39,056] INFO Stopped FileOffsetBackingStore > (org.apache.kafka.copycat.storage.FileOffsetBackingStore:61) > [2015-10-07 16:20:39,056] INFO Worker stopped > (org.apache.kafka.copycat.runtime.Worker:133) > [2015-10-07 16:20:39,057] INFO Copycat stopped > (org.apache.kafka.copycat.runtime.Copycat:69) > {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332)