[ https://issues.apache.org/jira/browse/KAFKA-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15339018#comment-15339018 ]
Ewen Cheslack-Postava commented on KAFKA-3487: ---------------------------------------------- [~rhauch] Absolutely, did not mean to imply it was the be-all end-all, just that for some use cases its extremely convenient. I wouldn't rely on Central being up for any sort of production use case :) > Support per-connector/per-task classloaders in Connect > ------------------------------------------------------ > > Key: KAFKA-3487 > URL: https://issues.apache.org/jira/browse/KAFKA-3487 > Project: Kafka > Issue Type: New Feature > Components: KafkaConnect > Affects Versions: 0.10.0.0 > Reporter: Ewen Cheslack-Postava > Assignee: Liquan Pei > Priority: Critical > Labels: needs-kip > > Currently we just use the default ClassLoader in Connect. However, this > limits how we can compatibly load conflicting connector plugins. Ideally we > would use a separate class loader per connector/task that is instantiated to > avoid potential conflicts. > Note that this also opens up options for other ways to provide jars to > instantiate connectors. For example, Spark uses this to dynamically publish > classes defined in the REPL and load them via URL: > https://ardoris.wordpress.com/2014/03/30/how-spark-does-class-loading/ But > much simpler examples (include URL in the connector class instead of just > class name) are also possible and could be a nice way to more support dynamic > sets of connectors, multiple versions of the same connector, etc. -- This message was sent by Atlassian JIRA (v6.3.4#6332)