Suraj Fale created KAFKA-7835:
---------------------------------
Summary: Kafka Connect - Unable to create multiple connectors in a
single HTTP (REST) call
Key: KAFKA-7835
URL: https://issues.apache.org/jira/browse/KAFKA-7835
Project: Kafka
Issue Type: Improvement
Components: KafkaConnect
Affects Versions: 1.1.1
Reporter: Suraj Fale
We have 6 connectors under distributed Kafka worker. Each of this connectors
has 18-36 tasks. Each time we add new connector all existing connector
restarts/re-balance.
*Issue:*
* For each new connector we add, previous/existing connector(s) restarts along
with new connector.
* All existing connectors and their tasks goes into re-balance mode.
Assuming that we want to add 3 new connectors in one flow, right now we have to
make 3 Http call. And thus it existing all connectors restarts 3 times.
Is there any way to create all these 3 connectors for same distributed worker
in one HTTP call?
*If not can we add this as a improvement?*
Something like
{code:java}
## http://localhost:8083/connectors
[
{
"name": "connector-1",
"config": {
"connector.class": "Connector1Class",
"tasks.max": "36",
"run.next.start": "5",
"fetchsize": "100000",
"topic": "message.connector-1",
"offset.start": "0"
}
},
{
"name": "connector-2",
"config": {
"connector.class": "Connector2Class",
"tasks.max": "18",
"run.next.start": "5",
"fetchsize": "100000",
"topic": "message.connector-2",
"offset.start": "0"
}
},
{
"name": "connector-3",
"config": {
"connector.class": "Connector3Class",
"tasks.max": "18",
"run.next.start": "5",
"fetchsize": "100000",
"topic": "message.connector-3",
"offset.start": "0"
}
}
]
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
