about not losing data, they can configure a second connector to do
bulk loads on a more periodic basis. Thoughts?
On Wed, Feb 24, 2016 at 12:41 AM, Chris Riccomini
wrote:
> Hey all,
>
> Some more details on my question. My concern about using even IDs on
> immutable tables as a way to re
|
| 25607888 | 3 |0 | 0 | XXX | NULL | NULL |
0 | 0 | 0 | 0 | NULL |
NULL |
+--+---+--++--+---+--+-+-+-++--+-----+
On Tue, Feb
Hey all,
I was reviewing the Kafka connect JDBC driver, and I had a question. Is it
possible to use the JDBC driver with a look-back configured? The reason
that I ask is that there are some known issues with using a modified
timestamp:
Slide 14 here explains one with Oracle:
https://qconsf.com/s
entioned together until now :)
>
>Otis
>--
>Monitoring * Alerting * Anomaly Detection * Centralized Log Management
>Solr & Elasticsearch Support * http://sematext.com/
>
>
>On Fri, Jan 16, 2015 at 3:34 PM, Chris Riccomini <
>criccom...@linkedin.com.
Hey Otis,
I'm not terribly familiar with KOYA, but my understanding is that it's a
tool for deploying Kafka brokers to YARN, and administering them. I don't
think that it has any stream processing functionality built into it. As
such, it seems to me that KOYA and Samza could be used together: you
Hey Guys,
The current transactionality proposal
(https://cwiki.apache.org/confluence/display/KAFKA/Transactional+Messaging+in+Kafka)
and implementation use control messages to handle transactions in Kafka. Kafka
traditionally hasn't had control messages in its topics. Transactionality (as
it's
4 10:19 AM, "Chris Riccomini" wrote:
>Hey Guys,
>
>Sorry for the late follow up. Here are my questions/thoughts on the API:
>
>1. Why is the config String->Object instead of String->String?
>
>2. Are these Java docs correct?
>
> KafkaConsumer(java.util.Map
Hey Guys,
Sorry for the late follow up. Here are my questions/thoughts on the API:
1. Why is the config String->Object instead of String->String?
2. Are these Java docs correct?
KafkaConsumer(java.util.Map configs)
A consumer is instantiated by providing a set of key-value pairs as
configur
Hey Guys,
My 2c.
1. RecordSend is a confusing name to me. Shouldn't it be
RecordSendResponse?
2. Random nit: it's annoying to have the Javadoc info for the contstants
on
http://empathybox.com/kafka-javadoc/kafka/clients/producer/ProducerConfig.h
tml, but the string constant values on
http://empa
Hey Jay,
Reading over the wiki (and email thread). Here are some questions/comments:
"Make the producer fully async to to allow issuing sends to all brokers
simultaneously and having multiple in-flight requests simultaneously. This
will dramatically reduce the impact of latency on throughput (whi
gt;>~~
>> >>
>> >>/* scala versions and options */
>> >>scalaVersion := "2.9.2"
>> >>
>> >>
>> >>libraryDependencies +=
>> >>"org.apache.kafka" % "kafka_2.
. Would be nice to publish kafka-test jars as well.
5. Would be nice to have SNAPSHOT releases off of trunk using a Hudson job.
Shall I open Jiras for this stuff?
Cheers,
Chris
On 7/15/13 10:55 AM, "Chris Riccomini" wrote:
>Hey Guys,
>
>The problem persists, even when using the
n.org/maven2";,
> "sonatype releases" at "
>https://oss.sonatype.org/content/repositories/releases/";,
> "sonatype snapshots" at "
>https://oss.sonatype.org/content/repositories/snapshots/";,
> "nexus releases" at "
>
ke SBT does maybe you have to explicitly set this (shot in the dark,
>don't know Gradle).
>
>Maven Central Repository for resolver = http://repo1.maven.org/maven2/
>
>
>On Mon, Jul 15, 2013 at 1:39 PM, Chris Riccomini
>wrote:
>
>> Hey
o use what should be excluded is in
>https://issues.apache.org/jira/browse/KAFKA-974
>
>
>On Mon, Jul 15, 2013 at 1:30 PM, Chris Riccomini
>wrote:
>
>> Hey Joe,
>>
>> First off, thanks for doing this!
>>
>> I'm trying to use the publication with Gradl
Hey Joe,
First off, thanks for doing this!
I'm trying to use the publication with Gradle, and I'm running into
problems. It's giving me a funky exception. I did some digging, and
apparently the exception implies that Gradle has been given a 1.0 pom.
I took a look at the Kafka pom:
https://
Hey guys,
I have no idea if this would be reasonable, but what about just running
two Kafka processes on the bigger box?
Cheers,
Chris
On 5/17/13 2:48 PM, "Jason Rosenberg" wrote:
>Just resource allocation issues. E.g. imagine having an existing kafka
>cluster with one machine spec, and getti
Hey Guys,
One other potentially large benefit is to decouple broker dependencies
from consumer/producer dependencies. This makes upgrading the
consumer/producer and managing jar conflicts a lot less of a hassle.
Putting the consumer and producer in their own packages might hopefully
alleviate some
Hey Guys,
Correct me if I'm wrong, but I believe in 0.8, the producer uses a
metadata request to get topic/partition mappings from the broker. The
broker then interacts with ZK (rather than having the producer do it using
zk.connect).
In the event that the master for a topic/partition fails, a ne
19 matches
Mail list logo
