adoop ships with such an older, buggy version of Avro, and it is a
> major pain to work around it.
> 3. Avro's “one definition file = one schema = one record type” assumption
> causes us some trouble.
>
>
> On 11/20/15, 2:47 AM, "Selina Tech" wrote:
>
> >H
es
> the Avro objects in JSON:
>
> https://gist.github.com/ldcasillas-progreso/3611d40d2833aa62c1b3
>
> Hope this helps.
>
>
>
>
>
> On 11/17/15, 12:32 AM, "Selina Tech" wrote:
>
> >Dear All:
> > Do you know where I can find the tutorial or sample c
> Hi Selina,
>
> If you want to use Confluent's schema registry for Avro, then I have an
> example in this repo:
>
> https://github.com/theduderog/hello-samza-confluent
>
> Cheers,
>
> Roger
>
> On Tue, Nov 17, 2015 at 12:32 AM, Selina Tech
> wrote:
>
o maintain the compatibility between producer and
> consumers using ProtoBuf, I don't see why you cannot use ProtoBuf in Samza.
>
> Best,
>
> -Yi
>
> On Wed, Nov 18, 2015 at 3:43 PM, Selina Tech
> wrote:
>
> > Dear All:
> >
> > I need to generate s
Upon consumption, you can first get the schemaId, query
Avro for the schema given the id, and then use schema to deserialize the
message"
--http://grokbase.com/t/kafka/users/138mdm6tp3/avro-serialization
Thanks again!
Sincerely,
Selina
On Wed, Nov 18, 2015 at 5:43 PM, Selina Tech wrote:
u have other ways to maintain the compatibility between producer and
> consumers using ProtoBuf, I don't see why you cannot use ProtoBuf in Samza.
>
> Best,
>
> -Yi
>
> On Wed, Nov 18, 2015 at 3:43 PM, Selina Tech
> wrote:
>
> > Dear All:
> >
> >
Dear All:
I need to generate some data by Samza to Kafka and then write to
Parquet formate file. I was asked why I choose Avro type as my Samza
output to Kafka instead of Protocol Buffer. Since currently our data on
Kafka are all Protocol buffer.
I explained for Avro encoded message -
Dear All:
Do you know where I can find the tutorial or sample code for writing
Avro type message to Kafka and reading Avro type message from Kafka in
Samza?
I am wondering how should I serialized GenericRecord to byte and
deserialized it?
Your comments/suggestion are highly apprecia
)
>
>
> Cheers,
> Yan
>
>
> At 2015-10-25 06:12:50, "Selina Tech" wrote:
> >Hi, Yan:
> >
> > Thanks a lot for your reply.
> >
> > You mentioned "if you give the msgs the same partition key", which
> >mean same partit
Hi, Rohit:
You might like to check deploy/kafka/logs/kafka.log file.
Sincerely
Selina
On Thu, Oct 29, 2015 at 9:24 AM, Rohit Upadhyaya wrote:
> Hi,
>
> I am following the "Hello Samza" tutorial here:
> http://samza.apache.org/startup/hello-samza/0.9/ .Following all the steps
> I
> get an e
he result to "output" topic. You can send to any partition of the
> "output" if you give the msgs the same partition key.
>
>
> Thanks,
> Yan
>
>
>
>
>
>
>
> At 2015-10-22 08:30:15, "Selina Tech" wrote:
> >Hi, All:
> >
>
Hi, All:
In the Samza document, it mentioned "Each task consumes data from
one partition for each of the job’s input streams." Does it mean if the
data processing one job is not in one partition, the result will be wrong.
Assuming my Samza input data on Kafka topic -- "input" is
p
Hi, All:
I have same question also. Previously, I thought we just use java code to
implement, Counts, averages ... in Samza.
Is anyone kenw any Java libraries?
Sincerely,
Selina
On Wed, Oct 21, 2015 at 8:15 AM, jeremy p
wrote:
> Hey all,
>
> So, I'm wanting to do aggregate operations in Samza.
Dear all:
When I studied the Hello Samza project, I found if I
changed or for this project at Pom.xml. After I
deploy the code, A JNI error has occurred.
For example, I change the my.study.samza, after I "mvn
clean package" and deploy it to samza,
And then I run Samza job as below, Erro
code. Could you point out which line is it?
>
> It would be helpful if you can add some log info regarding to the message
> you receive in the process() vs the message you read from Kafka console
> consumer.
>
> Thanks!
>
> -Yi
>
> On Wed, Oct 14, 2015 at 10:0
Dear All:
I tried to consumer kafka topic "cnr-proto" in Java. It got the
SamzaContainer NullPointerException as below.
The messages can be shown by command line correctly
"deploy/kafka/bin/kafka-console-consumer.sh --zookeeper localhost:2181
--from-beginning --topic cnr-proto"
My Key
hat you are running the Samza job locally. Could you check
> whether your classpath include the local deployed dir: deploy/samza/lib?
>
> -Yi
>
> On Fri, Sep 25, 2015 at 5:54 PM, Selina Tech
> wrote:
>
> > Hi, All:
> >
> >I am trying to run a samza job, I
Hi, All:
I am trying to run a samza job, I got Error as "Error: A JNI error has
occurred, please check your installation and try again". I google on line
it looks like about CLASSPATH and .class/.jar. Is anyone can help me on
this.
$ deploy/samza/bin/run-job.sh
--config-factory=org.apache.sa
Dear all:
I received a few warning email as below. Does anyone know how should I
avoid those waring email?
Sincerely,
Selina
- -- - - - - - -
Hi! This is the ezmlm program. I'm managing the
dev@samza.apache.org mailing list.
I'm working for my owner, who can be reached
at dev-ow...@samza.a
Hi, Yi:
If I use Samza0.9.1 and Yarn2.6.0, Will the system be failed?
Sincerely,
Selina
On Wed, Aug 19, 2015 at 1:58 PM, Yi Pan wrote:
> Hi, Roger,
>
> In LinkedIn we have already moved to YARN 2.6 and is moving to YARN 2.7
> now. I am not aware of any major issues in upgrading. I will let
20 matches
Mail list logo
