pecified user? (Although
>>> this might be covered by the answer to the first.)
>>>
>>> Thanks,
>>> Charles
>>>
>>> __
>>> Disclaimer:This email and any attachments are sent in strictest
>>> confidence for the sole use of the addressee and may contain legally
>>> privileged, confidential, and proprietary data. If you are not the intended
>>> recipient, please advise the sender by replying promptly to this email and
>>> then delete and destroy this email and any attachments without any further
>>> use, copying or forwarding
>>>
>>
>>
>
--
Matt Sicker
My logging script is implemented in php, and this php script writes to
>> syslog which then forwards the events to a pre-configured flume node.
>>
>> Could anyone tell me which is better between avro and syslog sources, in
>> terms of performance,implementation and underst
Parquet
>> using flume. I am not sure how to do it. Can anyone help me out in this.
>>
>>
>>
>> Regards ,
>>
>> Ashok
>>
>
>
--
Matt Sicker
ess(HDFSEventSink.java:433)
>>>>> at org.apache.flume.sink.DefaultS
>>>>> inkProcessor.process(DefaultSinkProcessor.java:67)
>>>>> at org.apache.flume.SinkRunner$Po
>>>>> llingRunner.run(SinkRunner.java:145)
>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>> 28 Sep 2017 11:52:14,716 ERROR
>>>>> [SinkRunner-PollingRunner-DefaultSinkProcessor]
>>>>> (org.apache.flume.SinkRunner$PollingRunner.run:158) - Unable to
>>>>> deliver event. Exception follows.
>>>>> org.apache.flume.EventDeliveryException:
>>>>> org.apache.kafka.clients.consumer.CommitFailedException: Commit
>>>>> cannot be completed due to group rebalance
>>>>> at org.apache.flume.sink.hdfs.HDF
>>>>> SEventSink.process(HDFSEventSink.java:451)
>>>>> at org.apache.flume.sink.DefaultS
>>>>> inkProcessor.process(DefaultSinkProcessor.java:67)
>>>>> at org.apache.flume.SinkRunner$Po
>>>>> llingRunner.run(SinkRunner.java:145)
>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>> Caused by: org.apache.kafka.clients.consumer.CommitFailedException:
>>>>> Commit cannot be completed due to group rebalance
>>>>
>>>>
>>>> Is the problem related with the JIRA ticket:
>>>> https://issues.apache.org/jira/browse/KAFKA-3409 and we need to
>>>> upgrade the Kafka library to 0.10.0.0?
>>>>
>>>> Appreciated for any advice.
>>>> Kind Regards, Wenxing
>>>>
>>>
>>>
>>
>
--
Matt Sicker
ons to Flume HTTP Source running on 3 boxes.
>
> With so “high” QPS, the HTTP Source instances will report
> "java.io.IOException: Too many open files" error.
>
> Except to scale out the boxes, does anyone have any advice to improve the
> situation?
>
> Thank
ta is
> partition on the basis of date)
>
> Can't Flume append to existing file to avoid creation of new file?
> Also, how can I solve this problem which leads to creation of too many
> small files?
>
> Any help would be appreciated.
>
> --
>
> *Regards,Nitin Kumar*
>
--
Matt Sicker
