Aljoscha Krettek created FLINK-13397:
Summary: Remove RollingSink
Key: FLINK-13397
URL: https://issues.apache.org/jira/browse/FLINK-13397
Project: Flink
Issue Type: Improvement
Chesnay Schepler created FLINK-9584:
---
Summary: Unclosed streams in Bucketing-/RollingSink
Key: FLINK-9584
URL: https://issues.apache.org/jira/browse/FLINK-9584
Project: Flink
Issue Type
Christophe Jolif created FLINK-9071:
---
Summary: Dataflow programming model documentation example is
referencing deprecated RollingSink
Key: FLINK-9071
URL: https://issues.apache.org/jira/browse/FLINK-9071
Kostas Kloudas created FLINK-5096:
-
Summary: Make the RollingSink rescalable.
Key: FLINK-5096
URL: https://issues.apache.org/jira/browse/FLINK-5096
Project: Flink
Issue Type: Improvement
Wenlong Lyu created FLINK-4378:
--
Summary: Enable RollingSink to custom HDFS client configuration
Key: FLINK-4378
URL: https://issues.apache.org/jira/browse/FLINK-4378
Project: Flink
Issue Type
Josh Forman-Gornall created FLINK-4190:
--
Summary: Generalise RollingSink to work with arbitrary buckets
Key: FLINK-4190
URL: https://issues.apache.org/jira/browse/FLINK-4190
Project: Flink
Hi,
I’m not aware of anyone having tested the RollingSink with anything besides
“hdfs://“ and “file://“. That the file is empty is strange. Is something
like revokeLease() necessary for your custom HCFS?
Cheers,
Aljoscha
On Wed, 23 Mar 2016 at 17:53 Vijay Srinivasaraghavan
wrote:
> Hi Aljos
Hi,
(sending from my other handle since the apache mail relay seems to be down for
me)
I’m not aware of anyone having tested the RollingSink with anything besides
“hdfs://“ and “file://“. That the file is empty is strange. Is something like
revokeLease() necessary for your custom HCFS?
Cheers
Hi Aljoscha,
It was my bad that I have copied some wrong class files during one of the step.
I have retried the same steps that I mentioned earlier and with that I am able
to see all the debug statements that I have added to the RollingSink..
I have found another interesting issue here. I am
Cheers,
>> Aljoscha
>>> On 23 Mar 2016, at 15:02, Vijay wrote:
>>>
>>> Hi Aljoscha,
>>>
>>> I am using standalone flink cluster (3 node). I am running flink job by
>>> submitting/uploading jar through Flink UI.
>>>
>>>
ng/uploading jar through Flink UI.
>>
>> I have built flink from maven and modified the RollingSink code to add new
>> debug statements.
>>
>> I have also packaged the streaming file system connector package (including
>> RollingSink changes) to the job jar file
y
> submitting/uploading jar through Flink UI.
>
> I have built flink from maven and modified the RollingSink code to add new
> debug statements.
>
> I have also packaged the streaming file system connector package (including
> RollingSink changes) to the job jar file. Modified
Hi Aljoscha,
I am using standalone flink cluster (3 node). I am running flink job by
submitting/uploading jar through Flink UI.
I have built flink from maven and modified the RollingSink code to add new
debug statements.
I have also packaged the streaming file system connector package
Mar 2016, at 12:41, Vijay wrote:
>>>
>>> I think only the ERROR category gets displayed in the log file
>>>
>>> Regards,
>>> Vijay
>>>
>>> Sent from my iPhone
>>>
>>>> On Mar 23, 2016, at 2:30 AM, Aljoscha Krettek
t 12:41, Vijay wrote:
>>
>> I think only the ERROR category gets displayed in the log file
>>
>> Regards,
>> Vijay
>>
>> Sent from my iPhone
>>
>>> On Mar 23, 2016, at 2:30 AM, Aljoscha Krettek wrote:
>>>
>>> Hi,
>>>
016, at 2:30 AM, Aljoscha Krettek wrote:
>>
>> Hi,
>> are you seeing the regular log output from the RollingSink in the
>> TaskManager logs?
>>
>> Cheers,
>> Aljoscha
>>> On 22 Mar 2016, at 20:03, Vijay Srinivasaraghavan
>>> wrote:
then uploaded the jar to Job Manager.
Am I missing something? How do I enable logging for the RollingSink class?
org.apache.flink
flink-connector-filesystem_2.11
${flink.version}
provided
On Tuesday, March 22, 2016 3:04 AM, Aljoscha Krettek
wrote:
Hi,
how are you printin
Aljoscha Krettek created FLINK-3651:
---
Summary: Fix faulty RollingSink Restore
Key: FLINK-3651
URL: https://issues.apache.org/jira/browse/FLINK-3651
Project: Flink
Issue Type: Bug
I have enabled checkpoint and I am using RollingSink to sink the data to HDFS
> (2.7.x) from KafkaConsumer. To simulate failover/recovery, I stopped
> TaskManager and the job gets rescheduled to other Taskmanager instance.
> During this momemnt, the current "in-progress" gets clos
Hello,
I have enabled checkpoint and I am using RollingSink to sink the data to HDFS
(2.7.x) from KafkaConsumer. To simulate failover/recovery, I stopped
TaskManager and the job gets rescheduled to other Taskmanager instance. During
this momemnt, the current "in-progress" gets
Lasse Dalegaard created FLINK-3637:
--
Summary: Change RollingSink Writer interface to allow wider range
of outputs
Key: FLINK-3637
URL: https://issues.apache.org/jira/browse/FLINK-3637
Project: Flink
Till Rohrmann created FLINK-2979:
Summary: RollingSink does not work with Hadoop 2.7.1
Key: FLINK-2979
URL: https://issues.apache.org/jira/browse/FLINK-2979
Project: Flink
Issue Type: Bug
Mohamed Amine ABDESSEMED created FLINK-2672:
---
Summary: Add partitioned output format to HDFS RollingSink
Key: FLINK-2672
URL: https://issues.apache.org/jira/browse/FLINK-2672
Project: Flink
23 matches
Mail list logo
