his really?
--
Best regards / Met vriendelijke groeten,
Niels Basjes
he privilege to assign tickets to myself if I choose to
pick them up.
Jira userid: nielsbasjes
--
Best regards / Met vriendelijke groeten,
Niels Basjes
gt;> >
> >> > The script [1] only adds the FLINK_CLASSPATH env var which seems
> >> generally
> >> > reasonable to me. But since principled classpath and entrypoint
> >> > configuration is somewhat related to the follow-up improvement
> >> proposals, I
> >> > could also see this being done after FLIP-111.
> >> >
> >> >
> >> > > (2) Extend the example log4j-console configuration
> >> > >> => support log retrieval from the Flink UI out of the box
> >> > >
> >> > > If you mean to update the "flink-dist/conf/log4j-console.properties"
> >> to
> >> > > support console and
> >> > > local log files. I will say "+1". But we need to find a proper way
> to
> >> > make
> >> > > stdout/stderr output
> >> > > both available for console and log files. Maybe till's proposal
> could
> >> > help
> >> > > to solve this.
> >> > > "`program &2>1 | tee flink-user-taskexecutor.out`"
> >> > >
> >> >
> >> > I think we can simply add a rolling file appender with a limit on the
> >> log
> >> > size.
> >> >
> >> > I think this won't solve Yang's concern. What he wants to achieve is
> >> that
> >> STDOUT and STDERR go to STDOUT and STDERR as well as into some *.out and
> >> *.err file which are accessible from the web ui. I don't think that log
> >> appender will help with this problem.
> >>
> >> Cheers,
> >> Till
> >>
> >>
> >> > – Ufuk
> >> >
> >> > [1]
> >> >
> >> >
> >>
> https://github.com/apache/flink/blob/master/flink-dist/src/main/flink-bin/kubernetes-bin/kubernetes-entry.sh
> >> >
> >>
> >
>
--
Best regards / Met vriendelijke groeten,
Niels Basjes
desired change?
My opinion is that it is the better solution, the data available is more
reliable and as a consequence the rest of the code is simpler.
It would probably mean that during development of flink you should be aware
of this and do an 'extra step' to get it running.
What do you guys think?
--
Best regards / Met vriendelijke groeten,
Niels Basjes
, and to add the
> exercises to flink-playgrounds -- but these points can be discussed
> separately once we've established that the community wants this content.
>
> Looking forward to hearing what you think!
>
> Best regards,
> David
>
--
Best regards / Met vriendelijke groeten,
Niels Basjes
imply no other way to do this.
So i think the version properties file is enough for now. +1 for the first
> option.
>
Like I said. I'm fine with either choice by the committers.
I would choose the `mvn generate-sources` code variant as it is much
simpler and much more reliable.
t is indeed
> > >> slightly harder: If you do not run the pom.xml based code
> > generation it
> > >> will not work.
> > >> I understand that this requires the developers to think a bit more
> > about
> > >> the code they are
main question to you guys: Do you think it is worth it?
Niels Basjes
On Mon, Feb 19, 2018 at 10:50 AM Fabian Hueske wrote:
> Hi Niels,
>
> Jörn is right, although offering different methods, Flink's InputFormat is
> very similar to Hadoop's InputFormat interface.
> The
rategy in Hadoop orc and parquet are quite complex, I
> don't have a lot of in-depth research, but I think these implementations
> should be meaningful.
>
> [1]
>
> https://github.com/apache/flink/blob/master/flink-core/src/main/java/org/apache/flink/api/common/io/FileInputFormat.ja
.
Please review.
https://issues.apache.org/jira/browse/FLINK-9610
https://github.com/apache/flink/pull/6181
--
Best regards / Met vriendelijke groeten,
Niels Basjes
> >
> > I put up a Jira ticket and pull request yesterday and it passes all
> > automated tests.
> > Please review.
> >
> > https://issues.apache.org/jira/browse/FLINK-9610
> > https://github.com/apache/flink/pull/6181
> >
> >
> > --
> >
w we should
implement the "on"/"off" switch for these tests.
Thanks.
--
Best regards / Met vriendelijke groeten,
Niels Basjes
hanged:
- With a NON-Keyed SerializationSchema
- With a provided partitioner
What do you guys think?
--
Best regards / Met vriendelijke groeten,
Niels Basjes
to get this committed.
Thank you.
Niels Basjes
On Mon, Sep 10, 2018 at 10:12 AM Richard Deurwaarder wrote:
>
> Hello everyone,
>
> A while back I opened this Jira issue:
> https://issues.apache.org/jira/browse/FLINK-9311. It is regarding a new
> Flink connector for Google PubS
I would drop it.
Niels Basjes
On Sat, 29 Sep 2018, 10:38 Kostas Kloudas,
wrote:
> +1 to drop it as nobody seems to be willing to maintain it and it also
> stands in the way for future developments in Flink.
>
> Cheers,
> Kostas
>
> > On Sep 29, 2018, at 8:19 AM, Tzu-Li
ncentive enough for them (you)
> to
> > maintain the connector.
> >
> > I'm afraid we don't have much PubSub knowledge in the Flink community but
> > I will try and talk to some folks to have this reviewed.
> >
> > Best,
> > Aljoscha
> >
pecially so since
> you started a discussion beforehand as to whether the Flink community
> would be interested in having such a connector.
>
> I will nag some people to review it once the release is done or have a
> crack at it myself.
>
> On 02.11.2018 08:23, Niels Basjes w
Hi,
The Beam project has something in this area that is simply a page
within their documentation website:
https://beam.apache.org/documentation/sdks/java-thirdparty/
Niels Basjes
On Fri, Mar 8, 2019 at 11:39 PM Bowen Li wrote:
>
> Confluent hub for Kafka is another good example of this k
hort lived (about 50 jobs on our cluster).
--
Best regards / Met vriendelijke groeten,
Niels Basjes
> > >>> On behalf of the PMC, I’m very happy to announce Congxian
> > Qiu
> > > > as
> > > > > a
> > > > > > > new
> > > > > > > > >>> Flink committer.
> > > > > > > > >>>
> > > > > > > > >>> Congxian has been an active contributor for more than two
> > > > years,
> > > > > > with
> > > > > > > > 226
> > > > > > > > >>> contributions including 76 commits and many PR reviews.
> > > > > > > > >>>
> > > > > > > > >>> Congxian mainly works on state backend and checkpoint
> > > modules,
> > > > > > > > meantime is
> > > > > > > > >>> one of the main maintainers of our Chinese document
> > > > translation.
> > > > > > > > >>>
> > > > > > > > >>> Besides his work on the code, he has been driving
> > initiatives
> > > > on
> > > > > > dev@
> > > > > > > > >>> list,
> > > > > > > > >>> supporting users and giving talks at conferences.
> > > > > > > > >>>
> > > > > > > > >>> Please join me in congratulating Congxian for becoming a
> > > Flink
> > > > > > > > committer!
> > > > > > > > >>>
> > > > > > > > >>> Cheers,
> > > > > > > > >>> Yu
> > > > > > > > >>>
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Best,
> > > > > Benchao Li
> > > > >
> > > >
> > >
> >
> >
> > --
> > Best, Jingsong Lee
> >
>
--
Best regards / Met vriendelijke groeten,
Niels Basjes
mmunity who
> made this release possible!
>
> Regards,
> Dian & Robert
>
>
--
Best regards / Met vriendelijke groeten,
Niels Basjes
re appreciated.
--
Best regards / Met vriendelijke groeten,
Niels Basjes
elationship. Alternatively,
> you could take a look at Pulsar that wants to support this functionality
> out of the box [1].
>
> [1] https://github.com/apache/pulsar/issues/12267
>
> Cheers,
> Till
>
> On Sun, Dec 19, 2021 at 4:46 PM Niels Basjes wrote:
>
> >
I'm reading the Pulsar PIP and noticed another thing to take into account:
multiple applications (with each a different parallelism) that all write
into the same topic.
On Mon, 20 Dec 2021, 10:45 Niels Basjes, wrote:
> Hi Till,
>
> This morning I also realized what you call
ing to solve it at the processing layer, it's even
> harder.
>
> -Matthias
>
> On 12/20/21 01:57, Niels Basjes wrote:
> > I'm reading the Pulsar PIP and noticed another thing to take into
> account:
> > multiple applications (with each a different
ded per source id (pattern?):
- Important producer: expire after 24 hours.
- Yet another IOT sensor: expire after 1 minute.
- and a default.
Hope this helps.
>
Yes it does.
--
Best regards / Met vriendelijke groeten,
Niels Basjes
;MAX_LONG".
But for the "the sensor died" scenario I do not yet see a better way to do
this.
Niels
On Wed, Dec 22, 2021 at 11:22 AM Niels Basjes wrote:
>
> On Tue, Dec 21, 2021 at 9:42 PM Matthias J. Sax wrote:
>
>> Your high level layout make sense. However, I
I just realized I did not mention a key concept in my idea:
All watermarks are sent into all Kafka partitions so every consumer gets
all watermarks from all upstream producing tasks.
On Wed, Dec 22, 2021 at 11:33 AM Niels Basjes wrote:
> > Perhaps for this an explicit config is need
e our web analytics
> > within the Apache Software Foundation.
> >
> > Please join me in congratulating Martijn for becoming a Flink committer!
> >
> > Cheers,
> > Robert
>
>
--
Best regards / Met vriendelijke groeten,
Niels Basjes
https://github.com/EsotericSoftware/kryo/wiki/Migration-to-v5#migration-guide
One thing is that they have an extra artifact that allows having multiple
versions of Kryo in a single application to make this possible.
Niels Basjes
On Fri, Jan 15, 2021 at 2:14 PM Till Rohrmann wrote:
> Hi Fred,
>
&
do?
- I vote for the "We drop ES6, update ES7 and use this compatibility
mode"
- Where do we do it?
- We have these connectors in both the 'flink' and
'flink-connector-elasticsearch' repos. Do we update only the new one? Or
both?
--
Best regards / Met vriendelijke groeten,
Niels Basjes
tor from Flink's
> repo with Flink 1.17.
>
> Best regards,
>
> Martijn
>
> [1] https://www.elastic.co/support/eol
> [2] https://www.elastic.co/pricing/faq/licensing
> [3] https://github.com/elastic/elasticsearch-java
>
> Op do 11 aug. 2022 om 16:45 schreef Niels Basj
Martijn
> https://twitter.com/MartijnVisser82
> https://github.com/MartijnVisser
>
> [1] https://lists.apache.org/thread/2m6wtgjvxcogbf9d5q7mqt4ofqjf2ojc
>
--
Best regards / Met vriendelijke groeten,
Niels Basjes
I'm really looking forward to seeing this in action.
Niels
On Fri, 4 Nov 2022, 19:37 Maximilian Michels, wrote:
> Hi,
>
> I would like to kick off the discussion on implementing autoscaling for
> Flink as part of the Flink Kubernetes operator. I've outlined an approach
> here which I find promi
sub-versions for each release with
variations in for example the used Scala version and/or JDK. All published
at the same moment.
Niels Basjes
On Mon, Apr 27, 2020, 10:26 Robert Metzger wrote:
> Thanks for starting the thread!
>
> I would consider the docker images of Flink convenien
but people are quite
> sensitive to things interrupting their work-flow (which I ran into a few
> times already :/ ), so we put a lot of emphasis on that aspect.
>
> On 16/04/2020 16:05, Niels Basjes wrote:
>
> Hi,
>
> Apparently the IDEs (like IntelliJ) are imperfect at supportin
4, ...).
That way you can use any compiler and get the correct results.
I also am curious if that would fix the tests that seem to fail under Java
11.
What do you think is the correct approach for this?
--
Best regards / Met vriendelijke groeten,
Niels Basjes
ake it as convenient as for LTS releases. As such you have to
> manually enable the java11 profile when compiling Flink.
>
> I set the target version to 11 since IIRC we ran into more errors that
> way, ensuring a smoother transition once Java 11 is the default.
>
> On 30/06/2020 13
[11,)
...
11
11
11
Niels Basjes
On Tue, Jun 30, 2020 at 7:53 PM Chesnay Schepler wrote:
> This is difficult to do since you cannot have multiple jdk activations for
> a single profile in maven, and duplicating the entire profile for all jdk
> versions isn't an optio
ith the release flag.
-
https://stackoverflow.com/questions/45370178/exporting-a-package-from-system-module-is-not-allowed-with-release
- https://bugs.openjdk.java.net/browse/JDK-8178152
Q: Is there an existing ticket for making the build 'clean' for java 9+ ?
Or shall I create one?
Niels
es : Gelly .. SUCCESS [
0.002 s]
--
Best regards / Met vriendelijke groeten,
Niels Basjes
Attempt 2 to get you the images.
Now as attachments.
Niels
On Thu, Jul 9, 2020 at 2:38 PM Chesnay Schepler wrote:
> The images didn't go through.
>
> On 09/07/2020 14:21, Niels Basjes wrote:
>
> Hi,
>
> I have the idea that naming the modules would make life easier
lly the same thing?
>
> On 09/07/2020 14:51, Niels Basjes wrote:
>
> Attempt 2 to get you the images.
> Now as attachments.
>
> Niels
>
> On Thu, Jul 9, 2020 at 2:38 PM Chesnay Schepler
> wrote:
>
>> The images didn't go through.
>>
>> On 09/07/2
hich has not been implemented (yet)
and which has not been placed in all code correctly.
What do you guys think of this ?
I'm inclined to simply remove the generic type parameter from this
interface.
--
Best regards / Met vriendelijke groeten,
Niels Basjes
as you found. Also, I think
> custom sink implementations in user code are somewhat rare.
>
> Best,
> Aljoscha
>
> On Mon, Jul 13, 2020, at 17:03, Niels Basjes wrote:
> > Hi,
> >
> > I prefer to have my code as "warning free" as possible so I was looking
>
hanging the names
> shouldn't change anything for users because dependencies are referred to by
> group/artifactId, it really just makes build output and IDE a bit more
> parseable by humans.
>
> Best,
> Aljoscha
>
> On Thu, Jul 9, 2020, at 16:03, Niels Basjes wrote:
> &g
+1 For dropping java 1.7
On 13 Jul 2017 04:11, "Jark Wu" wrote:
> +1 for dropping Java 7
>
> 2017-07-13 9:34 GMT+08:00 ☼ R Nair (रविशंकर नायर) <
> ravishankar.n...@gmail.com>:
>
>> +1 for dropping Java 1.7.
>>
>> On Wed, Jul 12, 2017 at 9:10 PM, Kurt Young wrote:
>>
>>> +1 for droppint Java 7,
handle the possibilities regarding the various
file formats?
The reason I ask is because I want to see if I can port this (now Hadoop
specific) hobby project of mine to work with Flink:
https://github.com/nielsbasjes/splittablegzip
Thanks.
--
Best regards / Met vriendelijke groeten,
Niels Basjes
Niels Basjes created FLINK-16288:
Summary: Setting the TTL for discarding task pods on Kubernetes.
Key: FLINK-16288
URL: https://issues.apache.org/jira/browse/FLINK-16288
Project: Flink
Niels Basjes created FLINK-16289:
Summary: Missing serialVersionUID blocks running in Kubernetes.
Key: FLINK-16289
URL: https://issues.apache.org/jira/browse/FLINK-16289
Project: Flink
Issue
Niels Basjes created FLINK-16293:
Summary: Document using plugins in Kubernetes
Key: FLINK-16293
URL: https://issues.apache.org/jira/browse/FLINK-16293
Project: Flink
Issue Type: Improvement
Niels Basjes created FLINK-16432:
Summary: Building Hive connector gives problems
Key: FLINK-16432
URL: https://issues.apache.org/jira/browse/FLINK-16432
Project: Flink
Issue Type: Bug
Niels Basjes created FLINK-16871:
Summary: Make more build information available during runtime.
Key: FLINK-16871
URL: https://issues.apache.org/jira/browse/FLINK-16871
Project: Flink
Issue
Niels Basjes created FLINK-9610:
---
Summary: Add Kafka partitioner that uses the key to partition by
Key: FLINK-9610
URL: https://issues.apache.org/jira/browse/FLINK-9610
Project: Flink
Issue
Niels Basjes created FLINK-2977:
---
Summary: Cannot access HBase in a Kerberos secured Yarn cluster
Key: FLINK-2977
URL: https://issues.apache.org/jira/browse/FLINK-2977
Project: Flink
Issue
Niels Basjes created FLINK-3082:
---
Summary: Confusing error about ManualTimestampSourceFunction
Key: FLINK-3082
URL: https://issues.apache.org/jira/browse/FLINK-3082
Project: Flink
Issue Type
Niels Basjes created FLINK-3089:
---
Summary: OperatorState timeout
Key: FLINK-3089
URL: https://issues.apache.org/jira/browse/FLINK-3089
Project: Flink
Issue Type: New Feature
Niels Basjes created FLINK-3239:
---
Summary: Support for Kerberos enabled Kafka 0.9.0.0
Key: FLINK-3239
URL: https://issues.apache.org/jira/browse/FLINK-3239
Project: Flink
Issue Type: New
Niels Basjes created FLINK-3584:
---
Summary: WebInterface: Broken graphical display in Chrome
Key: FLINK-3584
URL: https://issues.apache.org/jira/browse/FLINK-3584
Project: Flink
Issue Type: Bug
Niels Basjes created FLINK-3719:
---
Summary: WebInterface: Moving the barrier between graph and stats
Key: FLINK-3719
URL: https://issues.apache.org/jira/browse/FLINK-3719
Project: Flink
Issue
Niels Basjes created FLINK-3886:
---
Summary: Give a better error when the application Main class is
not public.
Key: FLINK-3886
URL: https://issues.apache.org/jira/browse/FLINK-3886
Project: Flink
Niels Basjes created FLINK-4287:
---
Summary: Unable to access secured HBase from a yarn-session.
Key: FLINK-4287
URL: https://issues.apache.org/jira/browse/FLINK-4287
Project: Flink
Issue Type
Niels Basjes created FLINK-4311:
---
Summary: TableInputFormat fails when reused on next split
Key: FLINK-4311
URL: https://issues.apache.org/jira/browse/FLINK-4311
Project: Flink
Issue Type: Bug
Niels Basjes created FLINK-4485:
---
Summary: Finished jobs in yarn session fill /tmp filesystem
Key: FLINK-4485
URL: https://issues.apache.org/jira/browse/FLINK-4485
Project: Flink
Issue Type
Niels Basjes created FLINK-4486:
---
Summary: JobManager not fully running when yarn-session.sh finishes
Key: FLINK-4486
URL: https://issues.apache.org/jira/browse/FLINK-4486
Project: Flink
Issue
Niels Basjes created FLINK-4487:
---
Summary: Need tools for managing the yarn-session better
Key: FLINK-4487
URL: https://issues.apache.org/jira/browse/FLINK-4487
Project: Flink
Issue Type
Niels Basjes created FLINK-4495:
---
Summary: Running multiple jobs on yarn (without yarn-session)
Key: FLINK-4495
URL: https://issues.apache.org/jira/browse/FLINK-4495
Project: Flink
Issue Type
Niels Basjes created FLINK-4620:
---
Summary: Automatically creating savepoints
Key: FLINK-4620
URL: https://issues.apache.org/jira/browse/FLINK-4620
Project: Flink
Issue Type: New Feature
Niels Basjes created FLINK-5025:
---
Summary: Job fails because of Optimizer bug
Key: FLINK-5025
URL: https://issues.apache.org/jira/browse/FLINK-5025
Project: Flink
Issue Type: Bug
Affects
Niels Basjes created FLINK-31714:
Summary: Conjars.org has died
Key: FLINK-31714
URL: https://issues.apache.org/jira/browse/FLINK-31714
Project: Flink
Issue Type: Bug
Reporter
Niels Basjes created FLINK-28911:
Summary: Elasticsearch connector fails build
Key: FLINK-28911
URL: https://issues.apache.org/jira/browse/FLINK-28911
Project: Flink
Issue Type: Bug
Niels Basjes created FLINK-18448:
Summary: Update Google Cloud PubSub dependencies
Key: FLINK-18448
URL: https://issues.apache.org/jira/browse/FLINK-18448
Project: Flink
Issue Type
Niels Basjes created FLINK-18455:
Summary: Building with JDK 9+ leads to problems on JDK 8
Key: FLINK-18455
URL: https://issues.apache.org/jira/browse/FLINK-18455
Project: Flink
Issue Type
Niels Basjes created FLINK-18458:
Summary: Setting the property java.version makes the build brittle
and harder to debug.
Key: FLINK-18458
URL: https://issues.apache.org/jira/browse/FLINK-18458
Niels Basjes created FLINK-18514:
Summary: Building fails with JDK 14 installed
Key: FLINK-18514
URL: https://issues.apache.org/jira/browse/FLINK-18514
Project: Flink
Issue Type: Improvement
Niels Basjes created FLINK-18606:
Summary: Remove generic parameter from SinkFunction.Context
Key: FLINK-18606
URL: https://issues.apache.org/jira/browse/FLINK-18606
Project: Flink
Issue
Niels Basjes created FLINK-18607:
Summary: Give the maven modules human readable names.
Key: FLINK-18607
URL: https://issues.apache.org/jira/browse/FLINK-18607
Project: Flink
Issue Type
77 matches
Mail list logo
