Hi,
I have downloaded the flink code and the build works fine with following
command
mvnw install -DskipTests -Dcheckstyle.skip
Then I try to run the unit test code in IntelliJ, but got following error:
/Users/mintu/ApacheProjects/flink/flink-scala/src/test/scala/org/apache/flink/api/scala/Delt
>Fink will not run natively in windows - that is why I use Github CLI
Do you mean Git Bash?
> I made test with Flink version 1.14.4 - Taskmanager is running. But no
chance with 1.15.0 or 1.15.1 - taskmanager does not start. Something's
wrong with Flink?
I do not use Windows, so can't verify.
start
Does Table API connector, CSV, has some option to ignore some columns in source file?
For instance read only first, second, nine... but not the others?
Or any other trick?
CREATE TABLE some_table (
some_id BIGINT,
...
) WITH (
'format' = 'csv',
...
)
Fink will not run natively in windows - that is why I use Github CLI
I made test with Flink version 1.14.4 - Taskmanager is running. But no chance with 1.15.0 or 1.15.1 - taskmanager does not start.
Something's wrong with Flink?
Sent: Friday, July 08, 2022 at 5:15 PM
From: "Alexande
Hi Robin,
Apart from what Alexander suggested, I think you could also try the
following first:
Let the job use a "new" Kafka source, which you can achieve by simply
assigning a different operator ID than before. If you previously did not
set an ID, then previously by default it would have been a h
Hi Robin,
you should be able to use the State Processor API to modify the operator
state (sources) and override the offsets manually there. I never tried
that, but I believe conceptually it should work.
Best,
Alexander Fedulov
You do not need to run anything beyond start-cluster for a simple test. It
starts one jobmanager (this is what also hosts the UI you see) and one
taskmanager:
[image: image.png]
What does Github CLI has to do with the Flink startup?
On Fri, Jul 8, 2022 at 2:25 PM wrote:
> Yep, sorry, my fa
Hello all!
We have a need where, for specific recovery cases, we would need to
manually reset our Flink kafka consumer offset to a given date but have the
Flink job restore its state. As I understand, restoring from a checkpoint
necessarily sets the group's offset to the one that was in the checkp
Regarding the kafka subscribers, I ended up copying the original Kafka
Source in my project to make the setter public. Thanks for pointing out the
reflection option (in reality, both are ugly).
As for the main point, there is no real motivation other than curiosity. I
agree that one can always red
Hi Dian,
I'm using version 1.15.0 and 1.15.1 of PyFlink. I think it's to do with how the
arguments are ordered, as when I run the container with:
“standalone-job”, “-s”, “s3://”, “-n”, “-pym”,
“foo.main”
then the job starts successfully and loads from the savepoint.
Many thanks,
John
Thanks for the detailed info Xingbo, I am pretty new to the PyFlink module
so was mainly trying to experiment a little :)
I think supporting it in Flink 1.16 is more than enough, it would probably
be an overkill to try to backport this. The M1 issue only really occurs in
local development/testing.
Yep, sorry, my fault.
I see now that this is not enough to just start cluster; taskmanager have to be started as well.
How I start it (Github CLI):
export FLINK_HOME=/C/Flink/flink-1.15.0
$FLINK_HOME/bin/start-cluster.sh
Flink is running (I can reach it going to http://localhost:80
Hi Mike,
please do not forget to include the mailing list address/reply to all,
otherwise, this becomes a private conversation.
How do you start your cluster?
Best,
Alex
On Fri, Jul 8, 2022 at 10:45 AM wrote:
> Thanks for support.
> As you suggested, I did run it in IDE:
>
> WARNING: An illeg
Hi Salva,
I was the contributor on the ticket and have updated the PR. Sorry for the
delay! Meanwhile, you can use reflection to set the KafkaSubscriber if you
need to have an immediate solution.
With respect to your control message idea, what is the motivation to use a
push based mechanism vs po
14 matches
Mail list logo
