r job
c5ff9686e944f62a24c10c6bf20a5a55. |
I guess the simple resolution is to increase the JVM Heap Size?
On Thu, May 27, 2021 at 10:51 AM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
Hi Robert,
do you have some additional info? For example the last log mess
Hi Robert,
do you have some additional info? For example the last log message of
the unreachable TaskManagers. Is the Job running in kubernetes? What
backend are you using?
From the first looks of it, I have seen this behaviour mostly in cases
where one or more taskmanagers shut down due to
Hi Yaroslav,
here's a fourth option that we usually use: We set the default
parallelism once when we initially deploy the app (maybe change it a few
times in the beginning). From that point on rescale by either resizing
the TaskManager-Nodes or redistributing the parallelism over more / less
Hi,
recently we started seeing the following faulty behaviour in the Flink
Stateful Functions HTTP communication towards external Python workers.
This is only occuring when the system is under heavy load.
The Java Application will send HTTP Messages to an external Python
Function but the ext
a timer per element.
For that, you can store the previous time (in function state).
Regards,
Roman
On Fri, Feb 26, 2021 at 10:29 PM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
Hi everybody,
I just wanted to say thanks again for all your input and share the
(
--Original Mail --
*Sender:*Khachatryan Roman mailto:khachatryan.ro...@gmail.com>>
*Send Date:*Tue Feb 9 02:35:20 2021
*Recipients:*Jan Brusch mailto:jan.bru...@neuland-bfi.de>>
*CC:*Yun Gao mailto:yungao...@aliyun.com>&g
projects/flink/flink-docs-stable/dev/stream/operators/process_function.html#the-keyedprocessfunction
--Original Mail ------
*Sender:*Jan Brusch
*Send Date:*Sat Feb 6 23:44:00 2021
*Recipients:*user
*Subject:*Sliding Window Count: Tricky Edge Case
Hi,
I was recently working on a problem where we wanted to implement a
simple count on a sliding window, e.g. "how many messages of a certain
type were emitted by a certain type of sensor in the last n minutes".
Which sounds simple enough in theory:
messageStream
.keyBy(//EmitterType + Me
he.org/jira/browse/FLINK-21280>
On Thu, Feb 4, 2021 at 3:13 PM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
Hello,
we are currently trying to implement a JDBC Sink in Stateful
Functions
as documented here:
https://ci.apache.org/projects/flink/flink-state
Hello,
we are currently trying to implement a JDBC Sink in Stateful Functions
as documented here:
https://ci.apache.org/projects/flink/flink-statefun-docs-release-2.2/io-module/flink-connectors.html
However, when starting the application we are running into this error:
--
Hi,
I have a bit of a strange problem: I can't get a Statefun Application to
Compile or Run (Depending on the exact Protobuf version) with a Protobuf
version newer than 3.3.0. I have had this problem over multiple project
setups and multiple versions of Flink Statefun with Java8.
Protobuf 3.
Hi,
just a quick question: Is there a rough estimation, when the Flink 1.12
Features (especially the new HA-Mode) will also be available in Flink
Stateful Functions?
Best regards
Jan
k-statefun-docs-master/deployment-and-operations/packaging.html#flink-jar
<https://ci.apache.org/projects/flink/flink-statefun-docs-master/deployment-and-operations/packaging.html#flink-jar>
On Thu, Nov 5, 2020 at 5:29 PM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
gt;
[7]
https://ci.apache.org/projects/flink/flink-statefun-docs-master/deployment-and-operations/packaging.html#images
<https://ci.apache.org/projects/flink/flink-statefun-docs-master/deployment-and-operations/packaging.html#images>
On Thu, Nov 5, 2020 at 3:35 PM Jan Brusch <mailto:jan
Hi,
I'm currently trying to set up a Flink Stateful Functions Job with the
following architecture:
* Kinesis Ingress (embedded)
* Stateful Function (embedded) that calls to and takes responses from an
external business logic function (python worker similar to the one in
the python greeter e
identifier to have a produced type of com.google.protobuf.Message
instead of an Event.
Good luck!
Igal
On Fri, Jul 3, 2020 at 10:09 PM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
Hi Igal,
thanks for your reply. Initially I thought the same thing, but it
turns
including the module.yaml in your
src/main/resources/ directory.
Good luck,
Igal.
On Mon, Jul 6, 2020 at 12:39 PM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
Hi,
quick question about Deploying a Flink Stateful Functions
Application to
an existing cluster: The Docu
module.yaml,
So one way would be including the module.yaml in your
src/main/resources/ directory.
Good luck,
Igal.
On Mon, Jul 6, 2020 at 12:39 PM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
Hi,
quick question about Deploying a Flink Stateful Functions
Application
ou would have to change the definition of your ingress
identifier to have a produced type of com.google.protobuf.Message
instead of an Event.
Good luck!
Igal
On Fri, Jul 3, 2020 at 10:09 PM Jan Brusch <mailto:jan.bru...@neuland-bfi.de>> wrote:
Hi Igal,
thanks for your reply.
Hi,
quick question about Deploying a Flink Stateful Functions Application to
an existing cluster: The Documentation says to integrate
"statefun-flink-distribution" as additional maven Dependency in the fat
jar.
(https://ci.apache.org/projects/flink/flink-statefun-docs-release-2.1/deployment-a
erPython" is not known to stateful functions.
This could happen if the module.yaml (provided in your email) was
accidentally excluded from the resulting artifact (Docker image or a
jar-with-dependencies)
Can you please verify that the module.yaml is present at runtime?
Kind regards,
Igal.
On Thu
Hi,
based on Gordons excellent advice on how to handle JSON messages with
remote functions
(https://www.mail-archive.com/user@flink.apache.org/msg34385.html) I was
able to:
1) Deserialize JSON Messages from a Kafka Stream
2) Route the message to an embedded StatefulFunction
3) Serialize th
22 matches
Mail list logo
