Hello Pedroh!
I am adding the jar under /opt/flink/plugins/s3-fs-hadoop inside a docker
image. It's definitely not happening under the task manager and I don't
believe it's happening under Job manager either. The error is coming from
FlinkSessionJob under the Kubernetes' Custom Resource Definition
Hello there Bryan!
It looks like Flink cannot find the s3 schema in your packages. How are you
adding the jars? Is the error happening on TM or on JM?
Att,
Pedro Mázala
Be awesome
On Thu, 22 May 2025 at 19:45, Bryan Cantos wrote:
> Hello,
>
> I have deployed the Flink Operator via helm chart
Hello,
I have deployed the Flink Operator via helm chart (
https://github.com/apache/flink-kubernetes-operator) in our kubernetes
cluster. I have a use case where we want to run ephemeral jobs so I created
a FlinkDeployment and am trying to submit a job via FlinkSessionJob. I have
sent example yam
Hi Sanket,
have you considered reaching out to the Kinesis community? I might be wrong
but it looks like a Kinesis issue.
Best,
Matthias
On Tue, Aug 24, 2021 at 7:13 PM Sanket Agrawal
wrote:
> Hi,
>
>
>
> We are trying to use Kinesis along with Flink(1.11.2) and JDK 11 on EMR
> cluster(6.2). Wh
Hi,
We are trying to use Kinesis along with Flink(1.11.2) and JDK 11 on EMR
cluster(6.2). When the application starts we are getting below error:
2021-08-24 12:46:27.980 [INFO] [CONFIGURATION_BROADC] {App-N=app_name,
App-V=3.0.0} {}
org.apache.flink.kinesis.shaded.com.amazonaws.services.kinesi
I have created a custom annotation to log time consumed by a method using
aspectj library.
I tested it in a spring boot application for one of the rest endpoint and
it works fine.
But when I annotate map method in my flink job class, it doesn't work.
Anyone having any inputs on it?
With regards
Ok, no worries Aaron, that's still good advice :)
One last question - are you using JAR-based or image-based deployments? The
only real problem using Flink & Bazel and a JAR-based deployment from our
experience is removing the Flink libs present in the deploy environment
from the deploy jar, and s
Hi Austin,
In our experience, `rules_scala` and `rules_java` are enough for us at this
point.
It's entirely possible I'm not thinking far enough into the future, though,
so don't take our lack of investment as a sign it's not worth investing in
:)
Best,
Aaron Levin
On Thu, Jun 18, 2020 at 10:2
Great to hear Dan!
@Aaron - would you/ your team be interested in a `rules_flink` project? I'm
still fairly new to Bazel and know enough to contribute, but could
definitely use guidance on design as well.
Best,
Austin
On Mon, Jun 15, 2020 at 11:07 PM Dan Hill wrote:
> Thanks for the replies!
Thanks for the replies! I was able to use the provided answers to get a
setup working (maybe not the most efficiently). The main change I made was
to switch to including the deploy jar in the image (rather than the default
one).
I'm open to contributing to a "rules_flink" project. I don't know
Hi Dan,
if you want to run a Flink job without specifying the main class via
`bin/flink run --class org.a.b.Foobar` then you have to add a MANIFEST.MF
file to your jar under META-INF and this file needs to contain `Main-Class:
org.a.b.Foobar`.
Cheers,
Till
On Fri, Jun 12, 2020 at 12:30 AM Austin
Hey all,
Adding to Aaron's response, we use Bazel to build our Flink apps. We've
open-sourced some of our setup here[1] though a bit outdated. There are
definitely rough edges/ probably needs a good deal of work to fit other
setups. We have written a wrapper around the `java_library` and
`java_bin
Hi Dan,
We use Bazel to compile our Flink applications. We're using "rules_scala" (
https://github.com/bazelbuild/rules_scala) to manage the dependencies and
produce jars. We haven't had any issues. However, I have found that
sometimes it's difficult to figure out exactly what Flink target or
depe
I took the Flink playground and I'm trying to swap out Maven for Bazel. I
got to the point where I'm hitting the following error. I want to diff my
code with an existing, working setup.
Thanks! - Dan
client_1|
org.apache.flink.client.program.ProgramInvocationException:
Neither
Hello
Actually I evaluate my WindowFunction with a trigger alert, having
something like below code (testing with 2 different windows), expecting 5K
elements per second arriving
SingleOutputStreamOperator windowedElem = element
.keyBy("id")
.timeWindow(Time.seconds(120))
// .window(EventTi
Hi antonio,
I think it worth a try to test the performance in your scenario, since job
performance can be affected by a number of factors(say your WindowFunction).
Best, Hequn
On Sat, Jul 21, 2018 at 2:59 AM, antonio saldivar
wrote:
> Hello
>
> I am building an app but for this UC I want to te
Hello
I am building an app but for this UC I want to test with session windows
and I am not sure if this will be expensive for the compute resources
because the gap will be 10 mins, 20 mins 60 mins because I want to trigger
an alert if the element reaches some thresholds within those periods of
ti
17 matches
Mail list logo
