Any lessons-learned with boundless (infinite) joins, especially at scale?

Hi, I'm wondering if anyone could share if they've tried using infinite joins to join large amounts of state in real-time. If so, how did it go? What was the scale? Were there any "gotchas" or things that needed to be tuned? We're considering trying this at scale, and I'd love to hear some words o

Deployment on k8s via API

Hi, I'm looking at my options for automating the deployment of Flink jobs on k8s (ideally using application mode), and I noticed that most of the examples of deploying Flink jobs in the docs use calls to the Flink binary, such as: $ ./bin/flink run-application \--target kubernetes-application

Streaming Patterns and Best Practices - featuring Apache Flink

I just released a new video that features Apache Flink in several design patterns: Streaming Patterns and Best Practices with Apache Pulsar for Enabling Machine Learning and Analytics I thought it might be of interest to the Flink community. Devin G. Bost

Is Flink able to parse strings into dynamic JSON?

I'm wanting to know if it's possible in Flink to parse strings into a dynamic JSON object that doesn't require me to know the primitive type details at compile time. We have over 300 event types to process, and I need a way to load the types at runtime. I only need to know if certain fields exist o

importing types doesn't fix “could not find implicit value for evidence parameter of type …TypeInformation”

I posted this problem on Stack Overflow here: https://stackoverflow.com/questions/65930023/flink-importing-types-doesnt-fix-could-not-find-implicit-value-for-evidence Basically, I can't even get a basic map to work like this: object AmplitudeExample { def main(args: Array[String]) { import

Presentation - Real World Architectural Patterns with Apache Pulsar and Flink

If anyone missed my presentation on Real-World Architectural Patterns with Apache Pulsar that covers a use case involving Apache *Flink* for distributed tracing, please check out the recording here: https://youtu.be/pmaCG1SHAW8 Devin G. Bost

Re: Need help using AggregateFunction instead of FoldFunction

I did confirm that I got no resulting output after 20 seconds and after sending additional data after waiting over a minute between batches of data. My code looks like this: PulsarSourceBuilder builder = PulsarSourceBuilder .builder(new SimpleStringSchema()) .serviceUrl(SERVICE_URL)