Re: Flink bitnami

Hi william, Welcom to flink community. Flink do not provide the bitnami support now. You could deploy Flink on Local Cluster, Standalone Cluster, Yarn, Mesos, Kubernetes, etc. Navigate to doc[1] for more information.

Re: [DISCUSS] Set default planner for SQL Client to Blink planner in 1.10 release

Thanks everyone for the feedback! We have reached a clear consensus that the proposal is accepted. There are 3 binding votes from: - Timo - Hequn - Jark I will make sure that this change is applied to Flink code base and created FLINK-15495 to track this. Best, Jark On Mon, 6 Jan 2020 at 13:54

Re: Flink logging issue with logback

Hi Bajaj, I have tested just as you say, and find that the logs in the user class could not show up when using ConsoleAppender. If using FileAppender instead, everything goes well. It is so weird and i have no idea how to debug it. Best, Yang Bajaj, Abhinav 于2020年1月7日周二 上午4:28写道： > Hi, > >

Re: Re: Using async io in cep

Hi， Our business is to dynamically query (such as left join/right join) the mysql / oracle database during the cep process, or is there any other way to achieve this function? zjfpla...@hotmail.com From: Dawid Wysakowicz Da

RE: EXT :Re: Taskmanagers in Docker Fail to Resolve Own Hostnames and Won't Accept Tasks

Yes, the container seems to be resolving its own host name correctly (the Flink docker image doesn’t come with nslookup installed, but pinging by host name worked). When I did the check, it had been a considerable time since the container started, so I can’t rule out a race condition between fli

Re: Flink logging issue with logback

Hi, Thanks much for the responses. Let me add some more details and clarify my question. Setup * I used the WikipediaAnalysis example and added a log in main method. …… public static void main(String[] args) throws Exception { StreamExecutionEnvironment see = StreamExecutionEnvironment.ge

Flink bitnami

Hallo Is there a flink template for deployment on bitnami? Thanks

Re: Flink task node shut it self off.

So I increased all the jobs to 1 minute checkpoint... I let you know how it goes... Or of need to rethink gluster lol On Sat., Jan. 4, 2020, 9:27 p.m. John Smith, wrote: > It seems to have happened again... Here is a screen shot of the system > metrics for that day on that particular node >

Re: Checkpoints issue and job failing

Thanks Vino & Piotr, sure, will upgrade the flink version and monitor it to see if the problem still exist. Thanks On Mon, Jan 6, 2020 at 12:39 AM Piotr Nowojski wrote: > Hi, > > From the top of my head I don’t remember anything particular, however > release 1.4.0 came with quite a lot of deep

RE: Table API: Joining on Tables of Complex Types

Hi David, thanks for getting back. >From what you've said, I think we'll need to convert our GenericRecord into >structured types - do you have any references or examples I can have a look >at? If not, perhaps you could just show me a basic example of flattening a >complex object with accessors

Re: Table API: Joining on Tables of Complex Types

Hi Andreas, First of all I would highly recommend converting a non-structured types to structured types as soon as possible as it opens more possibilities to optimize the plan. Have you tried: Table users = batchTableEnvironment.fromDataSet(usersDataset).select("getField(f0, userName) as userNam

[ANNOUNCE] Flink Forward SF Call for Presentation closing soon!

Hi all, First of all, Happy New Year to everyone! Many of you probably didn't spent the holidays thinking a lot about Flink. Now, however, is the right time to focus again and decide which talk(s) to submit for Flink Forward San Francisco because the Call for Presentations is closing this Sunday,

Re: Flink group with time-windowed join

Hi, Could you check your query again? I could not reproduce your issue on latest master. I had to adjust your query slightly though: SELECT     a.account,     (SUM(a.`value`) + SUM(b.`value`)) as `result`,     TUMBLE_START(a.producer_timestamp, INTERVAL '3' MINUTE) FROM     (SELEC

Re: Flink logging issue with logback

Hi Bajaj, I am not entirely sure what is the actual issue you are seeking help, but let me comment on your observations. Ad. 1 If you log to the console from the main method this is an expected behavior in both cases (log4j, logback). The std out is being overwritten for the execution of the mai

Abstract classes in Stateful functions

Hello again :-) When using an abstract class should the instance variables be stored in PersistenceValues to conform to the fault tolerance? Exempel Car, Truck and Abstract Vehicle, should wheels in Vehicle be stored in a PersistenceValue? Thanks, /Dan

Re: kafka: how to stop consumption temporarily

My naive solution can't work because a dump can be quite long. So, yes I have to find a way to stop the consumption from the topic used for streaming mode when a dump is done :( Terry, I try to implement something based on your reply and based on this thread https://stackoverflow.com/questions/5

Re: Using async io in cep

Hi, You cannot use the Async IO as described here[1] in the CEP library, if that's what you are asking for. It is also not that straightforward to say what would an async processing in that case mean. Primary use case for Async IO is to execute parallel computations of independent data. In case o

Re: kafka: how to stop consumption temporarily

Hi, Thanks for your replies. Yes Terry. You are right. I can try to create a custom source. But perhaps, according to my use case, I figured out I can use a technical field in my data. This is a timestamp and I think I just have to ignore late events with watermarks or later in the pipeline acc

Using async io in cep

Hi， Is there a way to use asynchronous io to query the database in the process of cep? zjfpla...@hotmail.com

Re: Yarn Kerberos issue

I guess you have set some kerberos related configuration in spark jobs. For Flink, you need to do this too by the following configs. And the keytab file should existed on Flink client. In your environment, it means the scheduler(oozie) could access the keytab file. security.kerberos.login.keytab s

Re: Checkpoints issue and job failing

Hi, From the top of my head I don’t remember anything particular, however release 1.4.0 came with quite a lot of deep change which had it’s fair share number of bugs, that were subsequently fixed in later releases. Because 1.4.x tree is no longer supported I would strongly recommend to first