Hi Fabian,
+1 👍
Cheers
Dhanuka
On Mon, 14 Jan 2019, 21:29 Fabian Hueske Hi,
>
> That's a Java limitation. Methods cannot be larger than 64kb and code that
> is generated for this predicate exceeds the limit.
> There is a Jira issue to fix the problem.
>
> In the meantime, I'd follow a hybrid ap
Hi,
That's a Java limitation. Methods cannot be larger than 64kb and code that
is generated for this predicate exceeds the limit.
There is a Jira issue to fix the problem.
In the meantime, I'd follow a hybrid approach and UNION ALL only as many
tables as you need to avoid the code compilation exc
Hi Fabian ,
I was encounter below error with 200 OR operators so I guess this is JVM
level limitation.
Error :
of class "datastreamcalcrule" grows beyond 64 kb
Cheers
Dhanuka
On Mon, 14 Jan 2019, 20:30 Fabian Hueske Hi,
>
> you should avoid the UNION ALL approach because the query will scan
Hi,
you should avoid the UNION ALL approach because the query will scan the
(identical?) Kafka topic 200 times which is highly inefficient.
You should rather use your second approach and scale the query
appropriately.
Best, Fabian
Am Mo., 14. Jan. 2019 um 08:39 Uhr schrieb dhanuka ranasinghe <
d
SORRY about sending mail without completing :) ,
I also tried out different approach , which is instead of UNION ALL, use
OR as below.
( InterceptID = 4508724 AND Provider_Info = 'Dhanuka' AND LIID LIKE
'%193400835%'
) OR
( InterceptID = 4508724 AND Provider_Info = 'Dhanuka' AND LIID LIKE
'%193
Hi Hequn,
I think it's obvious when we see the job graph for 200 unions. I have
attached the screenshot here with.
I also tried out different approach , which is instead of UNION ALL
On Mon, Jan 14, 2019 at 2:57 PM Hequn Cheng wrote:
> Hi dhanuka,
>
> > I am trying to deploy 200 SQL unions an
Hi dhanuka,
> I am trying to deploy 200 SQL unions and it seems all the tasks getting
failing after some time.
Would be great if you can show us some information(say exception stack)
about the failure. Is it caused by OOM of job manager?
> How do i allocate memory for task manager and job manager
Hi Fabian,
Thanks for the prompt reply and its working 🤗.
I am trying to deploy 200 SQL unions and it seems all the tasks getting
failing after some time.
How do i allocate memory for task manager and job manager. What are the
factors need to be considered .
Cheers
Dhanuka
On Sun, 13 Jan 2019,
Hi Dhanuka,
The important error message here is "AppendStreamTableSink requires that
Table has only insert changes".
This is because you use UNION instead of UNION ALL, which implies duplicate
elimination.
Unfortunately, UNION is currently internally implemented as a regular
aggregration which pro
Hi All,
I am trying to select multiple results from Kafka and send results to Kafka
different topic using Table API. But I am getting below error. Could you
please help me on this.
Query:
SELECT TiggerID,'Rule3' as RuleName,mytime(ts) as ts1 ,
mytime(CURRENT_TIMESTAMP) as ts2 FROM dataTable WHER
10 matches
Mail list logo