Re: Kylin with S3, cubes tables get in transition when new cluster booted

2018-08-02 Thread Moisés Català
Thanks ShaoFeng Shi, As recommended in the installation tutorial, I use HDFS for intermediate data storage, so before shutting down the cluster I back up hdfs://user/kylin in S3 with dist-cp. I have 2 buckets and I don’t do any modifications to S3 hbase root directly,these are my buckets :

Fwd: Why running mapred job will not stop while cube building is paused?

2018-08-02 Thread 张俊宝
Hi, When I pause the cube building job in kylin web UI,the mapred job running is not stopped,is it an issue? or lack some configurations? Kind Regards, Joel

Re: Why running mapred job will not stop while cube building is paused?

2018-08-02 Thread ShaoFeng Shi
Hi Junbao, What's your Kylin version? and when you paused the job, was there any log like "failed to kill hadoop job" appeared in kylin.log? >From the code, I see both "discard" and "pause" will trigger to kill the job. 2018-08-02 18:15 GMT+08:00 张俊宝 : > Hi, > > When I pause the cube building j

multiple EMRs sync

2018-08-02 Thread Sonny Heer
Is it possible in the new version of kylin to have multiple EMR clusters with Kylin installed on master node but talking to the same S3 location. e.g. one Write EMR cluster and one Read EMR cluster ?