Re: new committer: Vino Yang (杨华)

2020-08-09 Thread Billy Liu
Welcome, Vino. With Warm regards Billy Liu Rupeng Wang 于2020年8月10日周一 上午9:54写道: > Congratulations! > > --- > Best wishes, > Rupeng Wang > > > 在 2020/8/7 10:36,“ShaoFeng Shi” 写入: > > The Project Management Committee (PMC) for Apache Kylin has

Re: New PMC: Xiaoxiang Yu

2020-10-09 Thread Billy Liu
Congratulation With Warm regards Billy Liu Xiaoyuan Gu 于2020年10月9日周五 下午8:17写道: > Congrats! > > > | | > 顾潇远 > | > | > 邮箱:njguxiaoy...@163.com > | > > 签名由 网易邮箱大师 定制 > > On 10/09/2020 19:05, George Ni wrote: > Congratulations > > Rupeng Wang

Re: Streaming cubing

2016-12-02 Thread Billy Liu
The script streaming_build.sh has been removed in 1.6.0, since Kylin introduces the new Streaming design. The old(experimental and deprecated) one has been removed. To learn how to use it, please refer to http://kylin.apache.org/docs16/tutorial/cube_streaming.html 2016-12-02 19:30 GMT+08:00 汪胜 :

Re: Streaming cube build failed

2016-12-05 Thread Billy Liu
Thanks for the update. Any feedback is welcomed. 2016-12-05 14:42 GMT+08:00 汪胜 : > I'm sorry to trouble you. I had found the reason about why the build job > failed. I wrote the wrong kafka host when I create streaming table. When I > added a broker, I wrote the host as "localhost". > > > > On 12

Re: Use Spark Cube Engine

2016-12-06 Thread Billy Liu
Spark Engine is not recommended by default, as it's not as stable as MR for the cube building algorithm, especially for large scale data. Based on my limited experience, we have not obtained enough advantages from the Spark Engine. So the spark engine is still under experimental conditions. 2016

Re: Cube Configuration Overwrites doesn't work

2016-12-07 Thread Billy Liu
Hi Peter, Which version were you using? This override feature is introduced by KYLIN-2095, which is released in Kylin 1.6.0. 2016-12-07 19:47 GMT+08:00 Jian Zhong : > Forward to dev list. > > -- Forwarded message -- > From: peter zhang > Date: Wed, Dec 7, 2016 at 9:03 AM > Subje

Re: Issues in building cubes of Apache Kylin

2016-12-07 Thread Billy Liu
Hi Tarun, what's the output of bin/find-hive-dependency.sh? It seems something wrong in the environment variables. Which Hadoop distribution were you using? 2016-12-07 23:04 GMT+08:00 Tarun Vashisth : > Hi, > > > > We are trying to build cubes for data and while doing so, we are getting > the fo

Re: Re: 使用全局字典报错AppendTrieDictionary can't retrive value from id

2016-12-07 Thread Billy Liu
To use GlobalDictionaryBuilder, there are some benefits, but also some limitation. It's very useful for precise count by using bitmap dictionary, but could not preserve the value order. That means it supports equals operator, but not greater(less) than operator. Back to your case, you should defin

Re: kylin1.6版本增量build的BUG

2016-12-07 Thread Billy Liu
Thanks for the reporting, but the images could not display. 在 2016年12月8日 上午8:55,gaolv123...@163.com 写道: > kylin1.6版本增量build的BUG > > 如下两张图片所示,条件只能是日期嘛? > 并且手动输入的无效,必须通过控件输入 > > > -- > gaolv123...@163.com >

Re: 答复: 回复:答复: Kylin1.6.0流式Cube查询时间错误

2016-12-07 Thread Billy Liu
here here some threads about getting the right Date from Kylin http://apache-kylin.74782.x6.nabble.com/JDBC-query-result-Date-column-get-wrong-value-td5370.html 在 2016年12月8日 上午11:09,仇同心 写道: > 是的,构建好的segment进行SQL查询的时候,发现这些查询记录的时间也都是早了8小时 > > > > -邮件原件- > 发件人: 汪胜 [mailto:sky...@163.com] > 发

Re: Issues in building cubes of Apache Kylin

2016-12-07 Thread Billy Liu
.jar:/usr/local/hive/lib/janino-2.7.6.jar:/ > usr/local/hive/lib/libthrift-0.9.3.jar:/usr/local/hive/lib/ > twill-discovery-api-0.6.0-incubating.jar:/usr/local/ > hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/local/hive/ > lib/commons-el-1.0.jar:/usr/local/hive/lib/hbase-protocol- > 1

Re: Can not Clean Up

2016-12-08 Thread Billy Liu
try org.apache.kylin.tool.StorageCleanupJob 2016-12-08 16:39 GMT+08:00 Luke_Selina : > I use the command '/opt/kylin/bin/kylin.sh > org.apache.kylin.storage.hbase.util.StorageCleanupJon --delete true' to > clean up my cluster, but it claims Could not find or load main class > org.apache.kylin.sto

Re: Can not Clean Up

2016-12-08 Thread Billy Liu
Have you exported KYLIN_HOME? 2016-12-08 16:50 GMT+08:00 Luke_Selina : > Just as the pic shows it still shows Error @Billy Liu > > -- > View this message in context: http://apache-kylin.74782.x6. > nabble.com/Can-not-Clean-Up-tp6554p6556.html > Sent from the Apache Kylin maili

Re: Can not Clean Up

2016-12-08 Thread Billy Liu
https://github.com/apache/kylin/blob/master/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/StorageCleanupJob.java For 1.5.4, it should still be org.apache.kylin.storage.hbase.util.StorageCleanupJob For 1.6+ it would be org.apache.kylin.tool.StorageCleanupJob 2016-12-08 18:13 GMT+

Update default config for sandbox environment

2016-12-08 Thread Billy Liu
Hi dev community, Most users deploy Kylin on their own sandbox for the first trial. Most sandbox has most 8G memory. The most used sandboxes are HDP sandbox and CDH sandbox. We'd better make the default kylin configuration convenient for these sandbox environment. The suggestion includes reducing

Re: Issues in building cubes of Apache Kylin

2016-12-08 Thread Billy Liu
.SLF4JLogFactory. > getInstance(SLF4JLogFactory.java:155) > > at org.apache.commons.logging.impl.SLF4JLogFactory. > getInstance(SLF4JLogFactory.java:132) > > at org.apache.commons.logging.LogFactory.getLog(LogFactory. > java:657) > > at org.apache.h

Re: Update default config for sandbox environment

2016-12-08 Thread Billy Liu
Besides the default value change, I could draft a document introducing the current default configuration, and give some advice for larger cluster deployment. 2016-12-08 20:40 GMT+08:00 roger shi : > Agree. Better task parallelization for sandbox environment. > > On 08/12/2016, 6:30 P

Re: Date error when query streaming cube

2016-12-08 Thread Billy Liu
Thanks for the reporting. Could you provide more information? including Kylin server timezone, kylin.web.timezone. 2016-12-09 9:46 GMT+08:00 汪胜 : > Sorry for that. I used JDBC and Kylin Web to test the sql query for > streaming cube, but the records came from JDBC and Kylin Web are incorrect. > A

Re: Re: Date error when query streaming cube

2016-12-08 Thread Billy Liu
How about your server timezone? Is your server at the right time? Try run 'date' on your server. 2016-12-09 13:58 GMT+08:00 汪胜 : > I only changed "kylin.rest.timezone=GMT" to "kylin.rest.timezone=GM+8" in > file "kylin.properties", and I don't know kylin.web.timezone, this > propertiey should be

Re: Issues in building cubes of Apache Kylin

2016-12-08 Thread Billy Liu
Glad to hear it. 2016-12-09 14:14 GMT+08:00 Tarun Vashisth : > Thanks Billy for your help. > > Indeed, It was a configuration issue with hadoop. We were able to resolve > it and now Apache Kylin is working fine. > > > Regards, > > Tarun > > _____

Re: Re: Re: Date error when query streaming cube

2016-12-08 Thread Billy Liu
Could you file an JIRA for this issue? The segment time may not process properly. 2016-12-09 14:26 GMT+08:00 汪胜 : > Yes, server date is same with PC date. And I didn't found this situation > in Kylin 1.5.*. I'm confused that cube's Last Build Time and Create Time > displayed on Kylin Web are sam

Re: Update default config for sandbox environment

2016-12-09 Thread Billy Liu
Filed KYLIN-2265, and patch attached. 2016-12-08 22:20 GMT+08:00 Billy Liu : > Besides the default value change, I could draft a document introducing the > current default configuration, and give some advice for larger cluster > deployment. > > 2016-12-08 20:40 GMT+08:00 roger s

Re: Create Aggr Func(SUM,MIN,MAX) For Every Measure

2016-12-13 Thread Billy Liu
Maybe you could edit the cube json directly, but be careful always. 2016-12-13 15:30 GMT+08:00 汪胜 : > Hello all, > I have many measures(about fifty), and I have to create SUM, MIN and > MAX for every measure. Is there any good ways to create them at a time > instead of create one by one? > >

Re: Load Hive Table Error

2016-12-13 Thread Billy Liu
Thanks Mars for the reporting. The NPE should be some kinds of bug. Will look into it. 2016-12-13 11:33 GMT+08:00 Mars Xu : > Hello all, > >After I test the feature of more robust approach for hive schema > change in version 1.6. I have some tests as follow: > > 1. Load a fact tabl

Re: Load Hive Table Error

2016-12-13 Thread Billy Liu
:40 GMT+08:00 Billy Liu : > Thanks Mars for the reporting. The NPE should be some kinds of bug. Will > look into it. > > 2016-12-13 11:33 GMT+08:00 Mars Xu : > >> Hello all, >> >>After I test the feature of more robust approach for hive schema >> chang

Re: build cube error

2016-12-16 Thread Billy Liu
Please google first. It's not Kylin's issue. Someone asked before. 2016-12-16 16:44 GMT+08:00 bingdianlieshou <804460...@qq.com>: > my kylin version: apache-kylin-1.6.0-hbase1.x-bin > hadoop version: hadoop-2.7.3 > hive version : apache-hive-2.1.1-bin > hbase version: hbase-1.2.4 > > and my erro

Fwd: [NOTICE] - analysis.apache.org closing down 14th January

2016-12-18 Thread Billy Liu
It seems Kylin could have better infra if we leverage build.apache.org also. -- Forwarded message -- From: Julian Hyde Date: 2016-12-18 8:08 GMT+08:00 Subject: Fwd: [NOTICE] - analysis.apache.org closing down 14th January To: d...@calcite.apache.org FYI - it is going to get easi

Re: [DISCUSS] Call the next release v2.0?

2016-12-18 Thread Billy Liu
+1 If possible, I will suggest shifting the master branch to HBase 1.X since 2.0. It will be more convenient for snapshot release test. 2016-12-19 14:23 GMT+08:00 Li Yang : > Guys, > > I'm thinking maybe it's time to call the next release v2.0. Like to hear > your thoughts. > > Actually the curr

Re: [Discuss] Disable/hide "RAW" measure in Kylin web GUI

2016-12-19 Thread Billy Liu
The experimental mode is system wide feature toggle. I think case by case is more flexible. Most new features could have toggles, default are off. 2016-12-19 21:40 GMT+08:00 Luke Han : > Beta or Experimental will also bring confusing for most of users. > > Maybe we could have something called "ex

Re: kylin 1.6 supports SQL right join

2016-12-20 Thread Billy Liu
Kylin supports left join and inner join. The right join could be rewritten into left join. Could you have a try? 2016-12-21 11:52 GMT+08:00 wang...@snqu.com : > Hi > when I excute the sql: > (select t3.CATE1,count(*) from (select CATE1 ,CATE2 from > kylinlabel.USER_TAG group by CATE1 ,CATE

Jenkins & SonarQube for Apache Kylin are ready

2016-12-28 Thread Billy Liu
Hi Dev team, Thanks the Apache INFR team, now we have set up the Jenkins Build Test Job and Static Code Analysis Service SonarQube for Kylin on Apache servers. Here are two build jobs, with be triggered by each commit: Build against JDK 1.7 with master branch: https://builds.apache.org/job/Kylin-

Re: [Announce] New Apache Kylin committer Kaisen Kang

2017-01-03 Thread Billy Liu
Congrats, welcome Kaisen. 2017-01-03 19:12 GMT+08:00 Luke Han : > On behalf of the Apache Kylin PMC, I am very pleased to announce > that Kaisen Kang has accepted the PMC's invitation to become a > committer on the project. > > We appreciate all of Kaisen's generous contributions about many bug >

Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary

2017-01-04 Thread Billy Liu
When you describe some problem, make sure you have all steps to reproduce the issue. Otherwise no one would know what happened. I remembered you mention that you deleted some files manually on HDFS by yourself in some JIRA. 2017-01-05 13:12 GMT+08:00 446463...@qq.com <446463...@qq.com>: > Hi all:

Re: Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary

2017-01-04 Thread Billy Liu
So could you reproduce your issue step by steps with sample data? 2017-01-05 14:53 GMT+08:00 446463...@qq.com <446463...@qq.com>: > Yes,but it is not work.In kylin webUI console it still throw this error > On Build Dimension Dictionary in Step 4. > > > > 446463...@qq

Re: Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary

2017-01-05 Thread Billy Liu
naries > Column Builder Class > rowkey org.apache.kylin.dict. > GlobalDictionaryBuilder > > > I do this beacuse in my query sql "select count(distinct(rowkey)) from > user_info group by ".\ > I don't kown I Whether or not it cle

Re: Hive Table is not loaded in Kylin

2017-01-07 Thread Billy Liu
Please check the classpath carefully, maybe some other Hive lib has higher priority than the right "hive-exec-1.2.1.jar" 2017-01-06 17:34 GMT+08:00 vinky : > hello, I can access from Hive console and do queries on it sucecssfully > using hive console. When I try to synch hive table using Kylin we

Re: Cube build error @First Step : DFS Command incompatible with Ranger

2017-01-12 Thread Billy Liu
dfs command is used to generate the count result when creating flat table. The good news is KYLIN-2165(https://issues.apache.org/jira/browse/KYLIN-2165) remove the dependency with "dfs -mkdir", it will be released in 2.0. The code is ready at the master branch. 2017-01-12 16:23 GMT+08:00 Geki : >

Re: how to query fields with keywords

2017-01-14 Thread Billy Liu
The Uppercase will work for Calcite reserved words 2017-01-14 0:04 GMT+08:00 nichunen : > Typo. > > > 2. Use TheTable.’KEYWORD’ in your sql > 3. Use TheTable.”KEYWORD” in your sql > > > > George/倪春恩 > > Mobile:+86-13501723787| WeChat:nceecn > > 北京明略软件系统有限公司(MiningLamp.COM > ) > > > > > > 上海市浦东新

Re: NotServingRegionException, My EMR CLuster lost two nodes, when we restart the machine,I find hbase is ok,but kylin is error.How can i do?

2017-01-16 Thread Billy Liu
As the exception said, the region server is not available. Please check the HBase first. 2017-01-16 17:46 GMT+08:00 张磊 <121762...@qq.com>: > Mon Jan 16 01:37:14 PST 2017, RpcRetryingCaller{globalStartTime=1484559434275, > pause=3000, retries=5}, org.apache.hadoop.hbase.NotServingRegionException:

Re: Streaming Cube Bulkload

2017-01-18 Thread Billy Liu
Could you check the region server healthy first? 2017-01-18 20:30 GMT+08:00 Mario Copperfield : > At the step of Load HFile to HBase Table, sometimes it will occur > exception as follow: > > > java.io.IOException: BulkLoad encountered an unrecoverable problem >at org.apache.hadoop.hbase.m

Error message in AppendTrieDictionaryTest

2017-01-19 Thread Billy Liu
Hi Yerui, >From the travis UT log, although all tests passed, but still some error log, could you please check if these are false positive warning? https://s3.amazonaws.com/archive.travis-ci.org/jobs/193325284/log.txt 2017-01-19 09:49:10,806 WARN [main FSInputChecker:157]: Problem opening check

Re: build kylin code exception

2017-01-21 Thread Billy Liu
Please run the build command at kylin root path. If you want to build some submdoule, please run something like 'mvn compile -pl jdbc'. 2017-01-21 17:39 GMT+08:00 ShaoFeng Shi : > Please check this doc to see whether it helps: > https://kylin.apache.org/development/dev_env.html > > > 2017-01-21 8

Re: Proposal for updating master branch to use HBase 1.x

2017-01-25 Thread Billy Liu
+1, nice work. 2017-01-25 15:59 GMT+08:00 Yerui Sun : > +1 > > Use hbase 1.x as default version really make sense. > > However, we also should support 0.98 version as past, since upgrading is > not easy in some production environments. > > > 在 2017年1月23日,11:41,nichunen 写道: > > > > +1 > > > > Hba

Re: Can not build sample cube

2017-02-07 Thread Billy Liu
Kylin should be installed at the Hadoop client/edge node, as it will load the necessary Hadoop configuration from the environment. Only the customized config files locate at kylin conf directory. The default Hadoop configuration(*-site.xml) should exist at the Hadoop client node. You could check th

Re: Can not build sample cube

2017-02-13 Thread Billy Liu
result: true > 2017-02-13 12:46:54,018 DEBUG [pool-9-thread-10] dao.ExecutableDao:210 : > updating job output, id: 60821d3b-6a2f-4789-a675-85d4109c4ed8 > 2017-02-13 12:46:54,019 DEBUG [pool-9-thread-10] > hbase.HBaseResourceStore:262 : Update row > /execute_output/60821d3b-6a2f-4789-a675-85d4109c4ed8 > from o

Re: kylin sql query with Weird error

2017-02-16 Thread Billy Liu
Could you reproduce this issue on the sample cube? That would help the dev team to identify the root cause quickly. 2017-02-16 20:30 GMT+08:00 xl l : > HI, I am sure hbase is ok. > 而且只有这个sql抛异常,且能稳定复现。 sql稍微改一下,就正常。 > > 从异常日志看, 首先抛出异常的是 > Caused by: java.lang.NullPointerException > at com.google.

Re: Caused by: java.lang.ClassNotFoundException: com.codahale.metrics.Gauge

2017-02-16 Thread Billy Liu
The root cause is clear as the log said: ClassNotFoundException: com. codahale.metrics.Gauge The codehale metrics-core library should be on the Hive classpath. 2017-02-16 20:15 GMT+08:00 zhangtianyu...@chinasofti.com < zhangtianyu...@chinasofti.com>: > hi: > I don't know why this is the case

Re: kylin sql query with Weird error

2017-02-17 Thread Billy Liu
The Query works fine on the latest master, could not be reproduced. It returns 255 records: Toys & Hobbies 59.5137 1 Toys & Hobbies 87.3074 1 Toys & Hobbies 177.3848 3 Toys & Hobbies 59.9071 2 Toys & Hobbies 128.2840 3 2017-02-17 12:40 GMT+08:00 xl l : > hi,Billy Liu >

Re: query meet java heap space,help!

2017-02-17 Thread Billy Liu
You'd better define the distinct count as a measure, with Error Rate < 9.75%, and have a try. 2017-02-17 16:05 GMT+08:00 yangchao : > PS: > if I remove distinct count condition, it can work! > > -- > View this message in context: http://apache-kylin.74782.x6. > nabble.com/query-meet-java-heap-spa

Re: .jHist file got deleted on /user/kylin/.staging/ directory

2017-02-17 Thread Billy Liu
You could discard the failed build job and rebuild that segment, instead of purging the whole cube. 2017-02-14 19:33 GMT+08:00 ketan dikshit : > Hi Guys, > The required .jHist file that the cube build,refresh,merge jobs wants to > search is not available, and we get this error; > > java.io.FileNo

Re: kylin sql query with Weird error

2017-02-17 Thread Billy Liu
is ok. > So the solution is to upgrade hbase version, thanks billyliu 。 > > 2017-02-17 17:49 GMT+08:00 Billy Liu : > > > The Query works fine on the latest master, could not be reproduced. It > > returns 255 records: > > > > Toys & Hobbies > > 59.513

Re: No result from JDBC with Date filter in prepareStatement

2017-02-22 Thread Billy Liu
Please check if this thread could help you: http://apache-kylin.74782.x6.nabble.com/JDBC-query-result-Date-column-get-wrong-value-td5370.html 在 2017年2月22日 下午8:37,程 万胜 写道: > 大家好: > > 用kylin的JDBC查询,查询条件是date类型的,如果通过prepareStatement、setDate是查询不出数据 > 的,然而直接用SQL可以查出数据 > > 我用的是kylin版本:apache-kylin-1.6.

Re: Problem while build cube:File not found for hdfs://...

2017-02-22 Thread Billy Liu
google 'HDP sandbox download' will lead you to the right place. 2017-02-21 17:59 GMT+08:00 排骨瘦肉丁 <153563...@qq.com>: > Neither CDH nor HDP, > i download it from http://hadoop.apache.org/releases.html > where can i download CDH or HDP version ? > > -- > View this message in context: http://apache-

Re: cube build error in step 4

2017-02-22 Thread Billy Liu
"Ask question efficiently" +1 2017-02-22 10:37 GMT+08:00 ShaoFeng Shi : > Hi , > > Sometimes I'd like to help but found the provided information is so > limited; For your question, I hope at least the following info be > provided: 1) kylin/hadoop version 2) error log, especially the exception >

Re: Trouble with building cube at step 3!!cry!cry!

2017-02-22 Thread Billy Liu
+1 I would follow Julian's advice. 2017-02-23 3:13 GMT+08:00 Julian Hyde : > Also, please keep emotions out the subject lines of email. Just state the > problem. > > I personally do not respond to emails that contain exclamation points > (‘!’) or ‘Please help’ or ’This is urgent’. If it is urgen

Re: Apache Kylin 2.0.0 beta is ready for download

2017-02-25 Thread Billy Liu
+1 Thanks Yang, nice work. 2017-02-25 20:41 GMT+08:00 Li Yang : > Dear all, > > Glad to let you know that the Apache Kylin 2.0.0 beta > is ready for download and test. This > is not an official release, but a beta build aims for preview and > collecting feedbac

Re: build cube failed in 3 step,Step Name: Extract Fact Table Distinct Columns

2017-03-01 Thread Billy Liu
Hi Wangxg, As the log said :"Caused by: MetaException(message:Can not create filePath: /user/hive/warehousePermission denied. user=dataprocess_user is not the owner of inode=warehouse" Kylin user(dataprocess_user) will create intermediate table into Hive, but the user does not have enough permiss

Re: Kylin errored when creating HBase of building cude

2017-03-01 Thread Billy Liu
Have you defined some dimensions with Integer encoding, but without entering the integer length parameter? 2017-03-01 17:14 GMT+08:00 ? ? : > Hi Sir, > > > I can build the sample, but when I built my own cube, it errored at step > 6. The error was not at Hadoop MR, but at Kylin itself. The detail

Re: I tried the method to solve ClassNotFoundException:org.apache.hive.hcatalog.mapreduce.HCatInputFormat

2017-03-01 Thread Billy Liu
Deploy CDH or HDP sandbox for a trial is the best practice. 2017-02-27 14:37 GMT+08:00 wfxxh <948718...@qq.com>: > my env is hadoop2.5.1,hbase1.2.2,hive1.2.1,kylin1.6.0.export > HADOOP_HOMEexport HBASE_HOMEexport HIVE_HOMEexport HCAT_HOMEexport > KYLIN_HOMEwhen I create the sample Cube by the kyl

Re: Error while cube refreshing using REST API

2017-03-01 Thread Billy Liu
It's not a bug, as the exception message is clear "NO match segment", please check your parameter and figure out which segment you were refreshing. One more thing, please do not open JIRA for questions. 2017-02-28 19:06 GMT+08:00 suresh m : > Hi, > > Getting below error While refreshing cube wi

Re: kylin jdbc meet exception

2017-03-11 Thread Billy Liu
Could you make the reproduce much easier? In your case, we could not know what's inside " conn = driver.connect(aresDataSourceConfig.getUrl(), kylinRepoDO.getProperties()); state = kylinRepoDO.getState(); logger.info(request.getSql()); rs = state.executeQuery(r

Re: Fw: Not able to connect Kylin from Modrian

2017-03-15 Thread Billy Liu
You are running quite old libraries. Please upgrade kylin jdbc and try this mondrian library: https://github.com/Kyligence/kylin-mondrian 2017-03-14 19:30 GMT-07:00 hada : > Did you solve the problem? I also encountered this problem > > -- > View this message in context: http://apache-kylin.74782

Re: kylin jdbc meet exception

2017-03-19 Thread Billy Liu
Could you prepare the code which could reproduce the issue? 2017-03-19 1:36 GMT-07:00 yangchao : > private KylinRepoDO makeKylinRepoDO() { > KylinRepoDO kylinRepoDO = null; > try { > driver = (Driver) > Class.forName(aresDataSourceConfig.getDriverClassName()).newInstan

Re: About Aggregation Group

2017-03-31 Thread Billy Liu
Have you read this article? http://kylin.apache.org/blog/2016/02/18/new-aggregation-group/ 2017-04-01 2:26 GMT+08:00 rahulsingh : > Hi all, > > I have an issue regarding aggregation group of Kylin. I have built cube two > times with two differrent scenarios that are. > In first time I have mentio

Re: Question regarding topN measure on string column

2017-03-31 Thread Billy Liu
group by SUM, or group by COUNT is reasonable and supported. There is no order by name alphabetical support. 2017-03-31 20:16 GMT+08:00 hongbin ma : > ​hi, > > i believe it's not supported. besides, how do you define "order" on string? > I don't think it's a reasonable requirement > > -- > Regard

Re: 请教关于KYLIN JDBC中对于Date维度的PreparedStatement问题

2017-04-06 Thread Billy Liu
consider this thread first: http://apache-kylin.74782.x6.nabble.com/JDBC-query-result-Date-column-get-wrong-value-td5370.html 2017-04-05 22:24 GMT+08:00 zhongyuhai <199526...@qq.com>: > 你好: > > 代码如下 > > Driver driver = (Driver) > Class.forName("org.apache.kylin.jdbc.Driver").newInstance(); >

Re: Creating Snowflake schema / Link 2 Cubes

2017-04-09 Thread Billy Liu
Please download the latest 2.0 beta2, and have a try. The feedback is very welcomed. 2017-04-08 19:32 GMT+08:00 Bart : > OK. > I see that Kylin 2.0 will resolve my problem. I'm gonna wait :) > > -- > View this message in context: http://apache-kylin.74782.x6. > nabble.com/Creating-Snowflake-schem

Re: Dual timestamp columns support in 2.0, Fact table Partitioned on ingestion date, aggregate on event date

2017-04-16 Thread Billy Liu
Hi Junhai If you want to build the late arrived data, you have to refresh to cube manually or calling refresh API. Kylin would not monitor the ingestion timestamp. 2017-04-13 22:07 GMT+08:00 Junhai Guo : > My hive fact table is partitioned on ingestion date column, but I need to > build cube and

Re: Dual timestamp columns support in 2.0, Fact table Partitioned on ingestion date, aggregate on event date

2017-04-17 Thread Billy Liu
ange" sounds a good idea, could you please > open a JIRA to track this? We can discuss this in detail on JIRA. > > > 2017-04-17 11:30 GMT+08:00 Billy Liu : > > > Hi Junhai > > > > If you want to build the late arrived data, you have to refresh to cube >

Re: Hi PMS, Do you can add me as contributor for kylin and assign the https://issues.apache.org/jira/browse/KYLIN-2557, which I reported, to me? For KYLIN-2557 I had submitted patch, created its RR an

2017-04-20 Thread Billy Liu
Currently, JIRA could not find the right user by name "peng.jianhua". Is this the name you login JIRA system? 2017-04-21 9:18 GMT+08:00 : >

Re: Rowkey in Advance Setting of Cube

2017-04-21 Thread Billy Liu
If you delete the normal dimensions from cube, the dimension in row key will be deleted also. 2017-04-21 18:27 GMT+08:00 rahulsingh : > Hi All, > > I am totally confused about Rowkey in Advance Setting of Cube. > > I am deleting some dimensions from Rowkey and save the Cube, then I see the > cube

Re: 答复: [VOTE] Release apache-kylin-2.0.0 (RC1)

2017-04-23 Thread Billy Liu
+1 (no binding) mvn test passed md5 verified with Java 1.8.0_91-b14 on MacOS 10.12.4 2017-04-22 21:19 GMT+08:00 ShaoFeng Shi : > Verified the md5 and sha1 hash; verified the signature. > "mvn test" passed with Java 1.8.0_111 on MacOS 10.12 > > Here is my vote: > > +1 (binding) > > > 2017-04-22 1

Re: [Announce] New Apache Kylin committer Roger Shi

2017-04-29 Thread Billy Liu
Welcome Roger. 2017-04-29 22:19 GMT+08:00 ShaoFeng Shi : > Welcome Roger! > > 2017-04-29 19:46 GMT+08:00 Dong Li : > >> Welcome! >> >> >> Thanks, >> Dong Li >> >> >> Original Message >> Sender:Li yangliy...@apache.org >> Recipient:dev...@kylin.apache.org >> Cc:useru...@kylin.apache.org; Apache Ky

Re: [Announce] New Apache Kylin committer Alberto Ramón

2017-04-29 Thread Billy Liu
Welcome Alberto! 2017-04-29 22:19 GMT+08:00 ShaoFeng Shi : > Welcome Alberto! > > 2017-04-29 19:47 GMT+08:00 Dong Li : > > > Welcome! > > > > > > Thanks, > > Dong Li > > > > > > Original Message > > Sender:Li yangliy...@apache.org > > Recipient:privatepriv...@kylin.apache.org > > Cc:dev...@kylin.

Re: [Announce] New Apache Kylin committer Zhixiong Chen

2017-04-29 Thread Billy Liu
Welcome Zhixiong! 2017-04-29 22:19 GMT+08:00 ShaoFeng Shi : > Welcome Zhixiong! > > 2017-04-29 20:04 GMT+08:00 Alberto Ramón : > >> Congratulations to Roger Shi and Zhixiong!! (and Dev team for next 2.0 >> version) >> >> If you are ever near London or Spain, let me know, have beer will be >> ne

Re: Fail to extract disctinct columns from fact tables

2017-05-07 Thread Billy Liu
Hi Shaofeng, Do you think the method "HiveConf.setLoadMetastoreConfig(true);" is the common approach to fix this issue? If so, we'd better file new JIRA for this one. 2017-05-06 22:58 GMT+08:00 ShaoFeng Shi : > Hi Hong Wei, > > That's cool, thanks for the update and detail summary! > > For the i

Re: How do I deploy kylin when I have a Hadoop environment

2017-05-08 Thread Billy Liu
You question has been answered by Li Feng on May 4. Please do not ask the same one again. 2017-05-09 12:41 GMT+08:00 john-126 : > Dear Dev: > >How do I deploy kylin when I have a Hadoop environment!Please give > me a plan and suggestion。 > > > >My Hadoop environment: > >ha

Re: BadQueryDetector (Please ignore the last post)

2017-05-08 Thread Billy Liu
Have you checked the “Direct Mode” on Tableau? Have you asked for help from Tableau community? 2017-04-25 23:12 GMT+08:00 rahulsingh : > Hi all, > > We are using Tableau Desktop 10.2.1 with Kylin 1.6. We got success to > connect kylin with tableau wia ODBC driver. > We have one table in kylin hav

Re: how to build source by myself

2017-05-09 Thread Billy Liu
To build the source, please check http://kylin.apache.org/development/howto_package.html 2017-05-05 18:38 GMT+08:00 Chao(data) Li : > hello: > I have a question about how can i extend my functions according to > my need ? Because when i finished the extension code i don’t know if i can >

Re: java.sql.SQLException: Error while executing SQL "select count(*) from optionaction LIMIT 50000": null

2017-05-10 Thread Billy Liu
You hit the issue https://issues.apache.org/jira/browse/KYLIN-1749 It's not about how the filter defines, but the mandatory dimension chosen. 2017-05-10 15:50 GMT+08:00 35925138 <35925...@qq.com>: > 能告诉我产生这个错误可能的原因也可以。 > > > > > -- 原始邮件 -- > 发件人: "35925138";<35925

Re: java.sql.SQLException: Error while executing SQL "select count(*)from optionaction LIMIT 50000": null

2017-05-10 Thread Billy Liu
问题的描述也不是我这个问题吧 > > > > > -- 原始邮件 ---------- > 发件人: "Billy Liu";; > 发送时间: 2017年5月10日(星期三) 下午5:40 > 收件人: "dev"; > > 主题: Re: java.sql.SQLException: Error while executing SQL "select > count(*)from optionaction LIMIT 5"

Re: Read write isolation; Availability of cube for query while rebuild/refresh

2017-05-11 Thread Billy Liu
If multiple cubes could answer the same query, such as the clone ones, Kylin will route the query to the cube who has the lowest query cost. The query cost is computed by dimensions complexity, not query latency. 2017-05-12 9:23 GMT+08:00 Nirav Patel : > Is it achieve via following steps? > > >

Re: A problem in cube moving

2017-05-11 Thread Billy Liu
Copy from Shaofeng‘s reply "Hi, To migrate/move a cube from staging Kylin to production Kylin, you can use the tool CubeMigrationCLI, e.g, on v2.0, run : $KYLIN_HOME/bin/kylin.sh org.apache.kylin.tool.CubeMigrationCLI it will print out the usage info. Follow the instruction to go ahead. (in 1.x

Re: Review patch

2017-05-14 Thread Billy Liu
Hi Alberto, Could you send out the document on Google Drive for review? The patch is not easy to read for long article. 2017-05-14 16:45 GMT+08:00 Li Yang : > Forward to dev for wider audience. > > > -- Forwarded message -- > From: Alberto Ramon > Date: Sat, May 13, 2017 at 5:32

Re: 您好,我是kylin的使用者,有个问题想问您。

2017-05-17 Thread Billy Liu
When you talk about something wrong, or unexpected, you'd better show very detail what you have done, what messages you got, and what the expected result you wish. Let's others could reproduce your issue by following the same steps. 在 2017年5月17日 上午9:42,1309696792 <1309696...@qq.com>写道: > 您好,我现在在使

Re: query with timestamp error?

2017-05-18 Thread Billy Liu
Your description is not clear enough. What's the cube desc json? What's the exception message? What's the sample data structure and column data? 2017-05-18 11:41 GMT+08:00 446463...@qq.com <446463...@qq.com>: > Hi: > I build a cube and use timestamp(-MM-dd) with a dimension in mine cube > . >

Re: kylin cube dimension 改动问题

2017-05-19 Thread Billy Liu
A few suggestions: 1. Use View instead Table, View could help you isolate the underlying table changes and keep the data model stable. 2. If column added only, you could sync the table, edit the cube and continue build the new segment. 在 2017年5月19日 下午2:42,elicer 写道: > Hi All: > 如果大家的报表字段改动比较平凡的话

Re: Is kylin support kerberos while using cube connecting to HBASE?

2017-05-19 Thread Billy Liu
I think so. Have you give the proper kerberos token to the current user? 2017-05-18 17:10 GMT+08:00 ran gabriele : > Hello, > > > I am using kylin 2.0.0 for CDH 5.7/5.8. My cluster is configured with > kerberos as certification. > > > Here I got the error log. > > > 17/05/17 17:25:16 WARN ipc.Rpc

Re: kylin cube dimension 改动问题

2017-05-19 Thread Billy Liu
I may made some mistakes in my above reply. I don't remember every detail very clearly. If the cube has existing segments, it's not allowed to edit. You have to clone the cube and edit it. 2017-05-19 16:16 GMT+08:00 elicer : > For answer2:If I modify the cube and continue the cube build only the

Re: A problem in cube migration

2017-05-21 Thread Billy Liu
Hi Zhuoran, Are you still blocked by this issue? I tried to reproduce it, but failed. 2017-05-19 16:16 GMT+08:00 吕卓然 : > Hi all, > > > > Currently I am using Kylin2.0.0 with CDH 5.8. I’m trying to migrate cubes > from one kylin server to another. Below is my command to migrate the cube: > > bin/

Re: 答复: A problem in cube migration

2017-05-22 Thread Billy Liu
Thanks for updating. 2017-05-22 16:03 GMT+08:00 吕卓然 : > Hi Billy, > > > > I already solved it. This is because of my Hadoop Env. > > > > Thanks, > > Zhuoran > > > > *发件人:* Billy Liu [mailto:billy...@apache.org] > *发送时间:* 2017年5月22日 11:06 > *收件

Re: Container complete event for unknown container id

2017-05-22 Thread Billy Liu
Please check if your YARN container has enough resource for MR jobs. By default, if in-memory build is used, kylin_job_conf_inmem.xml will ask for 3072MB for MapReduce Job. You could reduce the number. 2017-05-22 21:59 GMT+08:00 446463...@qq.com <446463...@qq.com>: > I found that at MR log > > C

Re: The problem of Kylin version

2017-05-23 Thread Billy Liu
Kylin CDH distribution could works well on CDH 5.7+, I have verified it on CDH 5.11. For usage questions, user mailer is the best channel. I removed other personal email address. 2017-05-22 16:18 GMT+08:00 蔡少武 <413000...@qq.com>: > Hi: > I am a Kylin user,Now I have a question about the Kylin

Re: How can I use substr function in query or find an alternative way

2017-05-25 Thread Billy Liu
A better way is to define PERIOD in your Hive view, and load the Hive view as the fact table. 2017-05-25 14:47 GMT+08:00 jiawei chen : > Hi kylin's developers, > I am using kylin-1.6.0 now. I have to use a sql query like: > > SELECT > SUBSTR(TO_CHAR(`time`,'MMDDHH24MISS'),9,2) AS PERIOD,

Re: Encounter cube merge error when deploy kylin on stand alone hbase cluster

2017-05-25 Thread Billy Liu
It seems a bug. Could you open a JIRA for issue? 2017-05-26 11:03 GMT+08:00 suheng.cloud : > Hi all : > > I try to deploy kylin on one node of a stand alone hbase > cluster(hdfs://cdh5-mini/) which seperate from main hive > cluster(hdfs://cdh5/), > According to the blog "Deploy Apache Kylin with

Re: When cube modified,can we query from all new and history segment without purge data?

2017-06-01 Thread Billy Liu
https://issues.apache.org/jira/browse/KYLIN-2317 provides CLI tools 2017-06-01 15:59 GMT+08:00 ShaoFeng Shi : > Suheng, thanks for your suggestion, yes they should be linked in the > documentation, we will do that. > > 2017-06-01 15:48 GMT+08:00 suheng.cloud : > > > Thanks, shaofeng ,it works. >

Re: kylin与tableau9集成问题

2017-06-05 Thread Billy Liu
Your picture could not display. Could you see the tables in Kylin "Insight" page? 在 2017年6月5日 上午11:36,梁永雄 写道: > 你好,kylin在与tableau9.1集成的时候,kylin的配置我更改了kylin.source.hive. > database-for-flat-table=kylin,目前tableau连接kylin正常,build cube也成功了 > 且tableau能正常连接kylin > > 为何会出现无法找到数据表的情况呢?难道数据源只能是在hive的defau

Re: Kylin2.0.0在Spark模式下报Class未注册的问题

2017-06-05 Thread Billy Liu
This is known issue. Could you try the latest code on the master branch? It should be fixed already. https://issues.apache.org/jira/browse/KYLIN-2592 2017-06-06 10:00 GMT+08:00 凡梦星尘 : > Hi guys: > > 按照官方的参考:https://kylin.apache.org/docs20/tutorial/cube_spark.html > 尝试最新的版本的KYLIN2.0.0版本下的Spark模式,

Re: KYLIN 2.0.0 java.util.NoSuchElementException bUG

2017-06-08 Thread Billy Liu
The description is not accurate enough. When you say something wrong, you need tell others how to reproduce your issue on other's environment. 2017-06-08 18:39 GMT+08:00 梁永雄 : > 下面是我的cube,build后出现 > > { > "uuid": "cdd44345-88b7-42dd-a58e-44eaec1f1a9d", > "last_modified": 1496915989310, > "v

Re: Kylin go to hdfs to find jar file

2017-06-11 Thread Billy Liu
Please check the find-hive-dependency.sh, make sure the hive_dependency works as expected. 2017-05-31 21:58 GMT+08:00 柴诗雨 : > hello,here is my question: > I try to use kylin, here is my install enviroment: > > > apache hadoop 2.7.3 > apache hbase 1.3.0 > apache hive 2.1.1 > apache kylin 2.0.0 > >

  1   2   3   4   >