Re: Kylin authorization and roles/LDAP

2015-12-12 Thread Shaofeng Shi
I planned to write a doc on this, but seems it need be prioritized now. Marek Wiewiorka 编写: >Hi All - I managed to get LDAP authentication working but I'm unable to setup >proper authorization. > > >Does anybody of you got it working properly - roles mapping, privileges on >cubes with LDAP? >

Re: Kylin authorization and roles/LDAP

2015-12-13 Thread ShaoFeng Shi
question 2), I didn't get your point, a sample case should be helpful. 2015-12-12 22:03 GMT+08:00 Marek Wiewiorka : > I would be extreme grateful!!! > In the first place if you could please write a few hints on how to > configure cubes ACLs + admin role mapping with LDAP. > > Ma

Re: Kylin authorization and roles/LDAP

2015-12-14 Thread ShaoFeng Shi
eant is that cubes ACL do not work for me as well. >> I'm calling REST api with a sql query with a user that isn't in any ACL - >> so does not have even read right. >> User is authenticated using LDAP, isn't a member of any group, default >> acl role isn't

Re: Kylin authorization and roles/LDAP

2015-12-15 Thread ShaoFeng Shi
nual :) >> >> Thanks again! >> Marek >> >> 2015-12-14 15:58 GMT+01:00 ShaoFeng Shi : >> >>> Hi Marek, >>> >>> If you're familiar with Spring Security framework, the "ROLE_" prefix is >>> added by that when conver

Re: hbase and hive use different hdfs

2015-12-22 Thread ShaoFeng Shi
2015年12月21日,16:16,Gqchen 写道: > > > > HI: > > > > I had installed Hbase on aHDFS hdfs://ip1/ ; But hive on another > HDFS hdfs://ip2/ > > It seemed Kylin does not work in ecviroment like this. > > How can I resolve it , reinstall Hive and Hbase on the same HDFS? > > -- Best regards, Shaofeng Shi

[ANNOUNCE] Apache Kylin 1.2 released

2015-12-22 Thread ShaoFeng Shi
The Apache Kylin team is pleased to announce the immediate availability of the 1.2 release. The release note can be found here [1]; The source code and binary package can be downloaded from Kylin's download page [2]. The Apache Kylin Team would like to hear from you and welcomes your comments and

Re: how to load table from hive

2015-12-25 Thread ShaoFeng Shi
> DataNucleus.Persistence: Property hive.metastore.integral.jdo.pushdown >> unknown - will be ignored >> ... >> 2015-12-24 15:01:24,350 INFO [http-bio-7070-exec-6] >> metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is DERBY >> >> I'm not sure these ignored property is OK or not. >> I config Hive as remote mode(use mysql to store metadata, config thrift >> uris) but kylin try to access DERBY which I do not use ! >> >> Could you tell me how to config it ? >> > > -- Best regards, Shaofeng Shi

Re: Step 2 (failed) : Extract Fact Table Distinct Columns

2015-12-30 Thread ShaoFeng Shi
[DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)] > - Saving resource /execute_output/2adf81ed-b19a-4b2f-8035-27b3a2184cac-01 > (Store kylin_metadata@hbase) > -- Best regards, Shaofeng Shi

Re: Cube Designer Advanced Setting

2015-12-30 Thread ShaoFeng Shi
s just a curiosity for me. > -- Best regards, Shaofeng Shi

Re: configuration for HBase region count

2016-01-04 Thread ShaoFeng Shi
K9 > >- Region Count: 979 >- Size: 5.75 TB >- Start Time: 2011-12-31 00:00:00 >- End Time: 2014-05-01 01:00:00 > > The region count is 979 which is definitely larger than > > 500. Does it mean that the setting actually did not work? > > > > Best regards, > > Zhong > > > -- Best regards, Shaofeng Shi

Re: hierarchy dimension

2016-01-04 Thread ShaoFeng Shi
| null | 524 | null > | > > I’m planning to put “regionname”, “town”, “provincecd”, > “provincename”, “dma_code” and “msa” in a hierarchy dimension. > > Do I understand correctly for the hierarchy dimension? > > Best regards, > > Zhong > > > > > -- Best regards, Shaofeng Shi

Re: Facing issue in installing Kylin in Hbase 1.0.0-cdh5.4.7

2016-01-04 Thread ShaoFeng Shi
World San Jose - Booth #1335. Not registered > yet? Be sure **to use code ZALONI20 to receive 20% off registration! * > > <http://conferences.oreilly.com/strata/hadoop-big-data-ca?cmp=ba-data-confreg-home-stca16_were_sponsoring> -- Best regards, Shaofeng Shi

Re: Need information about getting RESTFULL API for measures and dimension

2016-01-05 Thread ShaoFeng Shi
eive 20% off registration! * > > <http://conferences.oreilly.com/strata/hadoop-big-data-ca?cmp=ba-data-confreg-home-stca16_were_sponsoring> -- Best regards, Shaofeng Shi

Re: Need information about getting RESTFULL API for measures and dimension

2016-01-05 Thread ShaoFeng Shi
You're welcome, now the introduction of this API is added: https://kylin.apache.org/docs/howto/howto_use_restapi.html#get-cube-descriptor 2016-01-06 10:39 GMT+08:00 Sudeep Dey : > Thanks a lot appreciate that. > > Regards > > Sudeep > > On Tue, Jan 5, 2016 at 9:16

Re: HyperLogLogPlusCounter Usage

2016-01-11 Thread ShaoFeng Shi
issue we also calculated uniques across 2016-01-07, > 2016-01-08. It accounts to 164,637,916. Its only when we merge data for > 2016-01-09 we get spurious value. > > 2. Is there any limit on the relative order elements being merged ? > > Regards, > Prashant > -- Best regards, Shaofeng Shi

Re: Performance degradation in cube building.

2016-01-24 Thread ShaoFeng Shi
.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:745) > > > Regards > > Prashant > -- Best regards, Shaofeng Shi

Fwd: [ANNOUNCE] Apache HBase 1.1.3 is now available for download

2016-01-27 Thread ShaoFeng Shi
p;version=12333152 . Thanks to all the contributors who made this release possible! Cheers, The HBase Dev Team -- Best regards, Shaofeng Shi

Re: cube 构建疑惑

2016-01-30 Thread ShaoFeng Shi
for most of the cases, one reducer is okay for merge the distinct values from all dimension columns on fact table; but if there are multiple ultra high cardinality columns, using multiple reducers would gain better concurrency. Actually this is the task I'm doing today, as a part of work for ano

Re: 咨询:hive+hcatalog

2016-01-31 Thread ShaoFeng Shi
Fwd to the mailing list: From the log the root cause is a timeout error when connecting to the mysql database, which your hive configured as the metadata store; Please double check your hive-site.xml; Before running Kylin, make sure your hive has been properly configured, you should be able t

Re: cube 构建疑惑

2016-01-31 Thread ShaoFeng Shi
The screenshot couldn??t be shown up. So far kylin doesn??t support customising mr configurations for each step. You can try to give the reducer more memory in conf/kylin_job_conf.xml as a workaround. Besides, you need consider whether that ultra-high-cardinality column is meaningful as a dime

Re: Kylin LDAP encryption

2016-02-03 Thread ShaoFeng Shi
due to " >>>>>> *PasswordPlaceholderConfigurer*", which tries to decrypt passwords >>>>>> in kylin.properties file. Does this mean passwords like " >>>>>> ldap.password" in kylin.properties should be encrypted ? If so, I >>>>>> hope it's documented in tutorial. >>>>>> >>>>>> // PasswordPlaceholderConfigurer.java:Line71 >>>>>> >>>>>> protected String resolvePlaceholder(String placeholder, Properties >>>>>> props) { >>>>>> >>>>>> if (placeholder.toLowerCase().contains("password")) { >>>>>> >>>>>> return decrypt(props.getProperty(placeholder)); >>>>>> >>>>>> } else { >>>>>> >>>>>> return props.getProperty(placeholder); >>>>>> >>>>>> } >>>>>> >>>>>> } >>>>>> >>>>>> >>>>>> p.s. >>>>>> >>>>>> Kylin Branch: v1.2-release >>>>>> >>>>>> >>>>>> thanks >>>>>> *wu* >>>>>> >>>>> >>> >>> >>> -- >>> >>> *wu* >>> >> >> > -- Best regards, Shaofeng Shi

Re: BadQueryDetector things

2016-02-15 Thread ShaoFeng Shi
Yes. You need check those slow queries, and then optimize either the query or the cube design accordingly; Usually a good query or cube should not read much data into memory;

Re: how to build cube with timer

2016-02-16 Thread ShaoFeng Shi
. > do kylin provide client api? > > -- Best regards, Shaofeng Shi

Re: How to improve the performance of concurrent queries

2016-02-25 Thread ShaoFeng Shi
rs will help. > > On Wed, Feb 24, 2016 at 2:35 PM, 热爱大发挥 <385639...@qq.com> wrote: > >> How to improve the performance of concurrent queries? Increase >> kylin-server node, do load balancing useful? >> > > -- Best regards, Shaofeng Shi

Re: fail to get project after running sample.sh

2016-03-07 Thread ShaoFeng Shi
lin/hbase/hadoop version ? > > 在 2016年3月6日,下午3:31,ianzeng 写道: > > Caused by: com.fasterxml.jackson.core.JsonParseException: Illegal > character ((CTRL-CHAR, code 5)): only regular white space (\r, \n, \t) is > allowed between tokens > > > > -- Best regards, Shaofeng Shi

Re: Build Measures with count distinct high cardinality column

2016-03-10 Thread ShaoFeng Shi
;: > In measures step, I try to count distinct cardinality column (like > user_id), then I found the cuboid size was very large and cast much time. > is deprecated count distinct with the high cardinality column??? > -- Best regards, Shaofeng Shi

Re: Can't translate value 20150731 to dictionary ID

2016-03-10 Thread ShaoFeng Shi
which kylin version are you using? 2016-03-11 10:46 GMT+08:00 Bin.Li : > hello, > > I got this exception: > > org.apache.kylin.cube.kv.RowKeyColumnIO: Can't translate value 20150731 to > dictionary ID > > What's the problem?? > > 20150731 is numberic >

Re: Build Measures with count distinct high cardinality column

2016-03-11 Thread ShaoFeng Shi
ty less than 6) > measures : count (distinctuid), the "uid" 's cardinality about 60 >count (distinct keyword), the "keyword" 's cardinality > about 10 > > cast time:12 MIN > cube size: 765MB > > > > ---

Re: Can't translate value 20150731 to dictionary ID

2016-03-11 Thread ShaoFeng Shi
t; -- 原始邮件 ---------- > *发件人:* "ShaoFeng Shi";; > *发送时间:* 2016年3月11日(星期五) 上午10:51 > *收件人:* "user"; > *主题:* Re: Can't translate value 20150731 to dictionary ID > > which kylin version are you using? > >

Re: failed to build kylin cube

2016-03-18 Thread ShaoFeng Shi
at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2045) > ... 8 more > > > > What should I do to fix this problem ? > -- Best regards, Shaofeng Shi

Re: failed to build kylin cube

2016-03-19 Thread ShaoFeng Shi
3.3-1.cdh5.3.3.p0.5/bin/../lib/hive/lib/ant-1.9.1.jar:/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/bin/../lib/hive/lib/bonecp-0.8.0.RELEASE.jar:/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/bin/../lib/hive/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/bin/../lib/hive-hcatalo

Re: Can I close hyperLogLog Optimizing ??

2016-03-23 Thread ShaoFeng Shi
> thesender by replying to this message and delete this e-mail immediately."* > > > > > On Wed, Mar 23, 2016 at 12:19 PM, Bin.Li wrote: > >> hello, >> >> Can I close hyperLogLog Optimizing ?? (I'm using kylin1.2) >> >> I want to get an accurate data. >> >> >> bin.li >> > > -- Best regards, Shaofeng Shi

Re: How does kylin deal with sub query??

2016-03-23 Thread ShaoFeng Shi
where day = '20160315' > group by channel_id > order by shopper desc > ; > > And sql1, sql2 do can get the same results in hive, but different results > between hive & kylin. > What the problem is ?? > > Many tks!! > > bin.li > -- Best regards, Shaofeng Shi

Re: Apache Kylin--HBase common lib not found

2016-03-24 Thread ShaoFeng Shi
cut -c list [file ...] >cut -f list [-s] [-d delim] [file ...] > hbase-common lib not found > > > Please help me out with this so that i can proceed my work further -- Best regards, Shaofeng Shi

Re: 回复: Re: How does kylin deal with sub query??

2016-03-26 Thread ShaoFeng Shi
I see it, we will check, thank you! Regards, Shaofeng Shi shaofeng...@gmail.com >From Outlook Mobile On Sat, Mar 26, 2016 at 11:08 PM -0700, "Bin.Li" wrote: hello shaofeng.shi, There is the issue I created: https://issues.apache.org/jira/browse/KYLIN-1535 Many

Re: About Kylin Cube list on the Web

2016-03-28 Thread ShaoFeng Shi
"More" Button. there are 2 > reason for my advisement,1)for small pc screen users,the "more" button is > difficult to be found.2)the 1,2,3,..page list sytle is more familiar to > most users. > > Thanks. > -- Best regards, Shaofeng Shi

Re: How can I add read only users for kylin???

2016-03-28 Thread ShaoFeng Shi
16:32 GMT+08:00 Bin.Li : > hello, > > I want to add read only users for kylin, but I cannot find an entry. > > Many tks!! > > bin.li > -- Best regards, Shaofeng Shi

Re: Missing kylin.server.mode entry in conf/kylin.properties

2016-03-29 Thread ShaoFeng Shi
Will add it back in 1.5.1; if absent, kylin will use "all" as the value. You can manually add it if set it with other values. Regards, Shaofeng Shi shaofeng...@gmail.com >From Outlook Mobile On Tue, Mar 29, 2016 at 3:59 PM -0700, "Jins George" wrote: He

Re: faild to take action in kylin 1.5.0

2016-03-30 Thread ShaoFeng Shi
is there any error in kylin.log? 2016-03-30 16:05 GMT+08:00 热爱大发挥 <385639...@qq.com>: > when I do any action, kylin always show me "faild to take action" in > kylin 1.5.0 -- Best regards, Shaofeng Shi

Re: error with TOP_N in kylin 1.5.0

2016-03-30 Thread ShaoFeng Shi
adPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > -- Best regards, Shaofeng Shi

Re: error with TOP_N in kylin 1.5.0

2016-03-30 Thread ShaoFeng Shi
JIRA to add validation for such a case: https://issues.apache.org/jira/browse/KYLIN-1551 Thanks for the reporting. 2016-03-31 11:04 GMT+08:00 ShaoFeng Shi : > Hi, TopN measure need define two parameters, it seems you didn't specify > the second one. The first parameter is the me

Re: error with TOP_N in kylin 1.5.0

2016-03-30 Thread ShaoFeng Shi
, why should I specify a "order by column"? > > > > ------ 原始邮件 -- > *发件人:* "ShaoFeng Shi"; > *发送时间:* 2016年3月31日(星期四) 中午11:04 > *收件人:* "user"; > *主题:* Re: error with TOP_N in kylin 1.5.0 > > Hi, TopN measure need

Re: Stuck with ClassNotFoundException ( HCatInputFormat)

2016-04-02 Thread ShaoFeng Shi
this is a bug in 1.5.0, pls google this error there is a reported JIRA on this, and there is a workaround for it.  Regards, Shaofeng Shi shaofeng...@gmail.com >From Outlook Mobile On Fri, Apr 1, 2016 at 3:57 PM -0700, "Jins George" wrote: Hello Kylin Community

Re: Does INMEM Cubing algorithm release in v1.3?

2016-04-06 Thread ShaoFeng Shi
is " + alg);) > > Is there some docs describ the inmem cubing algorithm ? Is this one ( > http://www.infoq.com/cn/articles/apache-kylin-algorithm)? > -- Best regards, Shaofeng Shi

Re: Does INMEM Cubing algorithm release in v1.3?

2016-04-06 Thread ShaoFeng Shi
g. > > If the in-mem cubing is only available from v1.5.0 , why there some source > code about in-mem cubing shows in v 1.3.0 ? > > I suggest that u can take some comments there to mark that part will not > release in the particular version. > > > 2016-04-06 16:09 GMT+08:

Re: Incremental Build

2016-04-09 Thread ShaoFeng Shi
te-column > partition table when incremental building by date ? > -- Best regards, Shaofeng Shi

Re: unable to login after adding user

2016-04-14 Thread ShaoFeng Shi
LYST" /> > > > > But unable to login. > > > > > > > > > > > > 郑江雨 云平台 > > Phone: 15155195496 > > > -- Best regards, Shaofeng Shi

Re: why I got nothing when I select from KYLIN_SALES

2016-05-03 Thread ShaoFeng Shi
,KYLIN_SALES have the right data. I don't know why? > -- Best regards, Shaofeng Shi

Re: how to set mapreduce.job.queuename of cube job ?

2016-05-04 Thread ShaoFeng Shi
xml and kylin_job_conf.xml , can I set > job parameters when submiting cube job ? > > 2016-05-04 20:04 GMT+08:00 王猛 : > >> >> > -- Best regards, Shaofeng Shi

Re: Scheduling Cube Building Process

2016-05-05 Thread ShaoFeng Shi
for future reference. > > Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur > immédiatement, par retour de courriel ou par un autre moyen. Vous avez > accepté de recevoir le(s) document(s) ci-joint(s) par voie électronique à > l'adresse courriel indiquée ci-dessus; veuillez conserver une copie de > cette confirmation pour les fins de reference future. > > -- Best regards, Shaofeng Shi

Re: Fwd: About the missing build step

2016-05-07 Thread ShaoFeng Shi
couldn't see the screenshot; in the cube, did you define "joint" dimension? Regards, Shaofeng Shi shaofeng...@gmail.com >From Outlook Mobile On Fri, May 6, 2016 at 1:45 AM -0700, "Mars J" wrote: My kylin version is kylin 1.3 . Yes there is a step nam

Re: About Kylin Dimension Definition

2016-05-09 Thread ShaoFeng Shi
-> level3), I said it has 4 dims in the >> traditional BI way, but in kylin ,it's 10 dims. >>In kylin 1.5.1, I can't create hierachy dims directly, but I can >> create it for derived dims or normal dims first, then in the aggregroup , >> make it to hierachy dims. but I don't know how to count it in traditional >> BI way. >> >>We can discuss about the dims, and the different dims definition. >> > > -- Best regards, Shaofeng Shi

Re: kylin.cube.aggrgroup.max.combination setting

2016-05-11 Thread ShaoFeng Shi
er of include > number in agg group. I found the default value from github is 4096, and I > set it to 8092, also has this error. > > Please tell me what the right meaning of > kylin.cube.aggrgroup.max.combination and how to set it can avoid my error. > > Thanks. > -- Best regards, Shaofeng Shi

Re: kylin.cube.aggrgroup.max.combination setting

2016-05-11 Thread ShaoFeng Shi
erties stand for what ? > > 2016-05-11 19:15 GMT+08:00 Mars J : > >> Yes, I have restart kylin server after update this property. but the >> error is still there. >> >> 2016-05-11 17:20 GMT+08:00 ShaoFeng Shi : >> >>> Hi Mars, did you restart kylin

Re: kylin.cube.aggrgroup.max.combination setting

2016-05-12 Thread ShaoFeng Shi
s type different from the old one ? > > 2016-05-12 8:47 GMT+08:00 Mars J : > >> what's the combination's meaning ? what's the relation between number of >> combination and number of dimensions ? >> >> 2016-05-11 22:35 GMT+08:00 ShaoFeng Shi : >> >

Re: Incremental Build

2016-05-13 Thread ShaoFeng Shi
rtition table, it takes 2.31 mins and data size is > 130.96mb, when use partition table, it takes 3.17 mins and data size is > 21.62mb(this 2 buiding process has the same start date and different end > date) > > 2016-04-09 15:43 GMT+08:00 ShaoFeng Shi : > >> It is recommended

Re: Usage of TOP_N measure

2016-05-13 Thread ShaoFeng Shi
st > group by INDS order by pv desc LIMIT 5": Can't find any realization. > Please confirm with providers. SQL digest: fact table > LBS.LBS_AD_PV_1D,group by [LBS.LBS_AD_PV_1D.INDS],filter on [],with > aggregates[FunctionDesc [expression=SUM, parameter=ParameterDesc > [type=column, value=PV_1D_001, nextParam=null], returnType=null]] > > When using SELECT TOP_N | GROUP BY: > > Error while executing SQL "select top_n(pv_1d_001) pv from test > group by INDS LIMIT 5": From line 2, column 5 to line 2, column 20: No > match found for function signature TOP_N() > -- Best regards, Shaofeng Shi

Re: Usage of TOP_N measure

2016-05-13 Thread ShaoFeng Shi
inProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) > > at > org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) > > at > org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java

Re: Usage of TOP_N measure

2016-05-13 Thread ShaoFeng Shi
;: "constant", > > "value": "1", > > "next_parameter": null > > }, > > "returntype": "bigint" > > }, > > "dependent_measure_ref": null > > } > >

Re: Usage of TOP_N measure

2016-05-13 Thread ShaoFeng Shi
To by pass it, you can add all dimension to the aggregation group "includes" field. 2016-05-13 18:19 GMT+08:00 ShaoFeng Shi : > This is a bug, open a jira to track it: > https://issues.apache.org/jira/browse/KYLIN-1687 > > > 2016-05-13 17:45 GMT+08:00 lancelot chen : >

Re: Usage of TOP_N measure

2016-05-14 Thread ShaoFeng Shi
Cool, thanks for the feedback; 2016-05-14 14:54 GMT+08:00 lancelot chen : > I have successfully get the top100 measure by add all dimensions to > "includes" field, thanks a lot! > -- Best regards, Shaofeng Shi

Re: [ANNOUNCE] Apache Kylin 1.5.2 released

2016-05-26 Thread ShaoFeng Shi
; The Apache Kylin Team > > [1] https://kylin.apache.org/docs15/release_notes.html > [2] https://kylin.apache.org/download/ > -- Best regards, Shaofeng Shi

Re: kylin1.5.2启动错误

2016-05-26 Thread ShaoFeng Shi
.createResourceStore(ResourceStore.java:93) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) > at > org.apache.kylin.common.persistence.ResourceTool.reset(ResourceTool.java:167) > -- Best regards, Shaofeng Shi

Re: What's the difference between kylin_hive_conf.xml and kylin_job_conf.xml

2016-05-26 Thread ShaoFeng Shi
difference between kylin_hive_conf.xml and kylin_job_conf.xml > ? > -- Best regards, Shaofeng Shi

Re: Fact tables with complex data types.

2016-06-06 Thread ShaoFeng Shi
artInfo(InitializeInput.java:158) > at > org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:137) > at > org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86) > at > org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95) > > > Thanks, > Joel > -- Best regards, Shaofeng Shi

Re: There is no response when click "Property" button at Cube Designer.(Kylin1.5.2)

2016-06-06 Thread ShaoFeng Shi
rome? > > any log in browser? > > it's tested and not supposed to happen. > > On Thu, Jun 2, 2016 at 8:39 PM, Sun wrote: > >> >> >> >> ​ >> > > -- Best regards, Shaofeng Shi

Re: kylin query problem

2016-06-07 Thread ShaoFeng Shi
from the pre-computed data and calculated. > > > > > > > > OLAPToEnumerableConverter、OLAPEnumerator、OLAPTableScan When to call? > > > > > > Thankas! > -- Best regards, Shaofeng Shi

[Announce] Apache Kylin 1.5.2.1 released

2016-06-07 Thread ShaoFeng Shi
ments and contributions. Thanks, The Apache Kylin Team [1] https://kylin.apache.org/docs15/release_notes.html [2] https://kylin.apache.org/download/ -- Best regards, Shaofeng Shi

Re: Running two separate instances of Kylin on same machine

2016-06-09 Thread ShaoFeng Shi
hibited. If you have received this e-mail in error, please notify the > sender by replying to this message and delete this e-mail immediately." > > > > > > > > -- Best regards, Shaofeng Shi

Re: Problem while running sample.sh

2016-06-09 Thread ShaoFeng Shi
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > OK > Time taken: 0.48 seconds > OK > Time taken: 0.121 seconds > OK > Time taken: 0.682 seconds > FAILED: SemanticException Line 0:-1 Table not found 'KYLIN_CATEGORY_GROUPINGS' > > > Someone please help! > > -- > Thank You > > Regards > > Punit Naik > -- Best regards, Shaofeng Shi

Re: HBase region split policy.

2016-06-09 Thread ShaoFeng Shi
ntSizeRegionSplitPolicy but the code has > DisabledRegionSplitPolicy.[1] > Also the ConstantSizeRegionSplitPolicy link in the code does not work. > > > [1] > https://github.com/apache/kylin/blob/master/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHTableUtil.java#L61 > -- Best regards, Shaofeng Shi

Re: ldap SearchBase配置不上

2016-06-11 Thread ShaoFeng Shi
:89 : SearchBase > not set. Searches will be performed from the root: > > 尝试登陆时,也报错: > org.springframework.security.authentication.InternalAuthenticationServiceException: > Empty filter; nested exception is > javax.naming.directory.InvalidSearchFilterException: Empty filter; > remaining name '/' > > 请帮忙看看我的配置是否有问题? > -- Best regards, Shaofeng Shi

Re: ldap SearchBase配置不上

2016-06-11 Thread ShaoFeng Shi
rity.authentication.InternalAuthenticationServiceException: > Empty filter; nested exception is > javax.naming.directory.InvalidSearchFilterException: Empty filter; > remaining name '/' > > I want to kown how to configure SearchBase? > > 2016-06-12 11:15 GMT+08:00 Ja

Re: Can not load hive table in Kylin

2016-06-12 Thread ShaoFeng Shi
> were copied from hadoop cluster servers. Commands like 'hadoop fs -ls', > 'hive', 'hbase shell' can run and response successfully. Hive use a remote > mysql server for metastore, the configuration was properly specified in > hive-site.xml. > > Attachment were the log files, any help would be appreciated. > > > > -- Best regards, Shaofeng Shi

Re: ldap SearchBase配置不上

2016-06-12 Thread ShaoFeng Shi
Cool, thanks for the update! 2016-06-13 9:23 GMT+08:00 Jasee Tao : > @ShaoFeng, Thank You! > After configured 'ldap.user.groupSearchBase' it seems OK now. > > 2016-06-12 11:30 GMT+08:00 ShaoFeng Shi : > >> Here is my LDAP config, as an example: >

Re: Cube Designer 中Measures问题

2016-06-12 Thread ShaoFeng Shi
Expression **为**SUM, Return > Type **为**DECIMAL**,*那么是kylin在预计算存入hbase时先转成decimal类型得byte吗,还是 > > 查询时转化为decimal返回给客户端呢? > > > > > > > -- Best regards, Shaofeng Shi

Re: add pluggable custom authenticate method support

2016-06-12 Thread ShaoFeng Shi
; 珠海市魅族科技有限公司 > > MEIZU Technology Co., Ltd. > > 广东省珠海市科技创新海岸魅族科技楼 > > MEIZU Tech Bldg., Technology & Innovation Coast > > Zhuhai, 519085, Guangdong, China > > > > > > meizu.com > > > > > > > > > -- Best regards, Shaofeng Shi

Re: Support Hive View as Lookup Table

2016-06-15 Thread ShaoFeng Shi
n Wed, Jun 15, 2016 at 2:14 PM, Bhanu Mohanty > wrote: > >> I am using kylin-1.5.2.1 >> >> Added hive view as a look up table >> >> Getting error at Build Dimension Dictionary >> DEFAULT.kylin_intermediate_DEFAULT_* >> >> If the join is "inner" >> It works when I changed the join to "left" >> > > -- Best regards, Shaofeng Shi

Re: Support Hive View as Lookup Table

2016-06-15 Thread ShaoFeng Shi
JIRA created: https://issues.apache.org/jira/browse/KYLIN-1789 2016-06-16 9:52 GMT+08:00 ShaoFeng Shi : > Hi Bhanu, > > Kylin does have a speical optimization for "inner": if a dimension column > is the FK on fact table, and the join type is "inner", it will

Re: 答复: is it possible to use metaQ instead of kafka to do streaming cubing ?

2016-06-16 Thread ShaoFeng Shi
赵天烁 > > Kevin Zhao > > *zhaotians...@meizu.com * > > > > 珠海市魅族科技有限公司 > > MEIZU Technology Co., Ltd. > > 广东省珠海市科技创新海岸魅族科技楼 > > MEIZU Tech Bldg., Technology & Innovation Coast > > Zhuhai, 519085, Guangdong, China > > > > > > meizu.com > > > > > > > > > > > > > > -- > > With Warm regards > > Yiming Liu (刘一鸣) > -- Best regards, Shaofeng Shi

Re: Extract Fact Table Distinct Columns problem

2016-06-16 Thread ShaoFeng Shi
function > description? > > > > In this FactDistinctColumnsJob.class , Line 80 ,List > columnsNeedDict = cubeMgr.getAllDictColumnsOnFact(cubeDesc) : The method to > realize the function of what. > > > > > > > > > > Thanks! > > > > > -- Best regards, Shaofeng Shi

Re: query to slow ...................

2016-06-17 Thread ShaoFeng Shi
-------- > > > > 赵天烁 > > Kevin Zhao > > *zhaotians...@meizu.com * > > > > 珠海市魅族科技有限公司 > > MEIZU Technology Co., Ltd. > > 广东省珠海市科技创新海岸魅族科技楼 > > MEIZU Tech Bldg., Technology & Innovation Coast > > Zhuhai, 519085, Guangdong, China > > > > > > meizu.com > > > > > > > > > -- Best regards, Shaofeng Shi

Re: 答复: Hbase 查询结果的解析

2016-06-20 Thread ShaoFeng Shi
- > > > > 赵天烁 > > Kevin Zhao > > *zhaotians...@meizu.com * > > > > 珠海市魅族科技有限公司 > > MEIZU Technology Co., Ltd. > > 广东省珠海市科技创新海岸魅族科技楼 > > MEIZU Tech Bldg., Technology & Innovation Coast > > Zhuhai, 519085, Guangdong, China > > > > > > meizu.com > > > > > > > > > -- Best regards, Shaofeng Shi

Re: DISTINCT_COUNT精确计算问题

2016-06-21 Thread ShaoFeng Shi
int类型的统计. > > 希望可以帮到你. > > Roy > > > > > 在 2016-06-21 15:08:46,"仇同心" 写道: > >大家好: > > > Hive字段类型为varchar,字段内容也包含英文字母和中文,对这样的字段能否做DISTINCT_COUNT精确计算?如果不能,有什么好的建议吗? > > > >谢谢! > -- Best regards, Shaofeng Shi

Re: Timeout visiting cube

2016-06-21 Thread ShaoFeng Shi
ount: 0 Accept Partial: true Is Partial Result: false > Hit Exception Cache: false Storage cache used: false > Message: Error while executing SQL "select count(distinct userid) from > cortanauu LIMIT 5": Timeout visiting cube! > ==[QUERY]=== > > > > -Original Message- > From: hongbin ma [mailto:mahong...@apache.org] > Sent: Wednesday, June 15, 2016 10:09 PM > To: dev > Subject: Re: Timeout visiting cube > > ​actually, can you please attach latest 2 minutes' log before > 2016-06-15 02:18:22,741? > it's still incomplete for our analysis > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: > https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fkylin.io&data=01%7c01%7cjiaoli%40064d.mgd.microsoft.com%7ce53a04299632406e334208d395269be8%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=vpTxGJMsJQ7CoMHsEjHWBxaRVgQWfLVp6mcuFmlqzzI%3d > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Timeout visiting cube

2016-06-21 Thread ShaoFeng Shi
6GB > Source records: 85,794,927 > Dimension number: 20 (several joint groups) > Measure type: bigint > SQL query: select count(distinct userid) from XXX LIMIT 5 > > If you need more information please let me know. > > -Original Message- > From: ShaoFeng Shi [mailto:

Re: Timeout visiting cube

2016-06-22 Thread ShaoFeng Shi
a:89) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126) ... 10 more Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=155399, waitTime=90002, operation 2016-06-22 11:59 GMT+08:00 ShaoFeng Shi : > We doubt there is another HBase side error before throwing the timeout >

Re: 答复: Rest API for creating API

2016-06-23 Thread ShaoFeng Shi
gt; proprietary information, and may be used only by the person or entity > to which it is addressed. If the reader of this e-mail is not the intended > recipient or his or her authorized agent, the reader is hereby notified > that any dissemination, distribution or copying of this e-mail is > prohibited. If you have received this e-mail in error, please notify the > sender by replying to this message and delete this e-mail immediately." > > > > > > > > > > > > > > > -- Best regards, Shaofeng Shi

Re: kylin Remote JDBC Driver problem

2016-06-23 Thread ShaoFeng Shi
23 14:19:52,592 DEBUG [main] wire.content:84 : << > "{"userDetails":{"password":null,"username":"ADMIN","authorities":[{"authority":"ROLE_ADMIN"},{"authority":"ROLE_ANALYST"},{"authority":"ROLE_MODELER"}],"accountNonExpired":true,"accountNonLocked":true,"credentialsNonExpired":true,"enabled":true}}" > > > > 为什么kylin把传进的参数转为了 > "params":[{"className":"java.lang.Integer","value":"15706"}]??? > > > > > > 谢谢! > > > > > -- Best regards, Shaofeng Shi

Re: kylin Remote JDBC Driver problem

2016-06-23 Thread ShaoFeng Shi
sorry, JIRA already created: https://issues.apache.org/jira/browse/KYLIN-1817 2016-06-23 16:45 GMT+08:00 ShaoFeng Shi : > Hi TongXin, would you mind to open a JIRA for this? and please provide the > Kylin version number, thank you. > > 2016-06-23 14:30 GMT+08:00 仇同心 : > >> 大

Re: MAX aggregation for name column

2016-06-23 Thread ShaoFeng Shi
8055 > Add: 中国广东省深圳市西丽大学城清华园H楼205 > Room 205, Building H, Tsinghua Campus, The University Town, Shenzhen, > P.R.China > 清华大学计算机科学与技术系 > Department of Computer Science and Technology, Tsinghua University > -- Best regards, Shaofeng Shi

Re: Save querie issue

2016-06-23 Thread ShaoFeng Shi
gt; BR. Alberto > -- Best regards, Shaofeng Shi

Re: Model Designer Dimensions

2016-06-28 Thread ShaoFeng Shi
¡¡ > > No virus found in this message. > Checked by AVG - www.avg.com > Version: 2016.0.7640 / Virus Database: 4613/12512 - Release Date: 06/28/16 > -- Best regards, Shaofeng Shi

Re: kylin查询,报超时异常:Timeout visiting cube!

2016-06-30 Thread ShaoFeng Shi
27) > ... 4 more > > at > org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1235) > at > org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:222 > t > org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpc > Client.java:323) > at > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.execService(ClientProtos.j > ava:32855) > at > org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1618) > ... 13 more > > 目前cube size : 1.5GB source records :8亿 > 版本: hadoop2.6 hive -hive-1.2.1 hbase 1.1.5kylin 1.5.2 > > 还有问题就是都有哪些点可以优化查询??? > > 谢谢! > > > > > -- Best regards, Shaofeng Shi

Re: CubeVisitService AggregateRegionObserver prevent RegionServer Startup

2016-06-30 Thread ShaoFeng Shi
t;at org.apache.hadoop.ipc.Client.call(Client.java:1363) > > > I am using HBase 1.1 on HDP 2.4 > Is there a way to correct this, or am I going to have to delete the > contents of hbase? > -- Best regards, Shaofeng Shi

Re: Joint VS Derived

2016-06-30 Thread ShaoFeng Shi
; Hi > > I don't understand the difference between: > > - Joint Dim (from Dimension Step ) > - Derived Dim (from Advance Setings Step) > > Some example ? :) > -- Best regards, Shaofeng Shi

Re: 答复: kylin查询,报超时异常:Timeout visiting cube!

2016-06-30 Thread ShaoFeng Shi
omal维度则查询很快 > >三、如果增加hbase的regionderver是否可解决此问题 ? > > > 谢谢~ > > > > -邮件原件- > 发件人: ShaoFeng Shi [mailto:shaofeng...@apache.org] > 发送时间: 2016年7月1日 9:32 > 收件人: dev > 抄送: user@kylin.apache.org > 主题: Re: kylin查询,报超时异

Re: Joint VS Derived

2016-07-01 Thread ShaoFeng Shi
nt: > > a. It does NOT mean that ABC is necessarily joint group, right ??? > > b. Also BC doesn’t have to be joint, correct ?? > > > > Thanx, Richard. > > > > *From:* ShaoFeng Shi [mailto:shaofeng...@apache.org] > *Sent:* Thursday, June 30, 2016 7:45

Re: 答复: 答复: kylin查询,报超时异常:Timeout visiting cube!

2016-07-04 Thread ShaoFeng Shi
"quarter" as normal dimension so to reduce the post > aggregation. > 您的意思是:设置 年、上半年、季度、月、周、日 为normal dimension。那么在aggregation groups > 时是否需要设置年、上半年、季度、月、周、日为Hierarchies dimensions? > > 谢谢! > > > -邮件原件- > 发件人: ShaoFeng Shi [mailto:shaofeng...@apache.org] &

Re: Joint VS Derived

2016-07-04 Thread ShaoFeng Shi
ation number is 2, that's a further optimization on "hierarchy", quite simple and effective. Hope this can help. 2016-07-02 0:20 GMT+08:00 Julian Hyde : > A real(ish) world example would help me understand. Can you give an > example of a joint dimension in terms of sales, custo

  1   2   3   4   5   6   7   8   9   >