I planned to write a doc on this, but seems it need be prioritized now.
Marek Wiewiorka 编写:
>Hi All - I managed to get LDAP authentication working but I'm unable to setup
>proper authorization.
>
>
>Does anybody of you got it working properly - roles mapping, privileges on
>cubes with LDAP?
>
question 2), I didn't get your point, a sample case should be helpful.
2015-12-12 22:03 GMT+08:00 Marek Wiewiorka :
> I would be extreme grateful!!!
> In the first place if you could please write a few hints on how to
> configure cubes ACLs + admin role mapping with LDAP.
>
> Ma
eant is that cubes ACL do not work for me as well.
>> I'm calling REST api with a sql query with a user that isn't in any ACL -
>> so does not have even read right.
>> User is authenticated using LDAP, isn't a member of any group, default
>> acl role isn't
nual :)
>>
>> Thanks again!
>> Marek
>>
>> 2015-12-14 15:58 GMT+01:00 ShaoFeng Shi :
>>
>>> Hi Marek,
>>>
>>> If you're familiar with Spring Security framework, the "ROLE_" prefix is
>>> added by that when conver
2015年12月21日,16:16,Gqchen 写道:
> >
> > HI:
> >
> > I had installed Hbase on aHDFS hdfs://ip1/ ; But hive on another
> HDFS hdfs://ip2/
> > It seemed Kylin does not work in ecviroment like this.
> > How can I resolve it , reinstall Hive and Hbase on the same HDFS?
>
>
--
Best regards,
Shaofeng Shi
The Apache Kylin team is pleased to announce the immediate availability
of the 1.2 release. The release note can be found here [1]; The source
code and binary package can be downloaded from Kylin's download page [2].
The Apache Kylin Team would like to hear from you and welcomes
your comments and
> DataNucleus.Persistence: Property hive.metastore.integral.jdo.pushdown
>> unknown - will be ignored
>> ...
>> 2015-12-24 15:01:24,350 INFO [http-bio-7070-exec-6]
>> metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is DERBY
>>
>> I'm not sure these ignored property is OK or not.
>> I config Hive as remote mode(use mysql to store metadata, config thrift
>> uris) but kylin try to access DERBY which I do not use !
>>
>> Could you tell me how to config it ?
>>
>
>
--
Best regards,
Shaofeng Shi
[DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:195)]
> - Saving resource /execute_output/2adf81ed-b19a-4b2f-8035-27b3a2184cac-01
> (Store kylin_metadata@hbase)
>
--
Best regards,
Shaofeng Shi
s just a curiosity for me.
>
--
Best regards,
Shaofeng Shi
K9
>
>- Region Count: 979
>- Size: 5.75 TB
>- Start Time: 2011-12-31 00:00:00
>- End Time: 2014-05-01 01:00:00
>
> The region count is 979 which is definitely larger than
>
> 500. Does it mean that the setting actually did not work?
>
>
>
> Best regards,
>
> Zhong
>
>
>
--
Best regards,
Shaofeng Shi
| null | 524 | null
> |
>
> I’m planning to put “regionname”, “town”, “provincecd”,
> “provincename”, “dma_code” and “msa” in a hierarchy dimension.
>
> Do I understand correctly for the hierarchy dimension?
>
> Best regards,
>
> Zhong
>
>
>
>
>
--
Best regards,
Shaofeng Shi
World San Jose - Booth #1335. Not registered
> yet? Be sure **to use code ZALONI20 to receive 20% off registration! *
>
> <http://conferences.oreilly.com/strata/hadoop-big-data-ca?cmp=ba-data-confreg-home-stca16_were_sponsoring>
--
Best regards,
Shaofeng Shi
eive 20% off registration! *
>
> <http://conferences.oreilly.com/strata/hadoop-big-data-ca?cmp=ba-data-confreg-home-stca16_were_sponsoring>
--
Best regards,
Shaofeng Shi
You're welcome, now the introduction of this API is added:
https://kylin.apache.org/docs/howto/howto_use_restapi.html#get-cube-descriptor
2016-01-06 10:39 GMT+08:00 Sudeep Dey :
> Thanks a lot appreciate that.
>
> Regards
>
> Sudeep
>
> On Tue, Jan 5, 2016 at 9:16
issue we also calculated uniques across 2016-01-07,
> 2016-01-08. It accounts to 164,637,916. Its only when we merge data for
> 2016-01-09 we get spurious value.
>
> 2. Is there any limit on the relative order elements being merged ?
>
> Regards,
> Prashant
>
--
Best regards,
Shaofeng Shi
.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
>
> Regards
>
> Prashant
>
--
Best regards,
Shaofeng Shi
p;version=12333152
.
Thanks to all the contributors who made this release possible!
Cheers,
The HBase Dev Team
--
Best regards,
Shaofeng Shi
for most of the cases, one reducer is okay for merge the distinct values from
all dimension columns on fact table; but if there are multiple ultra high
cardinality columns, using multiple reducers would gain better concurrency.
Actually this is the task I'm doing today, as a part of work for ano
Fwd to the mailing list:
From the log the root cause is a timeout error when connecting to the mysql
database, which your hive configured as the metadata store; Please double check
your hive-site.xml; Before running Kylin, make sure your hive has been
properly configured, you should be able t
The screenshot couldn??t be shown up.
So far kylin doesn??t support customising mr configurations for each step. You
can try to give the reducer more memory in conf/kylin_job_conf.xml as a
workaround.
Besides, you need consider whether that ultra-high-cardinality column is
meaningful as a dime
due to "
>>>>>> *PasswordPlaceholderConfigurer*", which tries to decrypt passwords
>>>>>> in kylin.properties file. Does this mean passwords like "
>>>>>> ldap.password" in kylin.properties should be encrypted ? If so, I
>>>>>> hope it's documented in tutorial.
>>>>>>
>>>>>> // PasswordPlaceholderConfigurer.java:Line71
>>>>>>
>>>>>> protected String resolvePlaceholder(String placeholder, Properties
>>>>>> props) {
>>>>>>
>>>>>> if (placeholder.toLowerCase().contains("password")) {
>>>>>>
>>>>>> return decrypt(props.getProperty(placeholder));
>>>>>>
>>>>>> } else {
>>>>>>
>>>>>> return props.getProperty(placeholder);
>>>>>>
>>>>>> }
>>>>>>
>>>>>> }
>>>>>>
>>>>>>
>>>>>> p.s.
>>>>>>
>>>>>> Kylin Branch: v1.2-release
>>>>>>
>>>>>>
>>>>>> thanks
>>>>>> *wu*
>>>>>>
>>>>>
>>>
>>>
>>> --
>>>
>>> *wu*
>>>
>>
>>
>
--
Best regards,
Shaofeng Shi
Yes. You need check those slow queries, and then optimize either the query
or the cube design accordingly; Usually a good query or cube should not
read much data into memory;
.
> do kylin provide client api?
>
>
--
Best regards,
Shaofeng Shi
rs will help.
>
> On Wed, Feb 24, 2016 at 2:35 PM, 热爱大发挥 <385639...@qq.com> wrote:
>
>> How to improve the performance of concurrent queries? Increase
>> kylin-server node, do load balancing useful?
>>
>
>
--
Best regards,
Shaofeng Shi
lin/hbase/hadoop version ?
>
> 在 2016年3月6日,下午3:31,ianzeng 写道:
>
> Caused by: com.fasterxml.jackson.core.JsonParseException: Illegal
> character ((CTRL-CHAR, code 5)): only regular white space (\r, \n, \t) is
> allowed between tokens
>
>
>
>
--
Best regards,
Shaofeng Shi
;:
> In measures step, I try to count distinct cardinality column (like
> user_id), then I found the cuboid size was very large and cast much time.
> is deprecated count distinct with the high cardinality column???
>
--
Best regards,
Shaofeng Shi
which kylin version are you using?
2016-03-11 10:46 GMT+08:00 Bin.Li :
> hello,
>
> I got this exception:
>
> org.apache.kylin.cube.kv.RowKeyColumnIO: Can't translate value 20150731 to
> dictionary ID
>
> What's the problem??
>
> 20150731 is numberic
>
ty less than 6)
> measures : count (distinctuid), the "uid" 's cardinality about 60
>count (distinct keyword), the "keyword" 's cardinality
> about 10
>
> cast time:12 MIN
> cube size: 765MB
>
>
>
> ---
t; -- 原始邮件 ----------
> *发件人:* "ShaoFeng Shi";;
> *发送时间:* 2016年3月11日(星期五) 上午10:51
> *收件人:* "user";
> *主题:* Re: Can't translate value 20150731 to dictionary ID
>
> which kylin version are you using?
>
>
at
> org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2045)
> ... 8 more
>
>
>
> What should I do to fix this problem ?
>
--
Best regards,
Shaofeng Shi
3.3-1.cdh5.3.3.p0.5/bin/../lib/hive/lib/ant-1.9.1.jar:/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/bin/../lib/hive/lib/bonecp-0.8.0.RELEASE.jar:/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/bin/../lib/hive/lib/jetty-6.1.26.jar:/opt/cloudera/parcels/CDH-5.3.3-1.cdh5.3.3.p0.5/bin/../lib/hive-hcatalo
> thesender by replying to this message and delete this e-mail immediately."*
>
>
>
>
> On Wed, Mar 23, 2016 at 12:19 PM, Bin.Li wrote:
>
>> hello,
>>
>> Can I close hyperLogLog Optimizing ?? (I'm using kylin1.2)
>>
>> I want to get an accurate data.
>>
>>
>> bin.li
>>
>
>
--
Best regards,
Shaofeng Shi
where day = '20160315'
> group by channel_id
> order by shopper desc
> ;
>
> And sql1, sql2 do can get the same results in hive, but different results
> between hive & kylin.
> What the problem is ??
>
> Many tks!!
>
> bin.li
>
--
Best regards,
Shaofeng Shi
cut -c list [file ...]
>cut -f list [-s] [-d delim] [file ...]
> hbase-common lib not found
>
>
> Please help me out with this so that i can proceed my work further
--
Best regards,
Shaofeng Shi
I see it, we will check, thank you!
Regards,
Shaofeng Shi
shaofeng...@gmail.com
>From Outlook Mobile
On Sat, Mar 26, 2016 at 11:08 PM -0700, "Bin.Li" wrote:
hello shaofeng.shi,
There is the issue I created:
https://issues.apache.org/jira/browse/KYLIN-1535
Many
"More" Button. there are 2
> reason for my advisement,1)for small pc screen users,the "more" button is
> difficult to be found.2)the 1,2,3,..page list sytle is more familiar to
> most users.
>
> Thanks.
>
--
Best regards,
Shaofeng Shi
16:32 GMT+08:00 Bin.Li :
> hello,
>
> I want to add read only users for kylin, but I cannot find an entry.
>
> Many tks!!
>
> bin.li
>
--
Best regards,
Shaofeng Shi
Will add it back in 1.5.1; if absent, kylin will use "all" as the value. You
can manually add it if set it with other values.
Regards,
Shaofeng Shi
shaofeng...@gmail.com
>From Outlook Mobile
On Tue, Mar 29, 2016 at 3:59 PM -0700, "Jins George"
wrote:
He
is there any error in kylin.log?
2016-03-30 16:05 GMT+08:00 热爱大发挥 <385639...@qq.com>:
> when I do any action, kylin always show me "faild to take action" in
> kylin 1.5.0
--
Best regards,
Shaofeng Shi
adPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
--
Best regards,
Shaofeng Shi
JIRA to add validation for such a case:
https://issues.apache.org/jira/browse/KYLIN-1551
Thanks for the reporting.
2016-03-31 11:04 GMT+08:00 ShaoFeng Shi :
> Hi, TopN measure need define two parameters, it seems you didn't specify
> the second one. The first parameter is the me
, why should I specify a "order by column"?
>
>
>
> ------ 原始邮件 --
> *发件人:* "ShaoFeng Shi";
> *发送时间:* 2016年3月31日(星期四) 中午11:04
> *收件人:* "user";
> *主题:* Re: error with TOP_N in kylin 1.5.0
>
> Hi, TopN measure need
this is a bug in 1.5.0, pls google this error there is a reported JIRA on this,
and there is a workaround for it.
Regards,
Shaofeng Shi
shaofeng...@gmail.com
>From Outlook Mobile
On Fri, Apr 1, 2016 at 3:57 PM -0700, "Jins George"
wrote:
Hello Kylin Community
is " + alg);)
>
> Is there some docs describ the inmem cubing algorithm ? Is this one (
> http://www.infoq.com/cn/articles/apache-kylin-algorithm)?
>
--
Best regards,
Shaofeng Shi
g.
>
> If the in-mem cubing is only available from v1.5.0 , why there some source
> code about in-mem cubing shows in v 1.3.0 ?
>
> I suggest that u can take some comments there to mark that part will not
> release in the particular version.
>
>
> 2016-04-06 16:09 GMT+08:
te-column
> partition table when incremental building by date ?
>
--
Best regards,
Shaofeng Shi
LYST" />
>
>
>
> But unable to login.
>
>
>
>
>
>
>
>
>
>
>
> 郑江雨 云平台
>
> Phone: 15155195496
>
>
>
--
Best regards,
Shaofeng Shi
,KYLIN_SALES have the right data. I don't know why?
>
--
Best regards,
Shaofeng Shi
xml and kylin_job_conf.xml , can I set
> job parameters when submiting cube job ?
>
> 2016-05-04 20:04 GMT+08:00 王猛 :
>
>>
>>
>
--
Best regards,
Shaofeng Shi
for future reference.
>
> Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur
> immédiatement, par retour de courriel ou par un autre moyen. Vous avez
> accepté de recevoir le(s) document(s) ci-joint(s) par voie électronique à
> l'adresse courriel indiquée ci-dessus; veuillez conserver une copie de
> cette confirmation pour les fins de reference future.
>
>
--
Best regards,
Shaofeng Shi
couldn't see the screenshot; in the cube, did you define "joint" dimension?
Regards,
Shaofeng Shi
shaofeng...@gmail.com
>From Outlook Mobile
On Fri, May 6, 2016 at 1:45 AM -0700, "Mars J" wrote:
My kylin version is kylin 1.3 . Yes there is a step nam
-> level3), I said it has 4 dims in the
>> traditional BI way, but in kylin ,it's 10 dims.
>>In kylin 1.5.1, I can't create hierachy dims directly, but I can
>> create it for derived dims or normal dims first, then in the aggregroup ,
>> make it to hierachy dims. but I don't know how to count it in traditional
>> BI way.
>>
>>We can discuss about the dims, and the different dims definition.
>>
>
>
--
Best regards,
Shaofeng Shi
er of include
> number in agg group. I found the default value from github is 4096, and I
> set it to 8092, also has this error.
>
> Please tell me what the right meaning of
> kylin.cube.aggrgroup.max.combination and how to set it can avoid my error.
>
> Thanks.
>
--
Best regards,
Shaofeng Shi
erties stand for what ?
>
> 2016-05-11 19:15 GMT+08:00 Mars J :
>
>> Yes, I have restart kylin server after update this property. but the
>> error is still there.
>>
>> 2016-05-11 17:20 GMT+08:00 ShaoFeng Shi :
>>
>>> Hi Mars, did you restart kylin
s type different from the old one ?
>
> 2016-05-12 8:47 GMT+08:00 Mars J :
>
>> what's the combination's meaning ? what's the relation between number of
>> combination and number of dimensions ?
>>
>> 2016-05-11 22:35 GMT+08:00 ShaoFeng Shi :
>>
>
rtition table, it takes 2.31 mins and data size is
> 130.96mb, when use partition table, it takes 3.17 mins and data size is
> 21.62mb(this 2 buiding process has the same start date and different end
> date)
>
> 2016-04-09 15:43 GMT+08:00 ShaoFeng Shi :
>
>> It is recommended
st
> group by INDS order by pv desc LIMIT 5": Can't find any realization.
> Please confirm with providers. SQL digest: fact table
> LBS.LBS_AD_PV_1D,group by [LBS.LBS_AD_PV_1D.INDS],filter on [],with
> aggregates[FunctionDesc [expression=SUM, parameter=ParameterDesc
> [type=column, value=PV_1D_001, nextParam=null], returnType=null]]
>
> When using SELECT TOP_N | GROUP BY:
>
> Error while executing SQL "select top_n(pv_1d_001) pv from test
> group by INDS LIMIT 5": From line 2, column 5 to line 2, column 20: No
> match found for function signature TOP_N()
>
--
Best regards,
Shaofeng Shi
inProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
> at
> org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
>
> at
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java
;: "constant",
>
> "value": "1",
>
> "next_parameter": null
>
> },
>
> "returntype": "bigint"
>
> },
>
> "dependent_measure_ref": null
>
> }
>
>
To by pass it, you can add all dimension to the aggregation group
"includes" field.
2016-05-13 18:19 GMT+08:00 ShaoFeng Shi :
> This is a bug, open a jira to track it:
> https://issues.apache.org/jira/browse/KYLIN-1687
>
>
> 2016-05-13 17:45 GMT+08:00 lancelot chen :
>
Cool, thanks for the feedback;
2016-05-14 14:54 GMT+08:00 lancelot chen :
> I have successfully get the top100 measure by add all dimensions to
> "includes" field, thanks a lot!
>
--
Best regards,
Shaofeng Shi
; The Apache Kylin Team
>
> [1] https://kylin.apache.org/docs15/release_notes.html
> [2] https://kylin.apache.org/download/
>
--
Best regards,
Shaofeng Shi
.createResourceStore(ResourceStore.java:93)
> at
> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104)
> at
> org.apache.kylin.common.persistence.ResourceTool.reset(ResourceTool.java:167)
>
--
Best regards,
Shaofeng Shi
difference between kylin_hive_conf.xml and kylin_job_conf.xml
> ?
>
--
Best regards,
Shaofeng Shi
artInfo(InitializeInput.java:158)
> at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:137)
> at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
> at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
>
>
> Thanks,
> Joel
>
--
Best regards,
Shaofeng Shi
rome?
>
> any log in browser?
>
> it's tested and not supposed to happen.
>
> On Thu, Jun 2, 2016 at 8:39 PM, Sun wrote:
>
>>
>>
>>
>>
>>
>
>
--
Best regards,
Shaofeng Shi
from the pre-computed data and calculated.
>
>
>
>
>
>
>
> OLAPToEnumerableConverter、OLAPEnumerator、OLAPTableScan When to call?
>
>
>
>
>
> Thankas!
>
--
Best regards,
Shaofeng Shi
ments and contributions.
Thanks,
The Apache Kylin Team
[1] https://kylin.apache.org/docs15/release_notes.html
[2] https://kylin.apache.org/download/
--
Best regards,
Shaofeng Shi
hibited. If you have received this e-mail in error, please notify the
> sender by replying to this message and delete this e-mail immediately."
>
>
>
>
>
>
>
>
--
Best regards,
Shaofeng Shi
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> OK
> Time taken: 0.48 seconds
> OK
> Time taken: 0.121 seconds
> OK
> Time taken: 0.682 seconds
> FAILED: SemanticException Line 0:-1 Table not found 'KYLIN_CATEGORY_GROUPINGS'
>
>
> Someone please help!
>
> --
> Thank You
>
> Regards
>
> Punit Naik
>
--
Best regards,
Shaofeng Shi
ntSizeRegionSplitPolicy but the code has
> DisabledRegionSplitPolicy.[1]
> Also the ConstantSizeRegionSplitPolicy link in the code does not work.
>
>
> [1]
> https://github.com/apache/kylin/blob/master/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHTableUtil.java#L61
>
--
Best regards,
Shaofeng Shi
:89 : SearchBase
> not set. Searches will be performed from the root:
>
> 尝试登陆时,也报错:
> org.springframework.security.authentication.InternalAuthenticationServiceException:
> Empty filter; nested exception is
> javax.naming.directory.InvalidSearchFilterException: Empty filter;
> remaining name '/'
>
> 请帮忙看看我的配置是否有问题?
>
--
Best regards,
Shaofeng Shi
rity.authentication.InternalAuthenticationServiceException:
> Empty filter; nested exception is
> javax.naming.directory.InvalidSearchFilterException: Empty filter;
> remaining name '/'
>
> I want to kown how to configure SearchBase?
>
> 2016-06-12 11:15 GMT+08:00 Ja
> were copied from hadoop cluster servers. Commands like 'hadoop fs -ls',
> 'hive', 'hbase shell' can run and response successfully. Hive use a remote
> mysql server for metastore, the configuration was properly specified in
> hive-site.xml.
>
> Attachment were the log files, any help would be appreciated.
>
>
>
>
--
Best regards,
Shaofeng Shi
Cool, thanks for the update!
2016-06-13 9:23 GMT+08:00 Jasee Tao :
> @ShaoFeng, Thank You!
> After configured 'ldap.user.groupSearchBase' it seems OK now.
>
> 2016-06-12 11:30 GMT+08:00 ShaoFeng Shi :
>
>> Here is my LDAP config, as an example:
>
Expression **为**SUM, Return
> Type **为**DECIMAL**,*那么是kylin在预计算存入hbase时先转成decimal类型得byte吗,还是
>
> 查询时转化为decimal返回给客户端呢?
>
>
>
>
>
>
>
--
Best regards,
Shaofeng Shi
; 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
>
>
>
>
> meizu.com
>
>
>
>
>
>
>
>
>
--
Best regards,
Shaofeng Shi
n Wed, Jun 15, 2016 at 2:14 PM, Bhanu Mohanty
> wrote:
>
>> I am using kylin-1.5.2.1
>>
>> Added hive view as a look up table
>>
>> Getting error at Build Dimension Dictionary
>> DEFAULT.kylin_intermediate_DEFAULT_*
>>
>> If the join is "inner"
>> It works when I changed the join to "left"
>>
>
>
--
Best regards,
Shaofeng Shi
JIRA created: https://issues.apache.org/jira/browse/KYLIN-1789
2016-06-16 9:52 GMT+08:00 ShaoFeng Shi :
> Hi Bhanu,
>
> Kylin does have a speical optimization for "inner": if a dimension column
> is the FK on fact table, and the join type is "inner", it will
赵天烁
>
> Kevin Zhao
>
> *zhaotians...@meizu.com *
>
>
>
> 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
>
>
>
>
> meizu.com
>
>
>
>
>
>
>
>
>
>
>
>
>
> --
>
> With Warm regards
>
> Yiming Liu (刘一鸣)
>
--
Best regards,
Shaofeng Shi
function
> description?
>
>
>
> In this FactDistinctColumnsJob.class , Line 80 ,List
> columnsNeedDict = cubeMgr.getAllDictColumnsOnFact(cubeDesc) : The method to
> realize the function of what.
>
>
>
>
>
>
>
>
>
> Thanks!
>
>
>
>
>
--
Best regards,
Shaofeng Shi
--------
>
>
>
> 赵天烁
>
> Kevin Zhao
>
> *zhaotians...@meizu.com *
>
>
>
> 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
>
>
>
>
> meizu.com
>
>
>
>
>
>
>
>
>
--
Best regards,
Shaofeng Shi
-
>
>
>
> 赵天烁
>
> Kevin Zhao
>
> *zhaotians...@meizu.com *
>
>
>
> 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
>
>
>
>
> meizu.com
>
>
>
>
>
>
>
>
>
--
Best regards,
Shaofeng Shi
int类型的统计.
>
> 希望可以帮到你.
>
> Roy
>
>
>
>
> 在 2016-06-21 15:08:46,"仇同心" 写道:
> >大家好:
> >
> Hive字段类型为varchar,字段内容也包含英文字母和中文,对这样的字段能否做DISTINCT_COUNT精确计算?如果不能,有什么好的建议吗?
> >
> >谢谢!
>
--
Best regards,
Shaofeng Shi
ount: 0 Accept Partial: true Is Partial Result: false
> Hit Exception Cache: false Storage cache used: false
> Message: Error while executing SQL "select count(distinct userid) from
> cortanauu LIMIT 5": Timeout visiting cube!
> ==[QUERY]===
>
>
>
> -Original Message-
> From: hongbin ma [mailto:mahong...@apache.org]
> Sent: Wednesday, June 15, 2016 10:09 PM
> To: dev
> Subject: Re: Timeout visiting cube
>
> actually, can you please attach latest 2 minutes' log before
> 2016-06-15 02:18:22,741?
> it's still incomplete for our analysis
>
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin:
> https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fkylin.io&data=01%7c01%7cjiaoli%40064d.mgd.microsoft.com%7ce53a04299632406e334208d395269be8%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=vpTxGJMsJQ7CoMHsEjHWBxaRVgQWfLVp6mcuFmlqzzI%3d
> Github: https://github.com/binmahone
>
--
Best regards,
Shaofeng Shi
6GB
> Source records: 85,794,927
> Dimension number: 20 (several joint groups)
> Measure type: bigint
> SQL query: select count(distinct userid) from XXX LIMIT 5
>
> If you need more information please let me know.
>
> -Original Message-
> From: ShaoFeng Shi [mailto:
a:89)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
... 10 more
Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call
id=155399, waitTime=90002, operation
2016-06-22 11:59 GMT+08:00 ShaoFeng Shi :
> We doubt there is another HBase side error before throwing the timeout
>
gt; proprietary information, and may be used only by the person or entity
> to which it is addressed. If the reader of this e-mail is not the intended
> recipient or his or her authorized agent, the reader is hereby notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify the
> sender by replying to this message and delete this e-mail immediately."
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
--
Best regards,
Shaofeng Shi
23 14:19:52,592 DEBUG [main] wire.content:84 : <<
> "{"userDetails":{"password":null,"username":"ADMIN","authorities":[{"authority":"ROLE_ADMIN"},{"authority":"ROLE_ANALYST"},{"authority":"ROLE_MODELER"}],"accountNonExpired":true,"accountNonLocked":true,"credentialsNonExpired":true,"enabled":true}}"
>
>
>
> 为什么kylin把传进的参数转为了
> "params":[{"className":"java.lang.Integer","value":"15706"}]???
>
>
>
>
>
> 谢谢!
>
>
>
>
>
--
Best regards,
Shaofeng Shi
sorry, JIRA already created:
https://issues.apache.org/jira/browse/KYLIN-1817
2016-06-23 16:45 GMT+08:00 ShaoFeng Shi :
> Hi TongXin, would you mind to open a JIRA for this? and please provide the
> Kylin version number, thank you.
>
> 2016-06-23 14:30 GMT+08:00 仇同心 :
>
>> 大
8055
> Add: 中国广东省深圳市西丽大学城清华园H楼205
> Room 205, Building H, Tsinghua Campus, The University Town, Shenzhen,
> P.R.China
> 清华大学计算机科学与技术系
> Department of Computer Science and Technology, Tsinghua University
>
--
Best regards,
Shaofeng Shi
gt; BR. Alberto
>
--
Best regards,
Shaofeng Shi
¡¡
>
> No virus found in this message.
> Checked by AVG - www.avg.com
> Version: 2016.0.7640 / Virus Database: 4613/12512 - Release Date: 06/28/16
>
--
Best regards,
Shaofeng Shi
27)
> ... 4 more
>
> at
> org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1235)
> at
> org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:222
> t
> org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpc
> Client.java:323)
> at
> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.execService(ClientProtos.j
> ava:32855)
> at
> org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1618)
> ... 13 more
>
> 目前cube size : 1.5GB source records :8亿
> 版本: hadoop2.6 hive -hive-1.2.1 hbase 1.1.5kylin 1.5.2
>
> 还有问题就是都有哪些点可以优化查询???
>
> 谢谢!
>
>
>
>
>
--
Best regards,
Shaofeng Shi
t;at org.apache.hadoop.ipc.Client.call(Client.java:1363)
>
>
> I am using HBase 1.1 on HDP 2.4
> Is there a way to correct this, or am I going to have to delete the
> contents of hbase?
>
--
Best regards,
Shaofeng Shi
; Hi
>
> I don't understand the difference between:
>
> - Joint Dim (from Dimension Step )
> - Derived Dim (from Advance Setings Step)
>
> Some example ? :)
>
--
Best regards,
Shaofeng Shi
omal维度则查询很快
>
>三、如果增加hbase的regionderver是否可解决此问题 ?
>
>
> 谢谢~
>
>
>
> -邮件原件-
> 发件人: ShaoFeng Shi [mailto:shaofeng...@apache.org]
> 发送时间: 2016年7月1日 9:32
> 收件人: dev
> 抄送: user@kylin.apache.org
> 主题: Re: kylin查询,报超时异
nt:
>
> a. It does NOT mean that ABC is necessarily joint group, right ???
>
> b. Also BC doesn’t have to be joint, correct ??
>
>
>
> Thanx, Richard.
>
>
>
> *From:* ShaoFeng Shi [mailto:shaofeng...@apache.org]
> *Sent:* Thursday, June 30, 2016 7:45
"quarter" as normal dimension so to reduce the post
> aggregation.
> 您的意思是:设置 年、上半年、季度、月、周、日 为normal dimension。那么在aggregation groups
> 时是否需要设置年、上半年、季度、月、周、日为Hierarchies dimensions?
>
> 谢谢!
>
>
> -邮件原件-
> 发件人: ShaoFeng Shi [mailto:shaofeng...@apache.org]
&
ation number is 2, that's a further optimization
on "hierarchy", quite simple and effective.
Hope this can help.
2016-07-02 0:20 GMT+08:00 Julian Hyde :
> A real(ish) world example would help me understand. Can you give an
> example of a joint dimension in terms of sales, custo
1 - 100 of 884 matches
Mail list logo