Thank you very much Xiaoxiang
Will try your suggestion soon
I’ve presented quite OK and we decided to use Kylin in dev environment
before using it in production environment
Please continue to help us to master it
Thank you again
On Tue, 28 Nov 2023 at 16:06 Xiaoxiang Yu wrote:
> Sorry for my
Sorry for my incorrect answers before. Let me make it right.
Today I tried again and reproduced the issues you reported.
The Kylin query engine may not read new files because old metadata is
cached and not be invalidated.
It is a known issues with proper solution, the solution is calling a rest
ap
It is a good question, I can share some articles with you.
1. How to build a metric repository by Kylin to share among data teams (DA,
DS, AI), is that the usage of measure in Kylin?
I think the metric repository(or metrics store) is actually which Kylin can
help. For example,
Beike(ke.com) did c
Thank you Xiaoxiang, tomorrow noon is my presentation to the management
about kylin so I am pending this issue to focus on following ones, can you
please advise:
1. How to build a metric repository by Kylin to share among data teams (DA,
DS, AI), is that the usage of measure in Kylin?
2. How to us
Before you try again, you can use spark-sql/spark-shell to check if the
data is loaded
into your table successfully (or if your data is copied to the right place).
Following is how to start a spark-sql/spark-shell in a container.
export HADOOP_CONF_DIR=/opt/hadoop-3.2.1/etc/hadoop
cd /home/kylin/
Thank you Xiaoxiang, I tried in my place and it worked for the ssb database
but it didn't work for my own database.
It only works if I restart kylin so I guess there might be some
configuration miss in my end.
Thank you very much anyway and will update next time.
Have a good day.
On Fri, Nov 17
I did an easy test to verify if kylin has any bugs for the push down
function. And the push
down function works as expected without any mistakes. So I'm 99% certain
that
your step "I loaded the incremental data into Hive already" does not work.
Here are my steps(you can reproduce in a fresh Kylin5
Have a nice weekend Xiaoxiang, and thank you for helping me to become a
kylin's fan
You are right I am not familiar with Kylin enough and have little
background of the hadoop system so I will double check here carefully before
future questions. However I did understand the following mechanism
in q
Unfortunately, I guess you are not asking good questions.
If the answer of a question can be searched on the Internet,
it is not recommended to ask it in the mailing list. I guess you
didn't know how Kylin works, so you need to search for documents
or some tutorials.
What does 'get the incrementa
Hi Xiaoxiang,
Do I really need to create a model in order to get the incremental data
from Hive into Kylin?
Can I query the incremental data of a pure dim/fact table without a model?
Thank you very much
On Fri, Nov 17, 2023 at 9:05 AM Xiaoxiang Yu wrote:
> I am not really sure. But I think it
I am not really sure. But I think it is the Query cache make your query result
unchanged.
The config entry is kylin.query.cache-enabled , is turn on by default.
This doc links is https://kylin.apache.org/5.0/docs/configuration/query_cache
--
Best wishes to you !
From ：Xiaoxiang Yu
At
Hello Team, hello Xiaoxiang, can you please help me with this urgent
issue...
(this is public email group so in general I neglect your specific name from
greeting of first email in the threads, but in fact most of time Xiaoxiang
actively answers my issues, thank you very much)
On Thu, Nov 16, 202
Dear Dev Team, please kindly advise this scenario
1. I have a fact table and I use Kylin insights window to query it and get
5 million rows.
2. Then I use following command to load X rows (last hour data) from
parquet into Hive table
LOAD DATA LOCAL INPATH
'/opt/LastHour/factUserEventDF_2023_11_
13 matches
Mail list logo
