but I can't modify the ‘_’ character,
so I wan't to modify source code in source-kafka module
at StreamingParser.java class
```
static {
derivedTimeColumns.put("minute_start", 1);
derivedTimeColumns.put("hour_start", 2);
derivedTimeColumns.put("day_start", 3);
derivedTimeColumns.put("week_start", 4);
derivedTimeColumns.put("month_start", 5);
derivedTimeColumns.put("quarter_start", 6);
derivedTimeColumns.put("year_start", 7);
defaultProperties.put(PROPERTY_TS_COLUMN_NAME, "timestamp");
defaultProperties.put(PROPERTY_TS_PARSER,
"org.apache.kylin.source.kafka.DefaultTimeParser");
defaultProperties.put(PROPERTY_TS_PATTERN,
DateFormat.DEFAULT_DATETIME_PATTERN_WITHOUT_MILLISECONDS);
+ defaultProperties.put(EMBEDDED_PROPERTY_SEPARATOR, ".");
- defaultProperties.put(EMBEDDED_PROPERTY_SEPARATOR, "_");
}
````
and I rebuild this module and replace it to tomcat webapps
but error has still happened
I wonder Why?
[email protected]
From: ShaoFeng Shi
Date: 2018-01-15 16:37
To: dev
CC: user
Subject: Re: Support embedded JSON format ?
Hi,
It supports the embedded format, while has a conflict with "_" in the JSON.
You can check: https://issues.apache.org/jira/browse/KYLIN-3145
To bypass at this moment, you can create a message which has no "_" in the
property name.
2018-01-15 16:19 GMT+08:00 [email protected] <[email protected]>:
> Hi:
> kylin Support embedded JSON format since kylin1.6.0
> and I use streaming cube with kafka
> and my data:
> {
> "data": {
> "account": "5942153",
> "actual_amount": "30.0",
> "app_name": "xxxx",
> "app_no": "xxxx",
> "app_session": "xxx",
> "app_type_code": "xxx",
> "button_name": "",
> "dur": "",
> "forum_version": "new",
> "order_Time": "2018-01-11 16:38:43 0",
> "order_no": "OD201801111638322140",
> "order_type": "xxx",
> "original_price": "xxx",
> "page_name": "xxx",
> "pay_result": "",
> "pay_type": "",
> "product_name": "xxx",
> "scan_app": "",
> "scan_result": ""
> },
> "device":""
> }
> but build cube throw Error
> Property ‘app’ is not embedded format ?
>
>
>
>
>
> [email protected]
>
--
Best regards,
Shaofeng Shi 史少锋