[jira] [Commented] (FLINK-18493) Make target home directory used to store yarn files configurable

2020-07-06 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151927#comment-17151927 ] Kevin Zhang commented on FLINK-18493: - [~fly_in_gis] Yes I'd like to work on this if

[jira] [Commented] (FLINK-18493) Make target home directory used to store yarn files configurable

2020-07-06 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151860#comment-17151860 ] Kevin Zhang commented on FLINK-18493: - [~fly_in_gis] yes I mean the staging director

[jira] [Updated] (FLINK-18493) Make target home directory used to store yarn files configurable

2020-07-05 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated FLINK-18493: Description: When submitting applications to yarn, the file system's default home directory, like

[jira] [Created] (FLINK-18493) Make target home directory used to store yarn files configurable

2020-07-05 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-18493: --- Summary: Make target home directory used to store yarn files configurable Key: FLINK-18493 URL: https://issues.apache.org/jira/browse/FLINK-18493 Project: Flink

[jira] [Created] (FLINK-18493) Make target home directory used to store yarn files configurable

2020-07-05 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-18493: --- Summary: Make target home directory used to store yarn files configurable Key: FLINK-18493 URL: https://issues.apache.org/jira/browse/FLINK-18493 Project: Flink

[jira] [Commented] (FLINK-18211) Dynamic properties setting 'pipeline.jars' will be overwritten

2020-06-16 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136434#comment-17136434 ] Kevin Zhang commented on FLINK-18211: - hi [~kkl0u] IIRC, there is no other good way

[jira] [Commented] (FLINK-17745) PackagedProgram' extractedTempLibraries and jarfiles may be duplicate

2020-05-18 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110793#comment-17110793 ] Kevin Zhang commented on FLINK-17745: - [~fly_in_gis] IIUC, the problem that [~Echo L

[jira] [Created] (SPARK-31737) SparkSQL can't recognize the modified length of Hive varchar

2020-05-17 Thread Kevin Zhang (Jira)
Kevin Zhang created SPARK-31737: --- Summary: SparkSQL can't recognize the modified length of Hive varchar Key: SPARK-31737 URL: https://issues.apache.org/jira/browse/SPARK-31737 Project: Spark I

[jira] [Commented] (CALCITE-3603) SqlLateralOperator's unparse add additional keyword 'LATERAL' when the inner operator is SqlSnapshot

2019-12-16 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/CALCITE-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997908#comment-16997908 ] Kevin Zhang commented on CALCITE-3603: -- Thanks [~danny0405], it helps. > SqlLater

[jira] [Commented] (CALCITE-3603) SqlLateralOperator's unparse add additional keyword 'LATERAL' when the inner operator is SqlSnapshot

2019-12-16 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/CALCITE-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997799#comment-16997799 ] Kevin Zhang commented on CALCITE-3603: -- [~danny0405] yes, I'd like to submit a fix

[jira] [Commented] (CALCITE-3603) SqlLateralOperator's unparse add additional keyword 'LATERAL' when the inner operator is SqlSnapshot

2019-12-16 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/CALCITE-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997796#comment-16997796 ] Kevin Zhang commented on CALCITE-3603: -- hi [~julianhyde], "LATERAL" is the operato

[jira] [Created] (CALCITE-3603) SqlLateralOperator's unparse add additional keyword 'LATERAL' when the inner operator is SqlSnapshot

2019-12-16 Thread Kevin Zhang (Jira)
Kevin Zhang created CALCITE-3603: Summary: SqlLateralOperator's unparse add additional keyword 'LATERAL' when the inner operator is SqlSnapshot Key: CALCITE-3603 URL: https://issues.apache.org/jira/browse/CALCITE-

[jira] [Created] (CALCITE-3603) SqlLateralOperator's unparse add additional keyword 'LATERAL' when the inner operator is SqlSnapshot

2019-12-16 Thread Kevin Zhang (Jira)
Kevin Zhang created CALCITE-3603: Summary: SqlLateralOperator's unparse add additional keyword 'LATERAL' when the inner operator is SqlSnapshot Key: CALCITE-3603 URL: https://issues.apache.org/jira/browse/CALCITE-

[jira] [Commented] (FLINK-14567) Aggregate query with more than two group fields can't be write into HBase sink

2019-11-15 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974992#comment-16974992 ] Kevin Zhang commented on FLINK-14567: - I basically agree with [~jackylau]. In the pr

[jira] [Closed] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-30 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang closed FLINK-14539. --- Resolution: Invalid > Unique key metadata should be ketp when using concat or concat_ws in some > c

[jira] [Commented] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-30 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962759#comment-16962759 ] Kevin Zhang commented on FLINK-14539: - [~jark] That's good, I'd like to join the dis

[jira] [Commented] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-29 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962753#comment-16962753 ] Kevin Zhang commented on FLINK-14539: - [~jark] thansk, greate catch, I omitted this

[jira] [Comment Edited] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-28 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960875#comment-16960875 ] Kevin Zhang edited comment on FLINK-14539 at 10/28/19 9:06 AM: ---

[jira] [Commented] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-28 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960875#comment-16960875 ] Kevin Zhang commented on FLINK-14539: - Thanks for your opinions[~jark][~danny0405].

[jira] [Updated] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-27 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated FLINK-14539: Description: Currently unique key metadata of a project relnode are only kept in the following th

[jira] [Comment Edited] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-27 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960781#comment-16960781 ] Kevin Zhang edited comment on FLINK-14539 at 10/28/19 6:12 AM: ---

[jira] [Commented] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-27 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960781#comment-16960781 ] Kevin Zhang commented on FLINK-14539: - I indend to implement this using a RexBiVisit

[jira] [Created] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-27 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-14539: --- Summary: Unique key metadata should be ketp when using concat or concat_ws in some cases Key: FLINK-14539 URL: https://issues.apache.org/jira/browse/FLINK-14539 Project

[jira] [Created] (FLINK-14539) Unique key metadata should be ketp when using concat or concat_ws in some cases

2019-10-27 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-14539: --- Summary: Unique key metadata should be ketp when using concat or concat_ws in some cases Key: FLINK-14539 URL: https://issues.apache.org/jira/browse/FLINK-14539 Project

[jira] [Closed] (FLINK-14436) Add getter for ContextEnvironment instance in StreamContextEnvironment

2019-10-17 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang closed FLINK-14436. --- Resolution: Won't Fix > Add getter for ContextEnvironment instance in StreamContextEnvironment > ---

[jira] [Commented] (FLINK-14436) Add getter for ContextEnvironment instance in StreamContextEnvironment

2019-10-17 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954317#comment-16954317 ] Kevin Zhang commented on FLINK-14436: - Thanks [~tison] for the information, I'll clo

[jira] [Created] (FLINK-14436) Add getter for ContextEnvironment instance in StreamContextEnvironment

2019-10-17 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-14436: --- Summary: Add getter for ContextEnvironment instance in StreamContextEnvironment Key: FLINK-14436 URL: https://issues.apache.org/jira/browse/FLINK-14436 Project: Flink

[jira] [Created] (FLINK-14436) Add getter for ContextEnvironment instance in StreamContextEnvironment

2019-10-17 Thread Kevin Zhang (Jira)
Kevin Zhang created FLINK-14436: --- Summary: Add getter for ContextEnvironment instance in StreamContextEnvironment Key: FLINK-14436 URL: https://issues.apache.org/jira/browse/FLINK-14436 Project: Flink

[jira] [Commented] (FLINK-13547) Verify and correct string function's semantic for Blink planner

2019-08-26 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916313#comment-16916313 ] Kevin Zhang commented on FLINK-13547: - Thanks [~docete] and [~jark], we will have a

[jira] [Comment Edited] (FLINK-13547) Verify and correct string function's semantic for Blink planner

2019-08-23 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914052#comment-16914052 ] Kevin Zhang edited comment on FLINK-13547 at 8/23/19 8:33 AM:

[jira] [Commented] (FLINK-13547) Verify and correct string function's semantic for Blink planner

2019-08-23 Thread Kevin Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914052#comment-16914052 ] Kevin Zhang commented on FLINK-13547: - Hi [~docete] [~jark],is there substitute stan

[jira] [Commented] (SPARK-24036) Stateful operators in continuous processing

2019-07-27 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894323#comment-16894323 ] Kevin Zhang commented on SPARK-24036: - Hi [~joseph.torres], is there any update on t

[jira] [Issue Comment Deleted] (SPARK-24630) SPIP: Support SQLStreaming in Spark

2019-04-16 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-24630: Comment: was deleted (was: thanks [~Jackey Lee] So I'm wondering what's blocking the pr of this is

[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

2019-04-15 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818598#comment-16818598 ] Kevin Zhang commented on SPARK-24630: - thanks [~Jackey Lee] So I'm wondering what's

[jira] [Updated] (SPARK-27340) Alias on TimeWIndow expression may cause watermark metadata lost

2019-04-01 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-27340: Description: When we use data api to write a structured streaming query job we usually specify a

[jira] [Updated] (SPARK-27340) Alias on TimeWIndow expression may cause watermark metadata lost

2019-04-01 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-27340: Description: When we use data api to write a structured streaming query job we usually specify a

[jira] [Created] (SPARK-27340) Alias on TimeWIndow expression may cause watermark metadata lost

2019-04-01 Thread Kevin Zhang (JIRA)
Kevin Zhang created SPARK-27340: --- Summary: Alias on TimeWIndow expression may cause watermark metadata lost Key: SPARK-27340 URL: https://issues.apache.org/jira/browse/SPARK-27340 Project: Spark

[jira] [Commented] (SPARK-24630) SPIP: Support SQLStreaming in Spark

2019-03-28 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16804535#comment-16804535 ] Kevin Zhang commented on SPARK-24630: - Hi, is there any update about the progress?

[jira] [Updated] (SPARK-26350) Allow the user to override the group id of the Kafka's consumer

2018-12-13 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-26350: Attachment: Permalink.url > Allow the user to override the group id of the Kafka's consumer >

[jira] [Commented] (CASSANDRA-14358) OutboundTcpConnection can hang for many minutes when nodes restart

2018-09-27 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630690#comment-16630690 ] Kevin Zhang commented on CASSANDRA-14358: - [~jolynch]: thanks for the answer

[jira] [Commented] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

2018-06-21 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519994#comment-16519994 ] Kevin Zhang commented on SPARK-20295: - Still hit this bug in spark 2.3.0 > when sp

[jira] [Commented] (CASSANDRA-14358) OutboundTcpConnection can hang for many minutes when nodes restart

2018-06-08 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506404#comment-16506404 ] Kevin Zhang commented on CASSANDRA-14358: - [~jolynch] currently we have an i

[jira] [Commented] (SPARK-14974) spark sql job create too many files in HDFS when doing insert overwrite hive table

2018-02-28 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16380126#comment-16380126 ] Kevin Zhang commented on SPARK-14974: - I encountered the same problem with [~ussraf]

[jira] [Commented] (SPARK-23498) Accuracy problem in comparison with string and integer

2018-02-27 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16379753#comment-16379753 ] Kevin Zhang commented on SPARK-23498: - yes, thanks. But when we use spark sql to run

[jira] [Updated] (SPARK-23498) Accuracy problem in comparison with string and integer

2018-02-23 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-23498: Description: While comparing a string column with integer value, spark sql will automatically cast

[jira] [Created] (SPARK-23498) Accuracy problem in comparison with string and integer

2018-02-23 Thread Kevin Zhang (JIRA)
Kevin Zhang created SPARK-23498: --- Summary: Accuracy problem in comparison with string and integer Key: SPARK-23498 URL: https://issues.apache.org/jira/browse/SPARK-23498 Project: Spark Issue Ty

[jira] [Commented] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

2017-12-12 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288608#comment-16288608 ] Kevin Zhang commented on SPARK-22755: - [~ksunitha] Thanks, it helps a lot > Expressi

[jira] [Comment Edited] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

2017-12-11 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286961#comment-16286961 ] Kevin Zhang edited comment on SPARK-22755 at 12/12/17 2:03 AM:

[jira] [Comment Edited] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

2017-12-11 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286961#comment-16286961 ] Kevin Zhang edited comment on SPARK-22755 at 12/12/17 1:58 AM:

[jira] [Commented] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

2017-12-11 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286961#comment-16286961 ] Kevin Zhang commented on SPARK-22755: - Thanks for reply. In hive and presto the resul

[jira] [Created] (SPARK-22755) Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results

2017-12-11 Thread Kevin Zhang (JIRA)
Kevin Zhang created SPARK-22755: --- Summary: Expression (946-885)*1.0/946 < 0.1 and (946-885)*1.000/946 < 0.1 return different results Key: SPARK-22755 URL: https://issues.apache.org/jira/browse/SPARK-22755

[jira] [Updated] (AIRFLOW-1836) Airflow select keycloak as OAuth Provider

2017-11-20 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated AIRFLOW-1836: - Description: As the need of my project in hand, I had to integrate keycloak with airflow.During

[jira] [Created] (AIRFLOW-1836) Airflow select keycloak as OAuth Provider

2017-11-20 Thread Kevin Zhang (JIRA)
Kevin Zhang created AIRFLOW-1836: Summary: Airflow select keycloak as OAuth Provider Key: AIRFLOW-1836 URL: https://issues.apache.org/jira/browse/AIRFLOW-1836 Project: Apache Airflow Issue Ty

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

2017-09-08 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158948#comment-16158948 ] Kevin Zhang commented on SPARK-21944: - [~mgaido] Do you mean the following way by say

[jira] [Comment Edited] (SPARK-21944) Watermark on window column is wrong

2017-09-07 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158055#comment-16158055 ] Kevin Zhang edited comment on SPARK-21944 at 9/8/17 2:51 AM: -

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

2017-09-07 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158055#comment-16158055 ] Kevin Zhang commented on SPARK-21944: - I found the problem when I use kafka source co

[jira] [Created] (SPARK-21944) Watermark on window column is wrong

2017-09-07 Thread Kevin Zhang (JIRA)
Kevin Zhang created SPARK-21944: --- Summary: Watermark on window column is wrong Key: SPARK-21944 URL: https://issues.apache.org/jira/browse/SPARK-21944 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-09 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120924#comment-16120924 ] Kevin Zhang commented on SPARK-21590: - Thanks, I'd like to work on this. I agree th

[jira] [Comment Edited] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-07 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117900#comment-16117900 ] Kevin Zhang edited comment on SPARK-21590 at 8/8/17 6:15 AM: -

[jira] [Comment Edited] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-07 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117900#comment-16117900 ] Kevin Zhang edited comment on SPARK-21590 at 8/8/17 6:05 AM: -

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-07 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117900#comment-16117900 ] Kevin Zhang commented on SPARK-21590: - [~brkyvz] Thanks for your advice, but I believ

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-02 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16112274#comment-16112274 ] Kevin Zhang commented on SPARK-21590: - [~brkyvz] I don' t know the test you illustrat

[jira] [Commented] (SPARK-21546) dropDuplicates with watermark yields RuntimeException due to binding failure

2017-08-02 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16112146#comment-16112146 ] Kevin Zhang commented on SPARK-21546: - [~zsxwing] in my case I hope to use a watermar

[jira] [Commented] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-01 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110209#comment-16110209 ] Kevin Zhang commented on SPARK-21590: - I think the only problem is the non-negative c

[jira] [Updated] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-01 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Zhang updated SPARK-21590: Description: I want to calculate (unique) daily access count using structured streaming (2.2.0).

[jira] [Created] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-07-31 Thread Kevin Zhang (JIRA)
Kevin Zhang created SPARK-21590: --- Summary: Structured Streaming window start time should support negative values to adjust time zone Key: SPARK-21590 URL: https://issues.apache.org/jira/browse/SPARK-21590

[jira] [Comment Edited] (SPARK-12221) Add CPU time metric to TaskMetrics

2016-09-18 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15500750#comment-15500750 ] Kevin Zhang edited comment on SPARK-12221 at 9/18/16 10:35 AM:

[jira] [Commented] (SPARK-12221) Add CPU time metric to TaskMetrics

2016-09-18 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15500750#comment-15500750 ] Kevin Zhang commented on SPARK-12221: - hi, is there any plan to put this to trunk??

[jira] [Commented] (HIVE-13160) HS2 unable to load UDFs on startup when HMS is not ready

2016-07-26 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395141#comment-15395141 ] Kevin Zhang commented on HIVE-13160: I met this issue these days when I was trying to

[jira] [Commented] (SPARK-13514) Spark Shuffle Service 1.6.0 issue in Yarn

2016-07-18 Thread Kevin Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383437#comment-15383437 ] Kevin Zhang commented on SPARK-13514: - yes file:// does exsit and this is definitely