[jira] [Updated] (SPARK-16285) Implement sentences SQL function

[ https://issues.apache.org/jira/browse/SPARK-16285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16285: Assignee: Dongjoon Hyun > Implement sentences SQL function > > >

[jira] [Closed] (SPARK-16277) Implement java_method SQL function

[ https://issues.apache.org/jira/browse/SPARK-16277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16277. --- Resolution: Duplicate Assignee: Peter Lee > Implement java_method SQL function > --

[jira] [Updated] (SPARK-16284) Implement reflect and java_method SQL function

[ https://issues.apache.org/jira/browse/SPARK-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16284: Assignee: Peter Lee > Implement reflect and java_method SQL function >

[jira] [Updated] (SPARK-16284) Implement reflect and java_method SQL function

[ https://issues.apache.org/jira/browse/SPARK-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16284: Summary: Implement reflect and java_method SQL function (was: Implement reflect SQL function) > I

[jira] [Closed] (SPARK-16315) Implement code generation for elt function

[ https://issues.apache.org/jira/browse/SPARK-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16315. --- Resolution: Won't Fix I'm going to mark this as won't fix for now since it is unclear to me how impo

[jira] [Closed] (SPARK-16346) Implement code generation for parse_url function

[ https://issues.apache.org/jira/browse/SPARK-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16346. --- Resolution: Won't Fix I'm going to mark this as won't fix for now since it is unclear to me how impo

[jira] [Resolved] (SPARK-15847) DecisionTreeRunner example stucks with "NoClassDefFoundError: org/apache/avro/generic/GenericRecord"

[ https://issues.apache.org/jira/browse/SPARK-15847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora resolved SPARK-15847. Resolution: Cannot Reproduce > DecisionTreeRunner example stucks with "NoClassDefFoundError: > org

[jira] [Commented] (SPARK-15968) HiveMetastoreCatalog does not correctly validate partitioned metastore relation when searching the internal table cache

[ https://issues.apache.org/jira/browse/SPARK-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363877#comment-15363877 ] Apache Spark commented on SPARK-15968: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363871#comment-15363871 ] SuYan commented on SPARK-3630: -- 1. snappy 1.0.4.1 + Kryo + spark 1.6.1 --> throw Pars

[jira] [Updated] (SPARK-16390) Dataset API improvement in Spark 2.1

[ https://issues.apache.org/jira/browse/SPARK-16390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16390: Summary: Dataset API improvement in Spark 2.1 (was: Dataset API improvement) > Dataset API improv

[jira] [Created] (SPARK-16391) KeyValueGroupedDataset.reduceGroups should support partial aggregation

Reynold Xin created SPARK-16391: --- Summary: KeyValueGroupedDataset.reduceGroups should support partial aggregation Key: SPARK-16391 URL: https://issues.apache.org/jira/browse/SPARK-16391 Project: Spark

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363850#comment-15363850 ] Lev commented on SPARK-16387: - I am not sure what PR means. > Reserved SQL words are not esc

[jira] [Updated] (SPARK-15810) Aggregator doesn't play nice with Option

[ https://issues.apache.org/jira/browse/SPARK-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15810: Description: {code} val ds1 = List(("a", 1), ("a", 2), ("a", 3)).toDS val ds2 = ds1.map{ case (k, v

[jira] [Updated] (SPARK-15810) Aggregator doesn't play nice with Option

[ https://issues.apache.org/jira/browse/SPARK-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15810: Description: {code} val ds1 = List(("a", 1), ("a", 2), ("a", 3)).toDS val ds2 = ds1.map

[jira] [Updated] (SPARK-15769) Add Encoder for input type to Aggregator

[ https://issues.apache.org/jira/browse/SPARK-15769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15769: Issue Type: Sub-task (was: Improvement) Parent: SPARK-16390 > Add Encoder for input type t

[jira] [Comment Edited] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363802#comment-15363802 ] Lev edited comment on SPARK-16387 at 7/6/16 6:14 AM: - JdbcDialect cla

[jira] [Updated] (SPARK-15810) Aggregator doesn't play nice with Option

[ https://issues.apache.org/jira/browse/SPARK-15810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15810: Issue Type: Sub-task (was: Bug) Parent: SPARK-16390 > Aggregator doesn't play nice with Op

[jira] [Created] (SPARK-16390) Dataset API improvement

Reynold Xin created SPARK-16390: --- Summary: Dataset API improvement Key: SPARK-16390 URL: https://issues.apache.org/jira/browse/SPARK-16390 Project: Spark Issue Type: Improvement Compo

[jira] [Updated] (SPARK-15780) Support mapValues on KeyValueGroupedDataset

[ https://issues.apache.org/jira/browse/SPARK-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15780: Issue Type: Sub-task (was: Improvement) Parent: SPARK-16390 > Support mapValues on KeyValu

[jira] [Issue Comment Deleted] (SPARK-13485) (Dataset-oriented) API evolution in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13485: Comment: was deleted (was: User 'dilipbiswal' has created a pull request for this issue: https://gi

[jira] [Commented] (SPARK-16007) Empty DataFrame created with spark.read.csv() does not respect user specified schema

[ https://issues.apache.org/jira/browse/SPARK-16007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363825#comment-15363825 ] Reynold Xin commented on SPARK-16007: - Is this done yet? > Empty DataFrame created

[jira] [Updated] (SPARK-16007) Empty DataFrame created with spark.read.csv() does not respect user specified schema

[ https://issues.apache.org/jira/browse/SPARK-16007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16007: Target Version/s: 2.1.0 (was: 2.0.0) > Empty DataFrame created with spark.read.csv() does not resp

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363817#comment-15363817 ] Dongjoon Hyun commented on SPARK-16387: --- Then, could you make a PR for this? > Res

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363802#comment-15363802 ] Lev commented on SPARK-16387: - JdbcDialect class has a functionality that allows DB-dependent

[jira] [Resolved] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16389. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14062 [https://githu

[jira] [Resolved] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16340. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > In regexp_replac

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363775#comment-15363775 ] Mukul Garg commented on SPARK-16340: I have checked the PR. This is what I have reque

[jira] [Commented] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363768#comment-15363768 ] Hyukjin Kwon commented on SPARK-16371: -- Sorry for being noisy, here is the Scala ver

[jira] [Comment Edited] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363757#comment-15363757 ] Hyukjin Kwon edited comment on SPARK-16371 at 7/6/16 4:34 AM: -

[jira] [Commented] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363757#comment-15363757 ] Hyukjin Kwon commented on SPARK-16371: -- Here is shorter codes {code} from pyspark.s

[jira] [Updated] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16389: Assignee: Xiao Li > Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and > `Spar

[jira] [Commented] (SPARK-15730) [Spark SQL] the value of 'hiveconf' parameter in Spark-sql CLI don't take effect in spark-sql session

[ https://issues.apache.org/jira/browse/SPARK-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363691#comment-15363691 ] Yi Zhou commented on SPARK-15730: - Thanks a lot [~chenghao] and [~yhuai] ! > [Spark SQL]

[jira] [Commented] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363682#comment-15363682 ] Dongjoon Hyun commented on SPARK-16387: --- Hi, `escaping` sounds possible, but it is

[jira] [Updated] (SPARK-16286) Implement stack table generating function

[ https://issues.apache.org/jira/browse/SPARK-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16286: Assignee: Dongjoon Hyun > Implement stack table generating function > -

[jira] [Resolved] (SPARK-16286) Implement stack table generating function

[ https://issues.apache.org/jira/browse/SPARK-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-16286. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14033 [https://githu

[jira] [Assigned] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16389: Assignee: (was: Apache Spark) > Remove useless `MetastoreRelation` from `SparkHiveWrit

[jira] [Commented] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363594#comment-15363594 ] Apache Spark commented on SPARK-16389: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

[ https://issues.apache.org/jira/browse/SPARK-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16389: Assignee: Apache Spark > Remove useless `MetastoreRelation` from `SparkHiveWriterContainer

[jira] [Updated] (SPARK-15761) pyspark shell should load if PYSPARK_DRIVER_PYTHON is ipython an Python3

[ https://issues.apache.org/jira/browse/SPARK-15761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15761: Fix Version/s: (was: 2.0.1) 2.0.0 > pyspark shell should load if PYSPARK_DRI

[jira] [Updated] (SPARK-16182) Utils.scala -- terminateProcess() should call Process.destroyForcibly() if and only if Process.destroy() fails

[ https://issues.apache.org/jira/browse/SPARK-16182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16182: Fix Version/s: (was: 2.0.1) 2.0.0 > Utils.scala -- terminateProcess() should

[jira] [Created] (SPARK-16389) Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer`

Xiao Li created SPARK-16389: --- Summary: Remove useless `MetastoreRelation` from `SparkHiveWriterContainer` and `SparkHiveDynamicPartitionWriterContainer` Key: SPARK-16389 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-16353) Intended javadoc options are not honored for Java unidoc

[ https://issues.apache.org/jira/browse/SPARK-16353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16353: Fix Version/s: (was: 2.0.1) 2.0.0 > Intended javadoc options are not honored

[jira] [Commented] (SPARK-16382) YARN - Dynamic allocation with spark.executor.instances should increase max executors.

[ https://issues.apache.org/jira/browse/SPARK-16382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363592#comment-15363592 ] Saisai Shao commented on SPARK-16382: - I would suggest to fail and complain. Max usua

[jira] [Assigned] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

[ https://issues.apache.org/jira/browse/SPARK-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16388: Assignee: Apache Spark (was: Reynold Xin) > Remove spark.sql.nativeView and spark.sql.nat

[jira] [Assigned] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

[ https://issues.apache.org/jira/browse/SPARK-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16388: Assignee: Reynold Xin (was: Apache Spark) > Remove spark.sql.nativeView and spark.sql.nat

[jira] [Commented] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

[ https://issues.apache.org/jira/browse/SPARK-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363585#comment-15363585 ] Apache Spark commented on SPARK-16388: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-16388) Remove spark.sql.nativeView and spark.sql.nativeView.canonical config

Reynold Xin created SPARK-16388: --- Summary: Remove spark.sql.nativeView and spark.sql.nativeView.canonical config Key: SPARK-16388 URL: https://issues.apache.org/jira/browse/SPARK-16388 Project: Spark

[jira] [Commented] (SPARK-16371) IS NOT NULL clause gives false for nested not empty column

[ https://issues.apache.org/jira/browse/SPARK-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363548#comment-15363548 ] Hyukjin Kwon commented on SPARK-16371: -- [~maver1ck] [~proflin] I could reproduce thi

[jira] [Commented] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363509#comment-15363509 ] Jeff Zhang commented on SPARK-16367: Preparing the wheelhouse seems time consuming to

[jira] [Commented] (SPARK-16367) Wheelhouse Support for PySpark

[ https://issues.apache.org/jira/browse/SPARK-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363513#comment-15363513 ] Jeff Zhang commented on SPARK-16367: Oh, happen to find this project to build local p

[jira] [Resolved] (SPARK-16348) pyspark.ml MLSerDe should be called using full classpath

[ https://issues.apache.org/jira/browse/SPARK-16348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-16348. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14023 [h

[jira] [Resolved] (SPARK-16385) NoSuchMethodException thrown by Utils.waitForProcess

[ https://issues.apache.org/jira/browse/SPARK-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16385. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 > NoSuchMet

[jira] [Resolved] (SPARK-16383) Remove `SessionState.executeSql`

[ https://issues.apache.org/jira/browse/SPARK-16383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16383. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 > Remove `SessionS

[jira] [Resolved] (SPARK-16359) unidoc workaround for multiple kafka versions

[ https://issues.apache.org/jira/browse/SPARK-16359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-16359. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14041 [https://g

[jira] [Resolved] (SPARK-15730) [Spark SQL] the value of 'hiveconf' parameter in Spark-sql CLI don't take effect in spark-sql session

[ https://issues.apache.org/jira/browse/SPARK-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15730. - Resolution: Fixed Assignee: Cheng Hao Fix Version/s: 2.0.0 > [Spark SQL] the valu

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363482#comment-15363482 ] Dongjoon Hyun commented on SPARK-16340: --- Please check if the PR is what you want. :

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363478#comment-15363478 ] Apache Spark commented on SPARK-16340: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16340: Assignee: (was: Apache Spark) > In regexp_replace function column and/or column expres

[jira] [Assigned] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16340: Assignee: Apache Spark > In regexp_replace function column and/or column expression should

[jira] [Commented] (SPARK-16340) In regexp_replace function column and/or column expression should also allowed as replacement.

[ https://issues.apache.org/jira/browse/SPARK-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363469#comment-15363469 ] Dongjoon Hyun commented on SPARK-16340: --- Hi, [~mukul.ga...@gmail.com]. I'll make a

[jira] [Updated] (SPARK-16387) Reserved SQL words are not escaped by JDBC writer

[ https://issues.apache.org/jira/browse/SPARK-16387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lev updated SPARK-16387: Summary: Reserved SQL words are not escaped by JDBC writer (was: Reserved words are not escaped for JDBC writer)

[jira] [Created] (SPARK-16387) Reserved words are not escaped for JDBC writer

Lev created SPARK-16387: --- Summary: Reserved words are not escaped for JDBC writer Key: SPARK-16387 URL: https://issues.apache.org/jira/browse/SPARK-16387 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-16377) Spark MLlib: MultilayerPerceptronClassifier - error while training

[ https://issues.apache.org/jira/browse/SPARK-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363458#comment-15363458 ] Mikhail Shiryaev commented on SPARK-16377: -- The original issue with ArrayIndexOu

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363454#comment-15363454 ] Joseph K. Bradley commented on SPARK-16240: --- +1 for adding special logic in the

[jira] [Comment Edited] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363438#comment-15363438 ] Vladimir Ivanov edited comment on SPARK-16334 at 7/5/16 11:13 PM: -

[jira] [Commented] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363438#comment-15363438 ] Vladimir Ivanov commented on SPARK-16334: - Hi, we discovered problem with the sam

[jira] [Commented] (SPARK-16384) FROM_UNIXTIME reports incorrect days

[ https://issues.apache.org/jira/browse/SPARK-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363420#comment-15363420 ] Dongjoon Hyun commented on SPARK-16384: --- It's the behavior of Java `SimpleDateForma

[jira] [Commented] (SPARK-16384) FROM_UNIXTIME reports incorrect days

[ https://issues.apache.org/jira/browse/SPARK-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363418#comment-15363418 ] Dongjoon Hyun commented on SPARK-16384: --- Hi, [~epanastasi] That is not a bug. You

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363410#comment-15363410 ] Michael Gummelt commented on SPARK-11857: - Thanks! > Remove Mesos fine-grained m

[jira] [Updated] (SPARK-16386) SQLContext and HiveContext parse a query string differently

[ https://issues.apache.org/jira/browse/SPARK-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Ren updated SPARK-16386: Description: I just want to figure out why the two contexts behavior differently even on a simple query. I

[jira] [Updated] (SPARK-16386) SQLContext and HiveContext parse a query string differently

[ https://issues.apache.org/jira/browse/SPARK-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Ren updated SPARK-16386: Description: I just want to figure out why the two contexts behavior differently even on a simple query. I

[jira] [Created] (SPARK-16386) SQLContext and HiveContext parse a query string differently

Hao Ren created SPARK-16386: --- Summary: SQLContext and HiveContext parse a query string differently Key: SPARK-16386 URL: https://issues.apache.org/jira/browse/SPARK-16386 Project: Spark Issue Type

[jira] [Updated] (SPARK-16386) SQLContext and HiveContext parse a query string differently

[ https://issues.apache.org/jira/browse/SPARK-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Ren updated SPARK-16386: Description: I just want to figure out why the two contexts behavior differently even on a simple query. I

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363404#comment-15363404 ] Adam McElwee commented on SPARK-11857: -- Nah, carry on. I'm not using spark at the ne

[jira] [Updated] (SPARK-16324) regexp_extract should doc that it returns empty string when match fails

[ https://issues.apache.org/jira/browse/SPARK-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16324: -- Issue Type: Improvement (was: Bug) Summary: regexp_extract should doc that it returns empty stri

[jira] [Updated] (SPARK-15909) PySpark classpath uri incorrectly set

[ https://issues.apache.org/jira/browse/SPARK-15909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15909: -- Priority: Minor (was: Major) This is another instance of something that isn't generally supported -- r

[jira] [Updated] (SPARK-15804) Manually added metadata not saving with parquet

[ https://issues.apache.org/jira/browse/SPARK-15804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15804: -- Fix Version/s: (was: 2.0.0) > Manually added metadata not saving with parquet > ---

[jira] [Resolved] (SPARK-16098) Multiclass SVM Learning

[ https://issues.apache.org/jira/browse/SPARK-16098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16098. --- Resolution: Won't Fix > Multiclass SVM Learning > --- > > Key: SP

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363367#comment-15363367 ] Michael Gummelt commented on SPARK-11857: - I'll give [~amcelwee] a couple days to

[jira] [Commented] (SPARK-15730) [Spark SQL] the value of 'hiveconf' parameter in Spark-sql CLI don't take effect in spark-sql session

[ https://issues.apache.org/jira/browse/SPARK-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363355#comment-15363355 ] Apache Spark commented on SPARK-15730: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363345#comment-15363345 ] Michael Gummelt commented on SPARK-11857: - For completeness, here's my theoretica

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363331#comment-15363331 ] Reynold Xin commented on SPARK-11857: - Michael can you submit a pull request to log d

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363324#comment-15363324 ] Sean Owen commented on SPARK-16379: --- Of course we'd all like to never have bugs. Nobody

[jira] [Issue Comment Deleted] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16379: Comment: was deleted (was: > We have a bug and need to address it in the best way w

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363321#comment-15363321 ] Michael Gummelt commented on SPARK-11857: - [~amcelwee] Do you have any more input

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363302#comment-15363302 ] Stavros Kontopoulos edited comment on SPARK-16379 at 7/5/16 9:49 PM: --

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363314#comment-15363314 ] Stavros Kontopoulos commented on SPARK-16379: - > Nobody is suggesting knowing

[jira] [Commented] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363311#comment-15363311 ] Michael Gummelt commented on SPARK-11857: - I endorse the deprecation. Fine-grain

[jira] [Reopened] (SPARK-11857) Remove Mesos fine-grained mode subject to discussions

[ https://issues.apache.org/jira/browse/SPARK-11857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt reopened SPARK-11857: - > Remove Mesos fine-grained mode subject to discussions > ---

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363305#comment-15363305 ] Stavros Kontopoulos commented on SPARK-16379: - > We have a bug and need to ad

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363303#comment-15363303 ] Sean Owen commented on SPARK-16379: --- It's true, I can't say for sure the problem exists

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363302#comment-15363302 ] Stavros Kontopoulos commented on SPARK-16379: - There was no bug previously in

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:35 PM: --

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:34 PM: --

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363296#comment-15363296 ] Sean Owen commented on SPARK-16379: --- I don't think it's even a bad practice, any more t

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:33 PM: --

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363289#comment-15363289 ] Michael Gummelt edited comment on SPARK-16379 at 7/5/16 9:31 PM: --

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363290#comment-15363290 ] Michael Gummelt commented on SPARK-16379: - Hmmm, since that's a different lock, I

[jira] [Commented] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363289#comment-15363289 ] Michael Gummelt commented on SPARK-16379: - I say we add a new lock to synchronize

[jira] [Comment Edited] (SPARK-16379) Spark on mesos is broken due to race condition in Logging

[ https://issues.apache.org/jira/browse/SPARK-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363278#comment-15363278 ] Stavros Kontopoulos edited comment on SPARK-16379 at 7/5/16 9:27 PM: --

  1   2   3   >