[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001809#comment-15001809 ] Study Hsueh commented on SPARK-11191: - I have wrote a workaround patch for this issue

[jira] [Created] (SPARK-11691) Allow to specify compression codec in HadoopFsRelation when saving

Jeff Zhang created SPARK-11691: -- Summary: Allow to specify compression codec in HadoopFsRelation when saving Key: SPARK-11691 URL: https://issues.apache.org/jira/browse/SPARK-11691 Project: Spark

[jira] [Commented] (SPARK-6790) Model export/import for spark.ml: LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-6790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001802#comment-15001802 ] Apache Spark commented on SPARK-6790: - User 'fayeshine' has created a pull request for

[jira] [Commented] (SPARK-11691) Allow to specify compression codec in HadoopFsRelation when saving

[ https://issues.apache.org/jira/browse/SPARK-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001801#comment-15001801 ] Jeff Zhang commented on SPARK-11691: Will create a PR soon. > Allow to specify compr

[jira] [Assigned] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11687: Assignee: Apache Spark > Mixed usage of fold and foldLeft, reduce and reduceLeft and reduc

[jira] [Commented] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001793#comment-15001793 ] Apache Spark commented on SPARK-11687: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11687: Assignee: (was: Apache Spark) > Mixed usage of fold and foldLeft, reduce and reduceLef

[jira] [Commented] (SPARK-11690) Add pivot to python api

[ https://issues.apache.org/jira/browse/SPARK-11690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001790#comment-15001790 ] Apache Spark commented on SPARK-11690: -- User 'aray' has created a pull request for t

[jira] [Assigned] (SPARK-11690) Add pivot to python api

[ https://issues.apache.org/jira/browse/SPARK-11690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11690: Assignee: (was: Apache Spark) > Add pivot to python api > --- > >

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001791#comment-15001791 ] Apache Spark commented on SPARK-9319: - User 'felixcheung' has created a pull request f

[jira] [Assigned] (SPARK-11690) Add pivot to python api

[ https://issues.apache.org/jira/browse/SPARK-11690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11690: Assignee: Apache Spark > Add pivot to python api > --- > >

[jira] [Created] (SPARK-11690) Add pivot to python api

Andrew Ray created SPARK-11690: -- Summary: Add pivot to python api Key: SPARK-11690 URL: https://issues.apache.org/jira/browse/SPARK-11690 Project: Spark Issue Type: Improvement Compone

[jira] [Comment Edited] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001777#comment-15001777 ] Pavel Pletnev edited comment on SPARK-11191 at 11/12/15 7:13 AM: --

[jira] [Comment Edited] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001777#comment-15001777 ] Pavel Pletnev edited comment on SPARK-11191 at 11/12/15 7:13 AM: --

[jira] [Updated] (SPARK-11689) Add user guide and example code for LDA under spark.ml

[ https://issues.apache.org/jira/browse/SPARK-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11689: -- Description: Add simple user guide for LDA under spark.ml and example code under examples/. Use

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001777#comment-15001777 ] Pavel Pletnev commented on SPARK-11191: --- Checked 10 hours ago. Pulled from master.

[jira] [Created] (SPARK-11689) Add user guide and example code for LDA under spark.ml

Xiangrui Meng created SPARK-11689: - Summary: Add user guide and example code for LDA under spark.ml Key: SPARK-11689 URL: https://issues.apache.org/jira/browse/SPARK-11689 Project: Spark Issu

[jira] [Updated] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11605: -- Assignee: yuhao yang > ML 1.6 QA: API: Java compatibility, docs > -

[jira] [Updated] (SPARK-11602) ML 1.6 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-11602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11602: -- Assignee: yuhao yang > ML 1.6 QA: API: New Scala APIs, docs > -

[jira] [Created] (SPARK-11688) UDF's doesn't work when it has a default arguments

M Bharat lal created SPARK-11688: Summary: UDF's doesn't work when it has a default arguments Key: SPARK-11688 URL: https://issues.apache.org/jira/browse/SPARK-11688 Project: Spark Issue Type

[jira] [Updated] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-11687: - Description: As can be seen here https://github.com/scala/scala/blob/2.12.x/src/library/scala/co

[jira] [Commented] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001767#comment-15001767 ] Hyukjin Kwon commented on SPARK-11687: -- I think some might disagree with this. I wou

[jira] [Updated] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-11687: - Description: As can be seen here https://github.com/scala/scala/blob/2.12.x/src/library/scala/co

[jira] [Updated] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-11687: - Description: As can be seen here https://github.com/scala/scala/blob/2.12.x/src/library/scala/co

[jira] [Assigned] (SPARK-11603) ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit

[ https://issues.apache.org/jira/browse/SPARK-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-11603: --- Assignee: DB Tsai > ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit > --

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-11600: Description: This JIRA lists tasks for the next MLlib release's QA period. h2. API * Check binary API com

[jira] [Created] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

Hyukjin Kwon created SPARK-11687: Summary: Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption Key: SPARK-11687 URL: https://issues.apache.org/jira/browse/SPARK-11687

[jira] [Commented] (SPARK-11686) Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

[ https://issues.apache.org/jira/browse/SPARK-11686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001757#comment-15001757 ] Jacek Laskowski commented on SPARK-11686: - I'd like to work on this if agreed. >

[jira] [Created] (SPARK-11686) Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set

Jacek Laskowski created SPARK-11686: --- Summary: Issue WARN when dynamic allocation is disabled due to spark.dynamicAllocation.enabled and spark.executor.instances both set Key: SPARK-11686 URL: https://issues.apa

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11600: -- Description: This JIRA lists tasks for the next MLlib release's QA period. h2. API * Check bi

[jira] [Updated] (SPARK-11685) Find duplicate content under examples/

[ https://issues.apache.org/jira/browse/SPARK-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11685: -- Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-11600) > Find duplicat

[jira] [Updated] (SPARK-11685) Find duplicate content under examples/

[ https://issues.apache.org/jira/browse/SPARK-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11685: -- Summary: Find duplicate content under examples/ (was: Check duplicate content under examples/)

[jira] [Updated] (SPARK-11685) Find duplicate content under examples/

[ https://issues.apache.org/jira/browse/SPARK-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11685: -- Description: Because we moved some example code from user guide markdown to examples/ folder. T

[jira] [Created] (SPARK-11685) Check duplicate content under examples/

Xiangrui Meng created SPARK-11685: - Summary: Check duplicate content under examples/ Key: SPARK-11685 URL: https://issues.apache.org/jira/browse/SPARK-11685 Project: Spark Issue Type: Sub-tas

[jira] [Created] (SPARK-11684) Update user guide to show new features in SparkR:::glm and SparkR:::summary

Xiangrui Meng created SPARK-11684: - Summary: Update user guide to show new features in SparkR:::glm and SparkR:::summary Key: SPARK-11684 URL: https://issues.apache.org/jira/browse/SPARK-11684 Project

[jira] [Updated] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dai updated SPARK-9273: - Assignee: yuhao yang > Add Convolutional Neural network to Spark MLlib > -

[jira] [Updated] (SPARK-11607) Update MLlib website for 1.6

[ https://issues.apache.org/jira/browse/SPARK-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11607: -- Assignee: Xiangrui Meng > Update MLlib website for 1.6 > > >

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11604: -- Assignee: Yanbo Liang > ML 1.6 QA: API: Python API coverage > -

[jira] [Commented] (SPARK-9597) Add Spark Streaming + MQTT Integration Guide

[ https://issues.apache.org/jira/browse/SPARK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001751#comment-15001751 ] Chris Howard commented on SPARK-9597: - I have started working on this. Thanks > Add S

[jira] [Commented] (SPARK-11668) R style summary stats in GLM package SparkR

[ https://issues.apache.org/jira/browse/SPARK-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001745#comment-15001745 ] Shubhanshu Mishra commented on SPARK-11668: --- Thanks just checked the package. T

[jira] [Commented] (SPARK-11620) parquet.hadoop.ParquetOutputCommitter.commitJob() throws parquet.io.ParquetEncodingException

[ https://issues.apache.org/jira/browse/SPARK-11620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001746#comment-15001746 ] Hyukjin Kwon commented on SPARK-11620: -- Can you tell me your Spark version? Spark 1

[jira] [Commented] (SPARK-6790) Model export/import for spark.ml: LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-6790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001739#comment-15001739 ] Earthson Lu commented on SPARK-6790: I'm sorry, It's PR for SPARK-6727~ > Model expor

[jira] [Assigned] (SPARK-6727) Model export/import for spark.ml: HashingTF

[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6727: --- Assignee: Apache Spark > Model export/import for spark.ml: HashingTF > --

[jira] [Commented] (SPARK-8487) Update reduceByKeyAndWindow docs to highlight that filtering Function must be used

[ https://issues.apache.org/jira/browse/SPARK-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001737#comment-15001737 ] Chris Howard commented on SPARK-8487: - Hi [~tdas] - can you clarify this doc change?

[jira] [Assigned] (SPARK-6727) Model export/import for spark.ml: HashingTF

[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6727: --- Assignee: (was: Apache Spark) > Model export/import for spark.ml: HashingTF > ---

[jira] [Commented] (SPARK-6727) Model export/import for spark.ml: HashingTF

[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001738#comment-15001738 ] Apache Spark commented on SPARK-6727: - User 'Earthson' has created a pull request for

[jira] [Commented] (SPARK-11544) sqlContext doesn't use PathFilter

[ https://issues.apache.org/jira/browse/SPARK-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001730#comment-15001730 ] Apache Spark commented on SPARK-11544: -- User 'dilipbiswal' has created a pull reques

[jira] [Assigned] (SPARK-11544) sqlContext doesn't use PathFilter

[ https://issues.apache.org/jira/browse/SPARK-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11544: Assignee: Apache Spark > sqlContext doesn't use PathFilter > -

[jira] [Assigned] (SPARK-11544) sqlContext doesn't use PathFilter

[ https://issues.apache.org/jira/browse/SPARK-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11544: Assignee: (was: Apache Spark) > sqlContext doesn't use PathFilter > --

[jira] [Commented] (SPARK-11326) Support for authentication and encryption in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001727#comment-15001727 ] Jacek Lewandowski commented on SPARK-11326: --- [~pwendell] this leverage the curr

[jira] [Created] (SPARK-11683) DataFrameWriter.insertInto() fails on non-default schema

Luis Antonio Torres created SPARK-11683: --- Summary: DataFrameWriter.insertInto() fails on non-default schema Key: SPARK-11683 URL: https://issues.apache.org/jira/browse/SPARK-11683 Project: Spark

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001721#comment-15001721 ] LingZhou commented on SPARK-11617: -- Ok, it's in two programs. In one programs, it's like

[jira] [Commented] (SPARK-10785) Scale QuantileDiscretizer using distributed binning

[ https://issues.apache.org/jira/browse/SPARK-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001719#comment-15001719 ] Rachel Warren commented on SPARK-10785: --- Taking this over given that its very simil

[jira] [Assigned] (SPARK-11678) Partition discovery fail if there is a _SUCCESS file in the table's root dir

[ https://issues.apache.org/jira/browse/SPARK-11678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11678: Assignee: Yin Huai (was: Apache Spark) > Partition discovery fail if there is a _SUCCESS

[jira] [Assigned] (SPARK-11678) Partition discovery fail if there is a _SUCCESS file in the table's root dir

[ https://issues.apache.org/jira/browse/SPARK-11678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11678: Assignee: Apache Spark (was: Yin Huai) > Partition discovery fail if there is a _SUCCESS

[jira] [Commented] (SPARK-11678) Partition discovery fail if there is a _SUCCESS file in the table's root dir

[ https://issues.apache.org/jira/browse/SPARK-11678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001710#comment-15001710 ] Apache Spark commented on SPARK-11678: -- User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-1021: -- Labels: (was: starter) > sortByKey() launches a cluster job when it shouldn't > --

[jira] [Resolved] (SPARK-11674) Word2Vec code failed compile in Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-11674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11674. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9644 [https://gi

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001692#comment-15001692 ] Marcelo Vanzin commented on SPARK-11617: Do you have the complete exception? I do

[jira] [Commented] (SPARK-11682) Commons-collections object deserialization may expose remote command execution vulnerability

[ https://issues.apache.org/jira/browse/SPARK-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001690#comment-15001690 ] Marcelo Vanzin commented on SPARK-11682: If you want to look at exploitability of

[jira] [Commented] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001685#comment-15001685 ] Xin Wu commented on SPARK-10848: One case I found where there is inconsistency between us

[jira] [Resolved] (SPARK-11396) datetime function: to_unix_timestamp

[ https://issues.apache.org/jira/browse/SPARK-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11396. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9347 [https://github.c

[jira] [Assigned] (SPARK-6790) Model export/import for spark.ml: LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-6790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6790: --- Assignee: Apache Spark > Model export/import for spark.ml: LinearRegression > ---

[jira] [Assigned] (SPARK-6790) Model export/import for spark.ml: LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-6790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6790: --- Assignee: (was: Apache Spark) > Model export/import for spark.ml: LinearRegression >

[jira] [Commented] (SPARK-6790) Model export/import for spark.ml: LinearRegression

[ https://issues.apache.org/jira/browse/SPARK-6790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001670#comment-15001670 ] Apache Spark commented on SPARK-6790: - User 'Earthson' has created a pull request for

[jira] [Commented] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001667#comment-15001667 ] Xin Wu commented on SPARK-10848: Debugging through the code and found that in ResolvedDat

[jira] [Commented] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001653#comment-15001653 ] mayuanwen commented on SPARK-11679: --- The exception is easy to reproduced. I create a ja

[jira] [Commented] (SPARK-11623) Sparksql-1.4.1 DataFrameWrite.jdbc() bug

[ https://issues.apache.org/jira/browse/SPARK-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001648#comment-15001648 ] Nguyen Van Nghia commented on SPARK-11623: -- I am using Spark to update RDB table

[jira] [Comment Edited] (SPARK-11623) Sparksql-1.4.1 DataFrameWrite.jdbc() bug

[ https://issues.apache.org/jira/browse/SPARK-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001648#comment-15001648 ] Nguyen Van Nghia edited comment on SPARK-11623 at 11/12/15 3:34 AM: ---

[jira] [Resolved] (SPARK-11675) Remove shuffle hash joins

[ https://issues.apache.org/jira/browse/SPARK-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11675. - Resolution: Fixed Fix Version/s: 1.6.0 > Remove shuffle hash joins > -

[jira] [Assigned] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11679: Assignee: Apache Spark > When invoking method " apply(fields: java.util.List[StructField])

[jira] [Commented] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001642#comment-15001642 ] Apache Spark commented on SPARK-11679: -- User 'jackieMaKing' has created a pull reque

[jira] [Assigned] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11679: Assignee: (was: Apache Spark) > When invoking method " apply(fields: java.util.List[St

[jira] [Created] (SPARK-11682) Commons-collections object deserialization may expose remote command execution vulnerability

Ted Yu created SPARK-11682: -- Summary: Commons-collections object deserialization may expose remote command execution vulnerability Key: SPARK-11682 URL: https://issues.apache.org/jira/browse/SPARK-11682 Proj

[jira] [Assigned] (SPARK-11681) Fix state timestamp update logic in TrackStateRDD

[ https://issues.apache.org/jira/browse/SPARK-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11681: Assignee: Apache Spark (was: Tathagata Das) > Fix state timestamp update logic in TrackSt

[jira] [Assigned] (SPARK-11681) Fix state timestamp update logic in TrackStateRDD

[ https://issues.apache.org/jira/browse/SPARK-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11681: Assignee: Tathagata Das (was: Apache Spark) > Fix state timestamp update logic in TrackSt

[jira] [Commented] (SPARK-11681) Fix state timestamp update logic in TrackStateRDD

[ https://issues.apache.org/jira/browse/SPARK-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001634#comment-15001634 ] Apache Spark commented on SPARK-11681: -- User 'tdas' has created a pull request for t

[jira] [Created] (SPARK-11681) Fix state timestamp update logic in TrackStateRDD

Tathagata Das created SPARK-11681: - Summary: Fix state timestamp update logic in TrackStateRDD Key: SPARK-11681 URL: https://issues.apache.org/jira/browse/SPARK-11681 Project: Spark Issue Typ

[jira] [Updated] (SPARK-10408) Autoencoder

[ https://issues.apache.org/jira/browse/SPARK-10408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Ulanov updated SPARK-10408: - Description: Goal: Implement various types of autoencoders Requirements: 1)Basic (deep)

[jira] [Created] (SPARK-11680) graphx it's now surpport semantic graphs and have data lake?

David created SPARK-11680: - Summary: graphx it's now surpport semantic graphs and have data lake? Key: SPARK-11680 URL: https://issues.apache.org/jira/browse/SPARK-11680 Project: Spark Issue Type: T

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001615#comment-15001615 ] LingZhou commented on SPARK-11617: -- After testing this pull request, there is no ERROR:

[jira] [Commented] (SPARK-6727) Model export/import for spark.ml: HashingTF

[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001599#comment-15001599 ] Earthson Lu commented on SPARK-6727: It seems that we could implement a default reader

[jira] [Updated] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mayuanwen updated SPARK-11679: -- Description: When invoking method " apply(fields: java.util.List[StructField])" in Object "StructType"

[jira] [Updated] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mayuanwen updated SPARK-11679: -- Summary: When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get except

[jira] [Commented] (SPARK-6727) Model export/import for spark.ml: HashingTF

[ https://issues.apache.org/jira/browse/SPARK-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001590#comment-15001590 ] Earthson Lu commented on SPARK-6727: Is the API ready? Can I work on this? > Model ex

[jira] [Commented] (SPARK-6725) Model export/import for Pipeline API

[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001578#comment-15001578 ] Earthson Lu commented on SPARK-6725: Can we expect the this api be usable in spark-1.6

[jira] [Created] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" of in "StructType", get exception "java.lang.ClassCastException:

mayuanwen created SPARK-11679: - Summary: When invoking method " apply(fields: java.util.List[StructField])" of in "StructType", get exception "java.lang.ClassCastException: Key: SPARK-11679 URL: https://issues.apach

[jira] [Commented] (SPARK-11569) StringIndexer transform fails when column contains nulls

[ https://issues.apache.org/jira/browse/SPARK-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001439#comment-15001439 ] Jia Li commented on SPARK-11569: Hi [~josephkb] [~holdenk_amp], I'd like to hear your op

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001438#comment-15001438 ] Hitoshi Ozawa commented on SPARK-7708: -- Chill project is willing to upgrade to Kryo 3

[jira] [Commented] (SPARK-10113) Support for unsigned Parquet logical types

[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001435#comment-15001435 ] Apache Spark commented on SPARK-10113: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-10113) Support for unsigned Parquet logical types

[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10113: Assignee: (was: Apache Spark) > Support for unsigned Parquet logical types > -

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001434#comment-15001434 ] Hitoshi Ozawa commented on SPARK-11416: --- That's why I'm proposing Kryo upgrade to b

[jira] [Assigned] (SPARK-10113) Support for unsigned Parquet logical types

[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10113: Assignee: Apache Spark > Support for unsigned Parquet logical types >

[jira] [Created] (SPARK-11678) Partition discovery fail if there is a _SUCCESS file in the table's root dir

Yin Huai created SPARK-11678: Summary: Partition discovery fail if there is a _SUCCESS file in the table's root dir Key: SPARK-11678 URL: https://issues.apache.org/jira/browse/SPARK-11678 Project: Spark

[jira] [Assigned] (SPARK-11678) Partition discovery fail if there is a _SUCCESS file in the table's root dir

[ https://issues.apache.org/jira/browse/SPARK-11678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-11678: Assignee: Yin Huai > Partition discovery fail if there is a _SUCCESS file in the table's root dir

[jira] [Comment Edited] (SPARK-11583) Make MapStatus use less memory uage

[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001420#comment-15001420 ] Kent Yao edited comment on SPARK-11583 at 11/12/15 12:48 AM: -

[jira] [Assigned] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-11661: Assignee: Yin Huai > We should still pushdown filters returned by a data source's unhandledFilters

[jira] [Commented] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001423#comment-15001423 ] Cheng Hao commented on SPARK-10865: --- 1.5.2 is released, I am not sure whether part of i

[jira] [Commented] (SPARK-10865) [Spark SQL] [UDF] the ceil/ceiling function got wrong return value type

[ https://issues.apache.org/jira/browse/SPARK-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001422#comment-15001422 ] Cheng Hao commented on SPARK-10865: --- We actually follow the criteria of Hive, and actua

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001420#comment-15001420 ] Kent Yao commented on SPARK-11583: -- Are these methods {noformat} r.add(0,20) {noform

  1   2   3   >