[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-07 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367310#comment-15367310 ] Xin Ren commented on SPARK-16437: - I'm working on it :) > SparkR read.df() from parquet

[jira] [Created] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-07 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16437: --- Summary: SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" Key: SPARK-16437 URL: https://issues.apache.org/jira/browse/SPARK-16437

[jira] [Updated] (SPARK-16436) checkEvaluation should support NaN values

2016-07-07 Thread Peter Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee updated SPARK-16436: -- Summary: checkEvaluation should support NaN values (was: checkEvaluation should support NaN values and

[jira] [Resolved] (SPARK-16430) Add an option in file stream source to read 1 file at a time

2016-07-07 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-16430. --- Resolution: Fixed > Add an option in file stream source to read 1 file at a time > --

[jira] [Commented] (SPARK-16333) Excessive Spark history event/json data size (5GB each)

2016-07-07 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367283#comment-15367283 ] Carson Wang commented on SPARK-16333: - This doesn't look like related to SPARK-11206

[jira] [Updated] (SPARK-16318) xpath_int, xpath_short, xpath_long, xpath_float, xpath_double, xpath_string, and xpath

2016-07-07 Thread Peter Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee updated SPARK-16318: -- Summary: xpath_int, xpath_short, xpath_long, xpath_float, xpath_double, xpath_string, and xpath (was:

[jira] [Comment Edited] (SPARK-5770) Use addJar() to upload a new jar file to executor, it can't be added to classloader

2016-07-07 Thread Namrata (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367227#comment-15367227 ] Namrata edited comment on SPARK-5770 at 7/8/16 5:09 AM: Even I ran

[jira] [Commented] (SPARK-5770) Use addJar() to upload a new jar file to executor, it can't be added to classloader

2016-07-07 Thread Namrata (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367227#comment-15367227 ] Namrata commented on SPARK-5770: Even I ran into the same issue while reloading the jar f

[jira] [Updated] (SPARK-16286) Implement stack table generating function

2016-07-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16286: Fix Version/s: 2.0.1 > Implement stack table generating function >

[jira] [Updated] (SPARK-16288) Implement inline table generating function

2016-07-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16288: Fix Version/s: 2.0.1 > Implement inline table generating function > ---

[jira] [Updated] (SPARK-16271) Implement Hive's UDFXPathUtil

2016-07-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16271: Fix Version/s: 2.0.1 > Implement Hive's UDFXPathUtil > - > >

[jira] [Updated] (SPARK-16274) Implement xpath_boolean

2016-07-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16274: Fix Version/s: 2.0.1 > Implement xpath_boolean > --- > > Key: S

[jira] [Updated] (SPARK-16279) Implement map_values SQL function

2016-07-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16279: Fix Version/s: 2.0.1 > Implement map_values SQL function > - > >

[jira] [Updated] (SPARK-16278) Implement map_keys SQL function

2016-07-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16278: Fix Version/s: 2.0.1 > Implement map_keys SQL function > --- > >

[jira] [Updated] (SPARK-16276) Implement elt SQL function

2016-07-07 Thread Peter Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee updated SPARK-16276: -- Fix Version/s: 2.0.1 > Implement elt SQL function > -- > > Key:

[jira] [Commented] (SPARK-16276) Implement elt SQL function

2016-07-07 Thread Peter Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367191#comment-15367191 ] Peter Lee commented on SPARK-16276: --- I've also back ported this into branch-2.0 in case

[jira] [Issue Comment Deleted] (SPARK-16276) Implement elt SQL function

2016-07-07 Thread Peter Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Lee updated SPARK-16276: -- Comment: was deleted (was: I've also back ported this into branch-2.0 in case we cut another rc, and t

[jira] [Assigned] (SPARK-16436) checkEvaluation should support NaN values and RuntimeReplaceable

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16436: Assignee: (was: Apache Spark) > checkEvaluation should support NaN values and RuntimeR

[jira] [Assigned] (SPARK-16436) checkEvaluation should support NaN values and RuntimeReplaceable

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16436: Assignee: Apache Spark > checkEvaluation should support NaN values and RuntimeReplaceable

[jira] [Commented] (SPARK-16436) checkEvaluation should support NaN values and RuntimeReplaceable

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367177#comment-15367177 ] Apache Spark commented on SPARK-16436: -- User 'petermaxlee' has created a pull reques

[jira] [Created] (SPARK-16436) checkEvaluation should support NaN values and RuntimeReplaceable

2016-07-07 Thread Peter Lee (JIRA)
Peter Lee created SPARK-16436: - Summary: checkEvaluation should support NaN values and RuntimeReplaceable Key: SPARK-16436 URL: https://issues.apache.org/jira/browse/SPARK-16436 Project: Spark I

[jira] [Created] (SPARK-16435) Behavior changes if initialExecutor is less than minExecutor for dynamic allocation

2016-07-07 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-16435: --- Summary: Behavior changes if initialExecutor is less than minExecutor for dynamic allocation Key: SPARK-16435 URL: https://issues.apache.org/jira/browse/SPARK-16435 Pro

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Neil Dewar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367060#comment-15367060 ] Neil Dewar commented on SPARK-16425: Thanks so much Dongjoon. As someone without the

[jira] [Assigned] (SPARK-16434) Avoid record-per type dispatch in JSON when reading

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16434: Assignee: Apache Spark > Avoid record-per type dispatch in JSON when reading > ---

[jira] [Commented] (SPARK-16434) Avoid record-per type dispatch in JSON when reading

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367051#comment-15367051 ] Apache Spark commented on SPARK-16434: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-16434) Avoid record-per type dispatch in JSON when reading

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16434: Assignee: (was: Apache Spark) > Avoid record-per type dispatch in JSON when reading >

[jira] [Created] (SPARK-16434) Avoid record-per type dispatch in JSON when reading

2016-07-07 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-16434: Summary: Avoid record-per type dispatch in JSON when reading Key: SPARK-16434 URL: https://issues.apache.org/jira/browse/SPARK-16434 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-16431) Add a unified method that accepts single instances to feature transformers and predictors

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16431: Assignee: Apache Spark > Add a unified method that accepts single instances to feature tra

[jira] [Assigned] (SPARK-16431) Add a unified method that accepts single instances to feature transformers and predictors

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16431: Assignee: (was: Apache Spark) > Add a unified method that accepts single instances to

[jira] [Commented] (SPARK-16431) Add a unified method that accepts single instances to feature transformers and predictors

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367041#comment-15367041 ] Apache Spark commented on SPARK-16431: -- User 'husseinhazimeh' has created a pull req

[jira] [Updated] (SPARK-16431) Add a unified method that accepts single instances to feature transformers and predictors

2016-07-07 Thread Hussein Hazimeh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hussein Hazimeh updated SPARK-16431: Summary: Add a unified method that accepts single instances to feature transformers and pre

[jira] [Updated] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16425: -- Assignee: Dongjoon Hyun > SparkR summary() fails on column of type logical > --

[jira] [Resolved] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16425. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Assigned] (SPARK-16433) Improve StreamingQuery.explain when no data arrives

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16433: Assignee: Apache Spark (was: Shixiong Zhu) > Improve StreamingQuery.explain when no data

[jira] [Assigned] (SPARK-16433) Improve StreamingQuery.explain when no data arrives

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16433: Assignee: Shixiong Zhu (was: Apache Spark) > Improve StreamingQuery.explain when no data

[jira] [Commented] (SPARK-16433) Improve StreamingQuery.explain when no data arrives

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367029#comment-15367029 ] Apache Spark commented on SPARK-16433: -- User 'zsxwing' has created a pull request fo

[jira] [Created] (SPARK-16433) Improve StreamingQuery.explain when no data arrives

2016-07-07 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-16433: Summary: Improve StreamingQuery.explain when no data arrives Key: SPARK-16433 URL: https://issues.apache.org/jira/browse/SPARK-16433 Project: Spark Issue Typ

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367014#comment-15367014 ] Dongjoon Hyun commented on SPARK-16425: --- It is a good issue. You're good at this if

[jira] [Commented] (SPARK-16432) Empty blocks fail to serialize due to assert in ChunkedByteBuffer

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367007#comment-15367007 ] Apache Spark commented on SPARK-16432: -- User 'ericl' has created a pull request for

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Neil Dewar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367005#comment-15367005 ] Neil Dewar commented on SPARK-16425: Thanks very much. I wasn't aware of the limitat

[jira] [Assigned] (SPARK-16432) Empty blocks fail to serialize due to assert in ChunkedByteBuffer

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16432: Assignee: Apache Spark > Empty blocks fail to serialize due to assert in ChunkedByteBuffer

[jira] [Assigned] (SPARK-16432) Empty blocks fail to serialize due to assert in ChunkedByteBuffer

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16432: Assignee: (was: Apache Spark) > Empty blocks fail to serialize due to assert in Chunke

[jira] [Created] (SPARK-16432) Empty blocks fail to serialize due to assert in ChunkedByteBuffer

2016-07-07 Thread Eric Liang (JIRA)
Eric Liang created SPARK-16432: -- Summary: Empty blocks fail to serialize due to assert in ChunkedByteBuffer Key: SPARK-16432 URL: https://issues.apache.org/jira/browse/SPARK-16432 Project: Spark

[jira] [Updated] (SPARK-16432) Empty blocks fail to serialize due to assert in ChunkedByteBuffer

2016-07-07 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-16432: --- Component/s: Spark Core > Empty blocks fail to serialize due to assert in ChunkedByteBuffer > ---

[jira] [Comment Edited] (SPARK-16344) Array of struct with a single field name "element" can't be decoded from Parquet files written by Spark 1.6+

2016-07-07 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366069#comment-15366069 ] Cheng Lian edited comment on SPARK-16344 at 7/8/16 12:12 AM: -

[jira] [Created] (SPARK-16431) Add a unified method that accepts single instances in transformers and predictors

2016-07-07 Thread Hussein Hazimeh (JIRA)
Hussein Hazimeh created SPARK-16431: --- Summary: Add a unified method that accepts single instances in transformers and predictors Key: SPARK-16431 URL: https://issues.apache.org/jira/browse/SPARK-16431

[jira] [Commented] (SPARK-16365) Ideas for moving "mllib-local" forward

2016-07-07 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366978#comment-15366978 ] Manoj Kumar commented on SPARK-16365: - Is the ultimate aim to make mllib-local, the s

[jira] [Commented] (SPARK-16404) LeastSquaresAggregator in Linear Regression serializes unnecessary data

2016-07-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366975#comment-15366975 ] DB Tsai commented on SPARK-16404: - I think something like the following will work. Note t

[jira] [Assigned] (SPARK-16380) Update SQL examples and programming guide for Python language binding

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16380: Assignee: Miao Wang (was: Apache Spark) > Update SQL examples and programming guide for P

[jira] [Commented] (SPARK-16380) Update SQL examples and programming guide for Python language binding

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366967#comment-15366967 ] Apache Spark commented on SPARK-16380: -- User 'wangmiao1981' has created a pull reque

[jira] [Assigned] (SPARK-16380) Update SQL examples and programming guide for Python language binding

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16380: Assignee: Apache Spark (was: Miao Wang) > Update SQL examples and programming guide for P

[jira] [Commented] (SPARK-16380) Update SQL examples and programming guide for Python language binding

2016-07-07 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366954#comment-15366954 ] Miao Wang commented on SPARK-16380: --- I just finished the work. Sending PR now. > Upda

[jira] [Updated] (SPARK-16429) Include `StringType` columns in `describe()`

2016-07-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16429: -- Description: Currently, Spark `describe` supports `StringType`. However, `describe()` returns

[jira] [Commented] (SPARK-16303) Update SQL examples and programming guide for Scala and Java language bindings

2016-07-07 Thread Anton Okolnychyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366905#comment-15366905 ] Anton Okolnychyi commented on SPARK-16303: -- [~lian cheng] I would like to share

[jira] [Comment Edited] (SPARK-16422) maven 3.3.3 missing from mirror, breaks older builds

2016-07-07 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366875#comment-15366875 ] Luciano Resende edited comment on SPARK-16422 at 7/7/16 10:25 PM: -

[jira] [Updated] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16310: -- Fix Version/s: 2.1.0 > SparkR csv source should have the same default na.string

[jira] [Updated] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16310: -- Assignee: Felix Cheung > SparkR csv source should have the same default na.stri

[jira] [Resolved] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-07 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16310. --- Resolution: Fixed Fix Version/s: 2.0.1 Issue resolved by pull request

[jira] [Commented] (SPARK-16422) maven 3.3.3 missing from mirror, breaks older builds

2016-07-07 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366875#comment-15366875 ] Luciano Resende commented on SPARK-16422: - When new builds are released, old ones

[jira] [Assigned] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16425: Assignee: (was: Apache Spark) > SparkR summary() fails on column of type logical > ---

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366868#comment-15366868 ] Apache Spark commented on SPARK-16425: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16425: Assignee: Apache Spark > SparkR summary() fails on column of type logical > --

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366860#comment-15366860 ] Dongjoon Hyun commented on SPARK-16425: --- I'll make a PR to prevent errors first. >

[jira] [Commented] (SPARK-16422) maven 3.3.3 missing from mirror, breaks older builds

2016-07-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366829#comment-15366829 ] Thomas Graves commented on SPARK-16422: --- do we know why maven 3.3.3 got removed? I

[jira] [Commented] (SPARK-16423) Inconsistent settings on the first day of a week

2016-07-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366756#comment-15366756 ] Xiao Li commented on SPARK-16423: - Sure, let me find a right person for this. Thanks! >

[jira] [Assigned] (SPARK-16429) Include `StringType` columns in Scala/Python `describe()`

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16429: Assignee: Apache Spark > Include `StringType` columns in Scala/Python `describe()` > -

[jira] [Assigned] (SPARK-16429) Include `StringType` columns in Scala/Python `describe()`

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16429: Assignee: (was: Apache Spark) > Include `StringType` columns in Scala/Python `describe

[jira] [Commented] (SPARK-16429) Include `StringType` columns in Scala/Python `describe()`

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366746#comment-15366746 ] Apache Spark commented on SPARK-16429: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Updated] (SPARK-16428) Spark file system watcher not working on Windows

2016-07-07 Thread John-Michael Reed (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John-Michael Reed updated SPARK-16428: -- Description: Two people tested Apache Spark on their computers... [Spark Download - ht

[jira] [Assigned] (SPARK-16430) Add an option in file stream source to read 1 file at a time

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16430: Assignee: Apache Spark (was: Tathagata Das) > Add an option in file stream source to read

[jira] [Assigned] (SPARK-16430) Add an option in file stream source to read 1 file at a time

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16430: Assignee: Tathagata Das (was: Apache Spark) > Add an option in file stream source to read

[jira] [Commented] (SPARK-16430) Add an option in file stream source to read 1 file at a time

2016-07-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366736#comment-15366736 ] Apache Spark commented on SPARK-16430: -- User 'tdas' has created a pull request for t

[jira] [Created] (SPARK-16430) Add an option in file stream source to read 1 file at a time

2016-07-07 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-16430: - Summary: Add an option in file stream source to read 1 file at a time Key: SPARK-16430 URL: https://issues.apache.org/jira/browse/SPARK-16430 Project: Spark

[jira] [Created] (SPARK-16429) Include `StringType` columns in Scala/Python `describe()`

2016-07-07 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-16429: - Summary: Include `StringType` columns in Scala/Python `describe()` Key: SPARK-16429 URL: https://issues.apache.org/jira/browse/SPARK-16429 Project: Spark I

[jira] [Created] (SPARK-16428) Spark file system watcher not working on Windows

2016-07-07 Thread John-Michael Reed (JIRA)
John-Michael Reed created SPARK-16428: - Summary: Spark file system watcher not working on Windows Key: SPARK-16428 URL: https://issues.apache.org/jira/browse/SPARK-16428 Project: Spark Is

[jira] [Commented] (SPARK-16427) Expand documentation on the various RDD storage levels

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366711#comment-15366711 ] Nicholas Chammas commented on SPARK-16427: -- My first question about this would b

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3181: Component/s: (was: MLilb) MLlib > Add Robust Regression Algorithm with

[jira] [Updated] (SPARK-16074) Expose VectorUDT/MatrixUDT in a public API

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-16074: - Component/s: (was: MLilb) MLlib > Expose VectorUDT/MatrixUDT in a pu

[jira] [Updated] (SPARK-16156) RowMatrıx Covariance

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-16156: - Component/s: (was: MLilb) MLlib > RowMatrıx Covariance > ---

[jira] [Updated] (SPARK-16377) Spark MLlib: MultilayerPerceptronClassifier - error while training

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-16377: - Component/s: (was: MLilb) MLlib > Spark MLlib: MultilayerPerceptronC

[jira] [Updated] (SPARK-16290) text type features column for classification

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-16290: - Component/s: (was: MLilb) MLlib > text type features column for clas

[jira] [Updated] (SPARK-16232) Getting error by making columns using DataFrame

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-16232: - Component/s: (was: MLilb) MLlib > Getting error by making columns us

[jira] [Created] (SPARK-16427) Expand documentation on the various RDD storage levels

2016-07-07 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-16427: Summary: Expand documentation on the various RDD storage levels Key: SPARK-16427 URL: https://issues.apache.org/jira/browse/SPARK-16427 Project: Spark

[jira] [Commented] (SPARK-15760) Documentation missing for package-related config options

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366702#comment-15366702 ] Nicholas Chammas commented on SPARK-15760: -- Updating component since it seems we

[jira] [Updated] (SPARK-15441) dataset outer join seems to return incorrect result

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-15441: - Component/s: (was: sq;) SQL > dataset outer join seems to return inc

[jira] [Updated] (SPARK-15772) Improve Scala API docs

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-15772: - Component/s: (was: docs) > Improve Scala API docs > --- > >

[jira] [Updated] (SPARK-15760) Documentation missing for package-related config options

2016-07-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-15760: - Component/s: (was: docs) Documentation > Documentation missing for p

[jira] [Commented] (SPARK-8696) Streaming API for Online LDA

2016-07-07 Thread Matthew Morgan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366695#comment-15366695 ] Matthew Morgan commented on SPARK-8696: --- Here's my request for it; I'd like to use i

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-07-07 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: (was: 27814004000_spark_heap_2016-06-17_12-05.hprof.gz) > spark HistoryServer

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-07-07 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: (was: spark-spark-org.apache.spark.deploy.history.HistoryServer-1-testbic1on5

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-07-07 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: (was: 27814.004.000.sparkhistoryservermemory.log.1) > spark HistoryServer mem

[jira] [Updated] (SPARK-16426) IsotonicRegression produces NaNs with certain data

2016-07-07 Thread Nic Eggert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nic Eggert updated SPARK-16426: --- Description: {code} val r = sc.parallelize(Seq[(Double, Double, Double)]((2, 1, 1), (1, 1, 1), (0, 2

[jira] [Created] (SPARK-16426) IsotonicRegression produces NaNs with certain data

2016-07-07 Thread Nic Eggert (JIRA)
Nic Eggert created SPARK-16426: -- Summary: IsotonicRegression produces NaNs with certain data Key: SPARK-16426 URL: https://issues.apache.org/jira/browse/SPARK-16426 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366624#comment-15366624 ] Dongjoon Hyun commented on SPARK-16425: --- Oh, sorry. I'll comment after more investi

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366612#comment-15366612 ] Dongjoon Hyun commented on SPARK-16425: --- In SparkR, `summary` is an alias for `desc

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366609#comment-15366609 ] Dongjoon Hyun commented on SPARK-16425: --- The possible quick fix is preventing the f

[jira] [Updated] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

2016-07-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-16240: -- Priority: Major (was: Minor) > model loading backward compatibility for ml.clustering.

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

2016-07-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366606#comment-15366606 ] Joseph K. Bradley commented on SPARK-16240: --- It would be great to get help on t

[jira] [Commented] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366604#comment-15366604 ] Dongjoon Hyun commented on SPARK-16425: --- Unfortunately, Spark seems to support only

[jira] [Commented] (SPARK-16422) maven 3.3.3 missing from mirror, breaks older builds

2016-07-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366582#comment-15366582 ] Thomas Graves commented on SPARK-16422: --- I'll pop this discussions up on dev list a

  1   2   3   >