[jira] [Assigned] (SPARK-18575) Keep same style: adjust the position of driver log links

[ https://issues.apache.org/jira/browse/SPARK-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18575: Assignee: Apache Spark > Keep same style: adjust the position of driver log links > --

[jira] [Assigned] (SPARK-18575) Keep same style: adjust the position of driver log links

[ https://issues.apache.org/jira/browse/SPARK-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18575: Assignee: (was: Apache Spark) > Keep same style: adjust the position of driver log lin

[jira] [Commented] (SPARK-18575) Keep same style: adjust the position of driver log links

[ https://issues.apache.org/jira/browse/SPARK-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692527#comment-15692527 ] Apache Spark commented on SPARK-18575: -- User 'uncleGen' has created a pull request f

[jira] [Assigned] (SPARK-18575) Keep same style: adjust the position of driver log links

[ https://issues.apache.org/jira/browse/SPARK-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18575: Assignee: (was: Apache Spark) > Keep same style: adjust the position of driver log lin

[jira] [Assigned] (SPARK-18575) Keep same style: adjust the position of driver log links

[ https://issues.apache.org/jira/browse/SPARK-18575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18575: Assignee: Apache Spark > Keep same style: adjust the position of driver log links > --

[jira] [Created] (SPARK-18575) Keep same style: adjust the position of driver log links

Genmao Yu created SPARK-18575: - Summary: Keep same style: adjust the position of driver log links Key: SPARK-18575 URL: https://issues.apache.org/jira/browse/SPARK-18575 Project: Spark Issue Type

[jira] [Created] (SPARK-18574) Keep same style: adjust the position of

Genmao Yu created SPARK-18574: - Summary: Keep same style: adjust the position of Key: SPARK-18574 URL: https://issues.apache.org/jira/browse/SPARK-18574 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-18537) Add a REST api to spark streaming

[ https://issues.apache.org/jira/browse/SPARK-18537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692466#comment-15692466 ] Apache Spark commented on SPARK-18537: -- User 'ChorPangChan' has created a pull reque

[jira] [Closed] (SPARK-18552) Watermark should not rely on sinks to proceed

[ https://issues.apache.org/jira/browse/SPARK-18552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin closed SPARK-18552. - Resolution: Not A Problem > Watermark should not rely on sinks to proceed > -

[jira] [Commented] (SPARK-8560) Executors page displays negative active tasks

[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692346#comment-15692346 ] Lantao Jin commented on SPARK-8560: --- It still displays negative active tasks in UI of Sp

[jira] [Commented] (SPARK-18552) Watermark should not rely on sinks to proceed

[ https://issues.apache.org/jira/browse/SPARK-18552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692322#comment-15692322 ] Liwei Lin commented on SPARK-18552: --- Yea that's right. Thanks a lot for the clarificati

[jira] [Commented] (SPARK-18468) Flaky test: org.apache.spark.sql.hive.HiveSparkSubmitSuite.SPARK-9757 Persist Parquet relation with decimal column

[ https://issues.apache.org/jira/browse/SPARK-18468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692245#comment-15692245 ] Wenchen Fan commented on SPARK-18468: - looks like the executor was lost due to some u

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692147#comment-15692147 ] Apache Spark commented on SPARK-3359: - User 'HyukjinKwon' has created a pull request f

[jira] [Resolved] (SPARK-18573) when restart yarn cluster, the spark streaming job will lost ?

[ https://issues.apache.org/jira/browse/SPARK-18573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18573. Resolution: Information Provided Please don't use Jira for questions; there are people on t

[jira] [Commented] (SPARK-18573) when restart yarn cluster, the spark streaming job will lost ?

[ https://issues.apache.org/jira/browse/SPARK-18573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691986#comment-15691986 ] hustfxj commented on SPARK-18573: - when I restart yarn cluster, the spark streaming jobs

[jira] [Created] (SPARK-18573) when restart yarn cluster, the spark streaming job will lost ?

hustfxj created SPARK-18573: --- Summary: when restart yarn cluster, the spark streaming job will lost ? Key: SPARK-18573 URL: https://issues.apache.org/jira/browse/SPARK-18573 Project: Spark Issue

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691878#comment-15691878 ] Xiao Li commented on SPARK-18549: - True. > Failed to Uncache a View that References a Dr

[jira] [Comment Edited] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691690#comment-15691690 ] Herman van Hovell edited comment on SPARK-18549 at 11/23/16 11:48 PM: -

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691690#comment-15691690 ] Herman van Hovell commented on SPARK-18549: --- That only works for the sqlContext

[jira] [Comment Edited] (SPARK-18551) Add functionality to delete event logs from the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-18551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691341#comment-15691341 ] Marcelo Vanzin edited comment on SPARK-18551 at 11/23/16 11:11 PM:

[jira] [Commented] (SPARK-18506) kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only read from a single partition on a multi partition topic

[ https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691582#comment-15691582 ] Heji Kim commented on SPARK-18506: -- My ansible automation just downloads the official di

[jira] [Commented] (SPARK-18572) Use the hive client method "getPartitionNames" to answer "SHOW PARTITIONS" queries on partitioned Hive tables

[ https://issues.apache.org/jira/browse/SPARK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691513#comment-15691513 ] Apache Spark commented on SPARK-18572: -- User 'mallman' has created a pull request fo

[jira] [Updated] (SPARK-18572) Use the hive client method "getPartitionNames" to answer "SHOW PARTITIONS" queries on partitioned Hive tables

[ https://issues.apache.org/jira/browse/SPARK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-18572: --- Description: Currently Spark answers the {{SHOW PARTITIONS}} query by fetching all of the ta

[jira] [Assigned] (SPARK-18572) Use the hive client method "getPartitionNames" to answer "SHOW PARTITIONS" queries on partitioned Hive tables

[ https://issues.apache.org/jira/browse/SPARK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18572: Assignee: (was: Apache Spark) > Use the hive client method "getPartitionNames" to answ

[jira] [Assigned] (SPARK-18572) Use the hive client method "getPartitionNames" to answer "SHOW PARTITIONS" queries on partitioned Hive tables

[ https://issues.apache.org/jira/browse/SPARK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18572: Assignee: Apache Spark > Use the hive client method "getPartitionNames" to answer "SHOW PA

[jira] [Commented] (SPARK-18510) Partition schema inference corrupts data

[ https://issues.apache.org/jira/browse/SPARK-18510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691458#comment-15691458 ] Apache Spark commented on SPARK-18510: -- User 'zsxwing' has created a pull request fo

[jira] [Closed] (SPARK-17786) [SPARK 2.0] Sorting algorithm gives higher skewness of output

[ https://issues.apache.org/jira/browse/SPARK-17786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-17786. --- Resolution: Not A Problem Closing this. Please use the dev list for discussion. > [SPARK 2.0] Sorti

[jira] [Commented] (SPARK-18482) make sure Spark can access the table metadata created by older version of spark

[ https://issues.apache.org/jira/browse/SPARK-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691450#comment-15691450 ] Reynold Xin commented on SPARK-18482: - What's the deal with this? Can we just dump th

[jira] [Updated] (SPARK-17786) [SPARK 2.0] Sorting algorithm gives higher skewness of output

[ https://issues.apache.org/jira/browse/SPARK-17786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17786: Target Version/s: (was: 2.1.0) > [SPARK 2.0] Sorting algorithm gives higher skewness of output >

[jira] [Created] (SPARK-18572) Use the hive client method "getPartitionNames" to answer "SHOW PARTITIONS" queries on partitioned Hive tables

Michael Allman created SPARK-18572: -- Summary: Use the hive client method "getPartitionNames" to answer "SHOW PARTITIONS" queries on partitioned Hive tables Key: SPARK-18572 URL: https://issues.apache.org/jira/bro

[jira] [Commented] (SPARK-18506) kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only read from a single partition on a multi partition topic

[ https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691386#comment-15691386 ] Cody Koeninger commented on SPARK-18506: I'm really confused by that - did you tr

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691379#comment-15691379 ] Xiao Li commented on SPARK-18549: - Another way is to uncache all the impacted cached data

[jira] [Comment Edited] (SPARK-18548) OnlineLDAOptimizer reads the same broadcast data after deletion

[ https://issues.apache.org/jira/browse/SPARK-18548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691359#comment-15691359 ] Xiaoye Sun edited comment on SPARK-18548 at 11/23/16 9:05 PM: -

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691367#comment-15691367 ] Xiao Li commented on SPARK-18549: - Using name resolution is not a clean fix. We might unc

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691364#comment-15691364 ] Xiao Li commented on SPARK-18209: - [~jiangxb1987] Have you considered the impact on the e

[jira] [Commented] (SPARK-18548) OnlineLDAOptimizer reads the same broadcast data after deletion

[ https://issues.apache.org/jira/browse/SPARK-18548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691359#comment-15691359 ] Xiaoye Sun commented on SPARK-18548: Hi Yuhao, Sorry for misleading you. expElogbet

[jira] [Commented] (SPARK-18551) Add functionality to delete event logs from the History Server UI

[ https://issues.apache.org/jira/browse/SPARK-18551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691341#comment-15691341 ] Marcelo Vanzin commented on SPARK-18551: I'll comment here instead of the PR sinc

[jira] [Updated] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Bridgett updated SPARK-18571: Description: Sample code attached, code run with hadoop 2.7.3, python3.5 If I run this wit

[jira] [Updated] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Bridgett updated SPARK-18571: Attachment: unicode.py > pyspark: UTF-8 not written correctly (as CSV) when locale is not U

[jira] [Commented] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691299#comment-15691299 ] Adrian Bridgett commented on SPARK-18571: - Note that without the leading integer

[jira] [Created] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

Adrian Bridgett created SPARK-18571: --- Summary: pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8 Key: SPARK-18571 URL: https://issues.apache.org/jira/browse/SPARK-18571 Project:

[jira] [Commented] (SPARK-18548) OnlineLDAOptimizer reads the same broadcast data after deletion

[ https://issues.apache.org/jira/browse/SPARK-18548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691290#comment-15691290 ] yuhao yang commented on SPARK-18548: Hi [~sunxiaoye0116] by second time, do you mean

[jira] [Resolved] (SPARK-18510) Partition schema inference corrupts data

[ https://issues.apache.org/jira/browse/SPARK-18510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-18510. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.1.0 > Partition sche

[jira] [Created] (SPARK-18570) Consider supporting other R formula operators

Felix Cheung created SPARK-18570: Summary: Consider supporting other R formula operators Key: SPARK-18570 URL: https://issues.apache.org/jira/browse/SPARK-18570 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-18569) Support R formula arithmetic

[ https://issues.apache.org/jira/browse/SPARK-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691201#comment-15691201 ] Felix Cheung commented on SPARK-18569: -- [~josephkb] what do you think? > Support R

[jira] [Updated] (SPARK-18569) Support R formula arithmetic

[ https://issues.apache.org/jira/browse/SPARK-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18569: - Description: I think we should support arithmetic which makes it a lot more convenient to build

[jira] [Updated] (SPARK-18569) Support R formula arithmetic

[ https://issues.apache.org/jira/browse/SPARK-18569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18569: - Description: I think we should support arithmetic which makes it a lot more convenient to build

[jira] [Created] (SPARK-18569) Support R formula arithmetic

Felix Cheung created SPARK-18569: Summary: Support R formula arithmetic Key: SPARK-18569 URL: https://issues.apache.org/jira/browse/SPARK-18569 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-18552) Watermark should not rely on sinks to proceed

[ https://issues.apache.org/jira/browse/SPARK-18552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691098#comment-15691098 ] Shixiong Zhu commented on SPARK-18552: -- As per the current doc "the actual watermark

[jira] [Resolved] (SPARK-18506) kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only read from a single partition on a multi partition topic

[ https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heji Kim resolved SPARK-18506. -- Resolution: Workaround I was able to replicate the single partition only problem in AWS with both YARN

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691013#comment-15691013 ] Dongjoon Hyun commented on SPARK-18549: --- Yes, I meant it as a the fallback operatio

[jira] [Updated] (SPARK-17910) Allow users to update the comment of a column

[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17910: Target Version/s: 2.2.0 (was: 2.1.0) > Allow users to update the comment of a column > ---

[jira] [Created] (SPARK-18568) vertex attributes in the edge triplet not getting updated in super steps for Pregel API

Rohit created SPARK-18568: - Summary: vertex attributes in the edge triplet not getting updated in super steps for Pregel API Key: SPARK-18568 URL: https://issues.apache.org/jira/browse/SPARK-18568 Project: Sp

[jira] [Commented] (SPARK-18525) Kafka DirectInputStream cannot be aware of new partition

[ https://issues.apache.org/jira/browse/SPARK-18525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690915#comment-15690915 ] Cody Koeninger commented on SPARK-18525: Easiest thing to do is just restart your

[jira] [Assigned] (SPARK-18567) Simplify CreateDataSourceTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-18567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18567: Assignee: Wenchen Fan (was: Apache Spark) > Simplify CreateDataSourceTableAsSelectCommand

[jira] [Assigned] (SPARK-18567) Simplify CreateDataSourceTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-18567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18567: Assignee: Apache Spark (was: Wenchen Fan) > Simplify CreateDataSourceTableAsSelectCommand

[jira] [Commented] (SPARK-18567) Simplify CreateDataSourceTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-18567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690914#comment-15690914 ] Apache Spark commented on SPARK-18567: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-18567) Simplify CreateDataSourceTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-18567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18567: Target Version/s: (was: 2.1.0) > Simplify CreateDataSourceTableAsSelectCommand >

[jira] [Resolved] (SPARK-18050) spark 2.0.1 enable hive throw AlreadyExistsException(message:Database default already exists)

[ https://issues.apache.org/jira/browse/SPARK-18050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-18050. --- Resolution: Fixed Fix Version/s: 2.1.0 Target Version/s: 2.1.0 > spark 2.0.1 enable

[jira] [Reopened] (SPARK-18050) spark 2.0.1 enable hive throw AlreadyExistsException(message:Database default already exists)

[ https://issues.apache.org/jira/browse/SPARK-18050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-18050: --- Assignee: Wenchen Fan > spark 2.0.1 enable hive throw AlreadyExistsException(message:Database defau

[jira] [Updated] (SPARK-18567) Simplify CreateDataSourceTableAsSelectCommand

[ https://issues.apache.org/jira/browse/SPARK-18567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18567: Summary: Simplify CreateDataSourceTableAsSelectCommand (was: make saveAsTable work with hive table

[jira] [Created] (SPARK-18567) make saveAsTable work with hive table in append mode

Wenchen Fan created SPARK-18567: --- Summary: make saveAsTable work with hive table in append mode Key: SPARK-18567 URL: https://issues.apache.org/jira/browse/SPARK-18567 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690765#comment-15690765 ] Xiao Li edited comment on SPARK-18549 at 11/23/16 5:15 PM: --- Are

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690767#comment-15690767 ] Sean Owen commented on SPARK-14742: --- CC [~rxin] as it sounds like there might be some i

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690765#comment-15690765 ] Xiao Li commented on SPARK-18549: - Are you suggesting name-based resolution? This is risk

[jira] [Commented] (SPARK-14742) Redirect spark-ec2 doc to new location

[ https://issues.apache.org/jira/browse/SPARK-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690741#comment-15690741 ] Shivaram Venkataraman commented on SPARK-14742: --- [~srowen] It looks like th

[jira] [Commented] (SPARK-18566) remove OverwriteOptions

[ https://issues.apache.org/jira/browse/SPARK-18566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690667#comment-15690667 ] Apache Spark commented on SPARK-18566: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-18566) remove OverwriteOptions

[ https://issues.apache.org/jira/browse/SPARK-18566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18566: Assignee: Apache Spark (was: Wenchen Fan) > remove OverwriteOptions > ---

[jira] [Assigned] (SPARK-18566) remove OverwriteOptions

[ https://issues.apache.org/jira/browse/SPARK-18566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18566: Assignee: Wenchen Fan (was: Apache Spark) > remove OverwriteOptions > ---

[jira] [Created] (SPARK-18566) remove OverwriteOptions

Wenchen Fan created SPARK-18566: --- Summary: remove OverwriteOptions Key: SPARK-18566 URL: https://issues.apache.org/jira/browse/SPARK-18566 Project: Spark Issue Type: Improvement Compo

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690589#comment-15690589 ] Lianhui Wang commented on SPARK-14560: -- Can you provide some debug log of TaskMemory

[jira] [Created] (SPARK-18565) subtractByKey modifes values in the source RDD

Dmitry Dzhus created SPARK-18565: Summary: subtractByKey modifes values in the source RDD Key: SPARK-18565 URL: https://issues.apache.org/jira/browse/SPARK-18565 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-17528) MutableProjection should not cache content from the input row

[ https://issues.apache.org/jira/browse/SPARK-17528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690471#comment-15690471 ] Wenchen Fan commented on SPARK-17528: - now it's kind of a refactor work, let's put it

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690451#comment-15690451 ] Jiang Xingbo commented on SPARK-18209: -- I changed the share settings of the doc, I h

[jira] [Created] (SPARK-18564) mapWithState: add configuration for DEFAULT_CHECKPOINT_DURATION_MULTIPLIER

Daniel Haviv created SPARK-18564: Summary: mapWithState: add configuration for DEFAULT_CHECKPOINT_DURATION_MULTIPLIER Key: SPARK-18564 URL: https://issues.apache.org/jira/browse/SPARK-18564 Project: S

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690426#comment-15690426 ] Nattavut Sutyanyong commented on SPARK-18209: - [~jiangxb1987] Could you pleas

[jira] [Created] (SPARK-18563) mapWithState: initialState should have a timeout setting per record

Daniel Haviv created SPARK-18563: Summary: mapWithState: initialState should have a timeout setting per record Key: SPARK-18563 URL: https://issues.apache.org/jira/browse/SPARK-18563 Project: Spark

[jira] [Updated] (SPARK-18559) Fix HLL++ with small relative error

[ https://issues.apache.org/jira/browse/SPARK-18559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18559: - Summary: Fix HLL++ with small relative error (was: Restrict the lower bound of relativeSD in HLL

[jira] [Updated] (SPARK-18559) Restrict the lower bound of relativeSD in HLL++

[ https://issues.apache.org/jira/browse/SPARK-18559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18559: - Description: In HyperLogLogPlusPlus, if the relative error is so small that p >= 19, it will caus

[jira] [Commented] (SPARK-16931) PySpark access to data-frame bucketing api

[ https://issues.apache.org/jira/browse/SPARK-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690381#comment-15690381 ] Chirag Vaya commented on SPARK-16931: - Any updates on this as to which fix version wi

[jira] [Assigned] (SPARK-18555) na.fill miss up original values in long integers

[ https://issues.apache.org/jira/browse/SPARK-18555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18555: Assignee: (was: Apache Spark) > na.fill miss up original values in long integers > ---

[jira] [Closed] (SPARK-18562) Correlation causes Error “Cannot determine the number of cols”

[ https://issues.apache.org/jira/browse/SPARK-18562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuku1 closed SPARK-18562. - Resolution: Not A Bug I did a mistake, my RDD did get corrupt at one point and thus causing empty RDDs. > Corr

[jira] [Assigned] (SPARK-18555) na.fill miss up original values in long integers

[ https://issues.apache.org/jira/browse/SPARK-18555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18555: Assignee: Apache Spark > na.fill miss up original values in long integers > --

[jira] [Commented] (SPARK-18555) na.fill miss up original values in long integers

[ https://issues.apache.org/jira/browse/SPARK-18555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690139#comment-15690139 ] Apache Spark commented on SPARK-18555: -- User 'windpiger' has created a pull request

[jira] [Commented] (SPARK-18050) spark 2.0.1 enable hive throw AlreadyExistsException(message:Database default already exists)

[ https://issues.apache.org/jira/browse/SPARK-18050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15690117#comment-15690117 ] Apache Spark commented on SPARK-18050: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-18562) Correlation causes Error “Cannot determine the number of cols”

[ https://issues.apache.org/jira/browse/SPARK-18562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuku1 updated SPARK-18562: -- Component/s: MLlib > Correlation causes Error “Cannot determine the number of cols” > -

[jira] [Created] (SPARK-18562) Correlation causes Error “Cannot determine the number of cols”

Kuku1 created SPARK-18562: - Summary: Correlation causes Error “Cannot determine the number of cols” Key: SPARK-18562 URL: https://issues.apache.org/jira/browse/SPARK-18562 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-18522) Create explicit contract for column stats serialization

[ https://issues.apache.org/jira/browse/SPARK-18522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18522. - Resolution: Fixed Fix Version/s: 2.1.0 > Create explicit contract for column stats seriali

[jira] [Resolved] (SPARK-18545) Verify number of hive client RPCs in PartitionedTablePerfStatsSuite

[ https://issues.apache.org/jira/browse/SPARK-18545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18545. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.1.0 > Verify number of hi

[jira] [Resolved] (SPARK-18557) Downgrade the memory leak warning message

[ https://issues.apache.org/jira/browse/SPARK-18557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18557. --- Resolution: Fixed Fix Version/s: 2.1.0 > Downgrade the memory leak warning mes

[jira] [Updated] (SPARK-18519) map type can not be used in EqualTo

[ https://issues.apache.org/jira/browse/SPARK-18519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18519: -- Fix Version/s: 2.0.3 > map type can not be used in EqualTo > --

[jira] [Resolved] (SPARK-18053) ARRAY equality is broken in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18053. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.3 > ARRAY equali

[jira] [Commented] (SPARK-18561) when checkpoint restore ,Streaming Dstream join RDD from hbase exception

[ https://issues.apache.org/jira/browse/SPARK-18561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689909#comment-15689909 ] Sean Owen commented on SPARK-18561: --- This doesn't contain any detail about the actual e

[jira] [Created] (SPARK-18561) when checkpoint restore ,Streaming Dstream join RDD from hbase exception

kunfengwu created SPARK-18561: - Summary: when checkpoint restore ,Streaming Dstream join RDD from hbase exception Key: SPARK-18561 URL: https://issues.apache.org/jira/browse/SPARK-18561 Project: Spark

[jira] [Comment Edited] (SPARK-14560) Cooperative Memory Management for Spillables

[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689843#comment-15689843 ] Roy Wang edited comment on SPARK-14560 at 11/23/16 11:37 AM: -

[jira] [Comment Edited] (SPARK-14560) Cooperative Memory Management for Spillables

[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689843#comment-15689843 ] Roy Wang edited comment on SPARK-14560 at 11/23/16 11:36 AM: -

[jira] [Comment Edited] (SPARK-14560) Cooperative Memory Management for Spillables

[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689843#comment-15689843 ] Roy Wang edited comment on SPARK-14560 at 11/23/16 11:35 AM: -

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689843#comment-15689843 ] Roy wang commented on SPARK-14560: -- I found my tasks run into this problem after them wa

[jira] [Resolved] (SPARK-18073) Migrate wiki to spark.apache.org web site

[ https://issues.apache.org/jira/browse/SPARK-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18073. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15967 [https://github.co

[jira] [Updated] (SPARK-18073) Migrate wiki to spark.apache.org web site

[ https://issues.apache.org/jira/browse/SPARK-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18073: -- Description: Per http://apache-spark-developers-list.1001551.n3.nabble.com/Mini-Proposal-Make-it-easie

  1   2   >