[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174809#comment-15174809 ] Łukasz Gieroń commented on SPARK-13230: --- [~srowen] Can you please assign m

[jira] [Commented] (SPARK-3789) [GRAPHX] Python bindings for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178340#comment-15178340 ] Maciej Bryński commented on SPARK-3789: --- [~mengxr] Is there any ideas to rep

[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń commented on SPARK-13230: --- The issue here is the bug in S

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:3

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:3

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:3

[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181790#comment-15181790 ] Łukasz Gieroń commented on SPARK-13230: --- A good workaround is to use

[jira] [Created] (SPARK-13819) using a tegexp_replace in a gropu by clause raises a nullpointerexception

Javier Pérez created SPARK-13819: Summary: using a tegexp_replace in a gropu by clause raises a nullpointerexception Key: SPARK-13819 URL: https://issues.apache.org/jira/browse/SPARK-13819 Project

[jira] [Commented] (SPARK-11319) PySpark silently accepts null values in non-nullable DataFrame fields.

[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201308#comment-15201308 ] François Prunier commented on SPARK-11319: -- Hi [~yhuai], I'm not

[jira] [Created] (SPARK-13971) Implicit group by with distinct modifier on having raises an unexpected error

Javier Pérez created SPARK-13971: Summary: Implicit group by with distinct modifier on having raises an unexpected error Key: SPARK-13971 URL: https://issues.apache.org/jira/browse/SPARK-13971

[jira] [Updated] (SPARK-13819) using a regexp_replace in a group by clause raises a nullpointerexception

[ https://issues.apache.org/jira/browse/SPARK-13819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Javier Pérez updated SPARK-13819: - Summary: using a regexp_replace in a group by clause raises a nullpointerexception (was: using

[jira] [Created] (SPARK-13987) Build fails due to scala version mismatch between

Jean-Baptiste Onofré created SPARK-13987: Summary: Build fails due to scala version mismatch between Key: SPARK-13987 URL: https://issues.apache.org/jira/browse/SPARK-13987 Project: Spark

[jira] [Commented] (SPARK-13987) Build fails due to scala version mismatch between

[ https://issues.apache.org/jira/browse/SPARK-13987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200539#comment-15200539 ] Jean-Baptiste Onofré commented on SPARK-13987: -- Nevermind, it works

[jira] [Closed] (SPARK-13987) Build fails due to scala version mismatch between

[ https://issues.apache.org/jira/browse/SPARK-13987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré closed SPARK-13987. Resolution: Not A Problem > Build fails due to scala version mismatch betw

[jira] [Commented] (SPARK-13987) Build fails due to scala version mismatch between

[ https://issues.apache.org/jira/browse/SPARK-13987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200505#comment-15200505 ] Jean-Baptiste Onofré commented on SPARK-13987: -- I'm trying to use

[jira] [Created] (SPARK-13991) Extend mvn enforcer rule

Jean-Baptiste Onofré created SPARK-13991: Summary: Extend mvn enforcer rule Key: SPARK-13991 URL: https://issues.apache.org/jira/browse/SPARK-13991 Project: Spark Issue Type: Wish

[jira] [Commented] (SPARK-11319) PySpark silently accepts null values in non-nullable DataFrame fields.

[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15199743#comment-15199743 ] François Prunier commented on SPARK-11319: -- Hi, I created a PR to enhance

[jira] [Created] (SPARK-14050) Add multiple languages support for Stop Words Remover

Burak KÖSE created SPARK-14050: -- Summary: Add multiple languages support for Stop Words Remover Key: SPARK-14050 URL: https://issues.apache.org/jira/browse/SPARK-14050 Project: Spark Issue Type

[jira] [Commented] (SPARK-14050) Add multiple languages support for Stop Words Remover

[ https://issues.apache.org/jira/browse/SPARK-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205347#comment-15205347 ] Burak KÖSE commented on SPARK-14050: I am working on this, using nltk's w

[jira] [Commented] (SPARK-11666) Find the best `k` by cutting bisecting k-means cluster tree without recomputation

[ https://issues.apache.org/jira/browse/SPARK-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15207390#comment-15207390 ] Burak KÖSE commented on SPARK-11666: Hi, can you share links for references a

[jira] [Commented] (SPARK-3232) Backport SPARK-3006 into branch-1.0

[ https://issues.apache.org/jira/browse/SPARK-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14154737#comment-14154737 ] François Garillot commented on SPARK-3232: -- This is closed by h

[jira] [Commented] (SPARK-2256) pyspark: .take doesn't work ... sometimes ...

[ https://issues.apache.org/jira/browse/SPARK-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157765#comment-14157765 ] Ángel Álvarez commented on SPARK-2256: -- It seems the problem has been solve

[jira] [Commented] (SPARK-2418) Custom checkpointing with an external function as parameter

[ https://issues.apache.org/jira/browse/SPARK-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14160072#comment-14160072 ] András Barják commented on SPARK-2418: -- Hi, I would be happy if someone c

[jira] [Created] (SPARK-3954) promote the speed of convert files to RDDS

宿荣全 created SPARK-3954: -- Summary: promote the speed of convert files to RDDS Key: SPARK-3954 URL: https://issues.apache.org/jira/browse/SPARK-3954 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

URL: https://issues.apache.org/jira/browse/SPARK-3967 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 1.1.0 Reporter: Christophe PRÉAUD Spark applications fail from time to time in yarn-cluster mode (but not in yarn

[jira] [Updated] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe PRÉAUD updated SPARK-3967: - Attachment: spark-1.1.0-yarn_cluster_tmpdir.patch Ensure that the temporary file which

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173566#comment-14173566 ] Christophe PRÉAUD commented on SPARK-3967: -- After investigating, it turns

[jira] [Created] (SPARK-3989) Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command

Jan Zikeš created SPARK-3989: Summary: Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command Key: SPARK-3989 URL: https://issues.apache.org/jira/browse/SPARK-3989

[jira] [Commented] (SPARK-3989) Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command

[ https://issues.apache.org/jira/browse/SPARK-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174876#comment-14174876 ] Jan Zikeš commented on SPARK-3989: -- Implemented and sent pull request here: h

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176782#comment-14176782 ] Christophe PRÉAUD commented on SPARK-3967: -- Hi Ryan, Thanks for your help.

[jira] [Created] (SPARK-4007) EOF exception to load from HDFS an JavaRDD>

Cristian Galán created SPARK-4007: - Summary: EOF exception to load from HDFS an JavaRDD> Key: SPARK-4007 URL: https://issues.apache.org/jira/browse/SPARK-4007 Project: Spark Issue Type:

[jira] [Updated] (SPARK-4007) EOF exception to load an JavaRDD from HDFS

[ https://issues.apache.org/jira/browse/SPARK-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Galán updated SPARK-4007: -- Priority: Major (was: Critical) Environment: hadoop-client-2.30 hadoop-hdfs-2.30 spark

[jira] [Comment Edited] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176782#comment-14176782 ] Christophe PRÉAUD edited comment on SPARK-3967 at 10/20/14 12:2

[jira] [Comment Edited] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176782#comment-14176782 ] Christophe PRÉAUD edited comment on SPARK-3967 at 10/20/14 12:1

[jira] [Comment Edited] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176782#comment-14176782 ] Christophe PRÉAUD edited comment on SPARK-3967 at 10/20/14 12:2

[jira] [Comment Edited] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176782#comment-14176782 ] Christophe PRÉAUD edited comment on SPARK-3967 at 10/20/14 12:2

[jira] [Closed] (SPARK-4007) EOF exception to load an JavaRDD from HDFS

[ https://issues.apache.org/jira/browse/SPARK-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristian Galán closed SPARK-4007. - Resolution: Invalid Don't need fix because it's not a problem of Spark, the objects ar

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177040#comment-14177040 ] Christophe PRÉAUD commented on SPARK-3967: -- That's fine, thanks!

[jira] [Commented] (SPARK-3954) Optimization to FileInputDStream

[ https://issues.apache.org/jira/browse/SPARK-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181190#comment-14181190 ] 宿荣全 commented on SPARK-3954: Does someone take notice of this PR? > Optimiza

[jira] [Commented] (SPARK-743) An Akka-cluster based masterless standalone mode for Spark.

[ https://issues.apache.org/jira/browse/SPARK-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194411#comment-14194411 ] François Garillot commented on SPARK-743: - That last URL is https://github

[jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage

[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583423#comment-14583423 ] Jérémy Subtil commented on SPARK-8159: -- I'd be interested by {{collect_

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14588064#comment-14588064 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi, I've

[jira] [Created] (SPARK-8408) Python OR operator is not considered while creating a column of boolean type

Felix Maximilian Möller created SPARK-8408: -- Summary: Python OR operator is not considered while creating a column of boolean type Key: SPARK-8408 URL: https://issues.apache.org/jira/browse/SPARK-8408

[jira] [Updated] (SPARK-8408) Python OR operator is not considered while creating a column of boolean type

[ https://issues.apache.org/jira/browse/SPARK-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Maximilian Möller updated SPARK-8408: --- Attachment: bug_report.ipynb.json IPython notebook with the code that

[jira] [Updated] (SPARK-8408) Python OR operator is not considered while creating a column of boolean type

[ https://issues.apache.org/jira/browse/SPARK-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Maximilian Möller updated SPARK-8408: --- Description: h3. Given {code} d = [{'name': 'Alice

[jira] [Commented] (SPARK-7398) Add back-pressure to Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592001#comment-14592001 ] François Garillot commented on SPARK-7398: -- Note this subsumes [SPARK-

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592354#comment-14592354 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi, I have made

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600010#comment-14600010 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi, As I said abov

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604633#comment-14604633 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi, I have worked a

[jira] [Comment Edited] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604633#comment-14604633 ] Juan Rodríguez Hortalá edited comment on SPARK-8337 at 6/28/15 6:1

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605588#comment-14605588 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi [~jerryshao], Tha

[jira] [Commented] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605712#comment-14605712 ] Ángel Álvarez commented on SPARK-8385: -- A simple WordCount test worked fine i

[jira] [Comment Edited] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605744#comment-14605744 ] Ángel Álvarez edited comment on SPARK-8385 at 6/29/15 3:1

[jira] [Commented] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605744#comment-14605744 ] Ángel Álvarez commented on SPARK-8385: -- I could finally reproduce this same erro

[jira] [Commented] (SPARK-8293) Add high-level java docs to important YARN classes

[ https://issues.apache.org/jira/browse/SPARK-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612103#comment-14612103 ] Zoltán Zvara commented on SPARK-8293: - You can assign this issue to me. > A

[jira] [Commented] (SPARK-8294) Break down large methods in YARN code

[ https://issues.apache.org/jira/browse/SPARK-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612105#comment-14612105 ] Zoltán Zvara commented on SPARK-8294: - You can assign this to me. > Break dow

[jira] [Issue Comment Deleted] (SPARK-8294) Break down large methods in YARN code

[ https://issues.apache.org/jira/browse/SPARK-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltán Zvara updated SPARK-8294: Comment: was deleted (was: You can assign this to me.) > Break down large methods in YARN c

[jira] [Issue Comment Deleted] (SPARK-8293) Add high-level java docs to important YARN classes

[ https://issues.apache.org/jira/browse/SPARK-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltán Zvara updated SPARK-8293: Comment: was deleted (was: You can assign this issue to me.) > Add high-level java docs

[jira] [Created] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

François Garillot created SPARK-8834: Summary: Throttle DStreams dynamically through back-pressure information Key: SPARK-8834 URL: https://issues.apache.org/jira/browse/SPARK-8834 Project: Spark

[jira] [Updated] (SPARK-7398) Add back-pressure to Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-7398: - Description: Spark Streaming has trouble dealing with situations where batch processing

[jira] [Created] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

François Garillot created SPARK-8835: Summary: Provide pluggable Congestion Strategies to deal with Streaming load Key: SPARK-8835 URL: https://issues.apache.org/jira/browse/SPARK-8835 Project

[jira] [Updated] (SPARK-7398) Add back-pressure to Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-7398: - Description: Spark Streaming has trouble dealing with situations where batch processing

[jira] [Updated] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-8834: - Description: This aims to have Spark Streaming be more resilient to high-throughput

[jira] [Commented] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614777#comment-14614777 ] François Garillot commented on SPARK-8834: -- More feature-rich, in that

[jira] [Comment Edited] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614777#comment-14614777 ] François Garillot edited comment on SPARK-8834 at 7/6/15 9:3

[jira] [Updated] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-8835: - Description: Second part of [SPARK-7398|https://issues.apache.org/jira/browse/SPARK-7398

[jira] [Updated] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-8834: - Target Version/s: 1.5.0 > Throttle DStreams dynamically through back-pressure informat

[jira] [Updated] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-8835: - Shepherd: Tathagata Das > Provide pluggable Congestion Strategies to deal with Stream

[jira] [Comment Edited] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614777#comment-14614777 ] François Garillot edited comment on SPARK-8834 at 7/6/15 11:1

[jira] [Commented] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14617184#comment-14617184 ] Juan Rodríguez Hortalá commented on SPARK-8743: --- Hi, I guess you alr

[jira] [Created] (SPARK-8981) Set applicationId and appName in log4j MDC

Paweł Kopiczko created SPARK-8981: - Summary: Set applicationId and appName in log4j MDC Key: SPARK-8981 URL: https://issues.apache.org/jira/browse/SPARK-8981 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622666#comment-14622666 ] Paweł Kopiczko commented on SPARK-8981: --- Sure. I believe that when executo

[jira] [Comment Edited] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622666#comment-14622666 ] Paweł Kopiczko edited comment on SPARK-8981 at 7/10/15 6:0

[jira] [Comment Edited] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622666#comment-14622666 ] Paweł Kopiczko edited comment on SPARK-8981 at 7/10/15 6:0

[jira] [Closed] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot closed SPARK-8834. Resolution: Duplicate > Throttle DStreams dynamically through back-pressure informat

[jira] [Updated] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-8835: - Description: Second part of [SPARK-7398|https://issues.apache.org/jira/browse/SPARK-7398

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623700#comment-14623700 ] Paweł Kopiczko commented on SPARK-8981: --- slf4j supports MDC as well:

[jira] [Comment Edited] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623707#comment-14623707 ] Paweł Kopiczko edited comment on SPARK-8981 at 7/12/15 8:2

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623707#comment-14623707 ] Paweł Kopiczko commented on SPARK-8981: --- ??MDC has static methods?? Yes, but

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623720#comment-14623720 ] Paweł Kopiczko commented on SPARK-8981: --- I think so. Would you mind pointing m

[jira] [Commented] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14625930#comment-14625930 ] François Garillot commented on SPARK-8975: -- Typesafe PR : https://github

[jira] [Commented] (SPARK-8979) Implement a PIDRateEstimator

[ https://issues.apache.org/jira/browse/SPARK-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626118#comment-14626118 ] François Garillot commented on SPARK-8979: -- Parameter derivation available

[jira] [Comment Edited] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14625930#comment-14625930 ] François Garillot edited comment on SPARK-8975 at 7/14/15 11:1

[jira] [Commented] (SPARK-8977) Define the RateEstimator interface, and implement the ReceiverRateController

[ https://issues.apache.org/jira/browse/SPARK-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626202#comment-14626202 ] François Garillot commented on SPARK-8977: -- Typesafe PR: https://github

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1497#comment-1497 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Interesting comment

[jira] [Commented] (SPARK-11331) Kryo serializer broken with StringTypes

[ https://issues.apache.org/jira/browse/SPARK-11331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980101#comment-14980101 ] Maciej Bryński commented on SPARK-11331: Same when using from PySpark. &g

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981718#comment-14981718 ] 周一帆 commented on SPARK-5569: I encountered the same problem when deseriable Array

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981719#comment-14981719 ] 周一帆 commented on SPARK-5569: I encountered the same problem when deseriable Array

[jira] [Comment Edited] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981719#comment-14981719 ] 周一帆 edited comment on SPARK-5569 at 10/30/15 2:04 AM: -- I encount

[jira] [Issue Comment Deleted] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 周一帆 updated SPARK-5569: --- Comment: was deleted (was: I encountered the same problem when deseriable Array[Foo]() object from checkpoint file

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981972#comment-14981972 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Oh ok, so it makes s

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974653#comment-14974653 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 10/30/15 6:1

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991160#comment-14991160 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Hi Phil, I'm test

[jira] [Commented] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991197#comment-14991197 ] Jean-Baptiste Onofré commented on SPARK-2533: - New clean PR. > Show

[jira] [Comment Edited] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991794#comment-14991794 ] Stéphane Collot edited comment on SPARK-1378 at 11/5/15 3:2

[jira] [Commented] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991794#comment-14991794 ] Stéphane Collot commented on SPARK-1378: I had the same issue behind a corpo

[jira] [Comment Edited] (SPARK-1378) Build error: org.eclipse.paho:mqtt-client

[ https://issues.apache.org/jira/browse/SPARK-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991794#comment-14991794 ] Stéphane Collot edited comment on SPARK-1378 at 11/5/15 3:2

[jira] [Commented] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995615#comment-14995615 ] Adrian-Cătălin Florea commented on SPARK-2344: -- Hi, I'm working

[jira] [Created] (SPARK-11588) Submitting of Spark (Streaming) Job and killing/stopping of them

Michał Gabrysiak created SPARK-11588: Summary: Submitting of Spark (Streaming) Job and killing/stopping of them Key: SPARK-11588 URL: https://issues.apache.org/jira/browse/SPARK-11588 Project

[jira] [Updated] (SPARK-11588) Submitting of Spark (Streaming) Job and killing/stopping of them

[ https://issues.apache.org/jira/browse/SPARK-11588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michał Gabrysiak updated SPARK-11588: - Attachment: screen1.PNG > Submitting of Spark (Streaming) Job and killing/stopping

<    4   5   6   7   8   9   10   11   12   13   >