Github user zohar-mizrahi commented on the issue:
https://github.com/apache/flink/pull/5333
Just started to look at your changes and have one comment with respect to
the plan.py - have you tried executing the same script twice, but on the second
time change one line in the script
Github user zohar-mizrahi commented on the issue:
https://github.com/apache/flink/pull/3838
Referring to the issue with the ```PythonEnvironmentConfig ``` above, Is
there any other global indication that I can use to test whether a given
function is executed on the TaskManager
Github user zohar-mizrahi commented on the issue:
https://github.com/apache/flink/pull/3838
One of the critical attributes is
```PythonEnvironmentConfig::pythonTmpCachePath```, which is used in the
following places:
- ```PythonStreamExecutionEnvironment::execute:362
Github user zohar-mizrahi commented on the issue:
https://github.com/apache/flink/pull/3838
The thing is that I use the
```PythonEnvironmentConfig.pythonTmpCachePath``` attribute to deliver
information from the ```PythonStreamBinder``` to a class that is called from
the python
Github user zohar-mizrahi commented on the issue:
https://github.com/apache/flink/pull/3838
I'm trying to track down the root cause for the checks failures without a
success. Obviously, the given project (flink-libraries/flink-streaming-python)
in master branch passes the `v
Github user zohar-mizrahi commented on the issue:
https://github.com/apache/flink/pull/3838
Regarding the exception -
```java.io.IOException: java.io.IOException: The given HDFS file URI ...```
In general, using the python interface requires a valid configuration of
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r133392462
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/util/serialization/PyObjectSerializer.java
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r133192783
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/util/PythonCollector.java
---
@@ -0,0 +1,47
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r133170150
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/functions/PythonOutputSelector.java
---
@@ -0,0
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r133169625
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/util/serialization/PyObjectSerializer.java
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r133169331
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/util/serialization/PyObjectSerializer.java
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r133156452
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/functions/PythonOutputSelector.java
---
@@ -0,0
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r133154903
--- Diff:
flink-libraries/flink-streaming-python/src/test/java/org/apache/flink/streaming/python/api/PythonStreamBinderTest.java
---
@@ -0,0 +1,100
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r132967578
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/datastream/PythonObjectInputStream2.java
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r132843982
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/environment/PythonStreamExecutionEnvironment.java
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r132842489
--- Diff:
flink-libraries/flink-streaming-python/src/test/java/org/apache/flink/streaming/python/api/PythonStreamBinderTest.java
---
@@ -0,0 +1,100
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r132841381
--- Diff: flink-libraries/flink-streaming-python/pom.xml ---
@@ -0,0 +1,104 @@
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="htt
Github user zohar-mizrahi commented on the issue:
https://github.com/apache/flink/pull/3838
In the last change, I've rebased locally on top of origin/master, so I did
`git push -f` to the master branch in my fork.
---
If your project is set up for it, you can reply to this emai
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r117864592
--- Diff: flink-libraries/flink-streaming-python/pom.xml ---
@@ -0,0 +1,99 @@
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="htt
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r117807878
--- Diff:
flink-runtime/src/main/java/org/apache/flink/runtime/filecache/FileCache.java
---
@@ -233,6 +234,20 @@ boolean holdsStillReference(String
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r117806756
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/environment/PythonStreamExecutionEnvironment.java
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r117793843
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/environment/PythonStreamExecutionEnvironment.java
Github user zohar-mizrahi commented on a diff in the pull request:
https://github.com/apache/flink/pull/3838#discussion_r117788892
--- Diff:
flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/datastream/PythonObjectInputStream2.java
Github user zohar-mizrahi closed the pull request at:
https://github.com/apache/flink/pull/3826
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
GitHub user zohar-mizrahi opened a pull request:
https://github.com/apache/flink/pull/3838
[FLINK-5886] Python API for streaming applications
Thanks for contributing to Apache Flink. Before you open your pull request,
please take the following check list into consideration.
If
Github user zohar-mizrahi closed the pull request at:
https://github.com/apache/flink/pull/3827
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
[
https://issues.apache.org/jira/browse/FLINK-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996944#comment-15996944
]
Zohar Mizrahi commented on FLINK-5886:
--
No problem - I'll rebase on top
GitHub user zohar-mizrahi opened a pull request:
https://github.com/apache/flink/pull/3827
[FLINK-5886] Python API for streaming applications
Thanks for contributing to Apache Flink. Before you open your pull request,
please take the following check list into consideration.
If
GitHub user zohar-mizrahi opened a pull request:
https://github.com/apache/flink/pull/3826
[FLINK-5886] Python API for streaming applications
Thanks for contributing to Apache Flink. Before you open your pull request,
please take the following check list into consideration.
If
[
https://issues.apache.org/jira/browse/FLINK-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zohar Mizrahi closed FLINK-6283.
Resolution: Won't Do
> Enable to clear a given file ca
[
https://issues.apache.org/jira/browse/FLINK-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972776#comment-15972776
]
Zohar Mizrahi commented on FLINK-6283:
--
Yes, this is how I implemented it
[
https://issues.apache.org/jira/browse/FLINK-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972673#comment-15972673
]
Zohar Mizrahi commented on FLINK-6283:
--
Yep, FileCache#copy and therefore, I
[
https://issues.apache.org/jira/browse/FLINK-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972635#comment-15972635
]
Zohar Mizrahi commented on FLINK-6283:
--
In one case - when the python files
[
https://issues.apache.org/jira/browse/FLINK-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972346#comment-15972346
]
Zohar Mizrahi commented on FLINK-6283:
--
It refers to a file cache created
Zohar Mizrahi created FLINK-6283:
Summary: Enable to clear a given file cache path
Key: FLINK-6283
URL: https://issues.apache.org/jira/browse/FLINK-6283
Project: Flink
Issue Type
Zohar Mizrahi created FLINK-6177:
Summary: Add support for "Distributed Cache" in streaming
applications
Key: FLINK-6177
URL: https://issues.apache.org/jira/browse/FLINK-6177
Proj
[
https://issues.apache.org/jira/browse/FLINK-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zohar Mizrahi updated FLINK-5886:
-
Description:
A work in progress to provide python interface for Flink streaming APIs. The
core
Zohar Mizrahi created FLINK-5992:
Summary: Enable file registration at distributed cache in stream
execution environment
Key: FLINK-5992
URL: https://issues.apache.org/jira/browse/FLINK-5992
Project
Zohar Mizrahi created FLINK-5886:
Summary: Python API for streaming applications
Key: FLINK-5886
URL: https://issues.apache.org/jira/browse/FLINK-5886
Project: Flink
Issue Type: New Feature
39 matches
Mail list logo
