[jira] [Commented] (BEAM-13606) bigtable io doesn't handle non-ok row mutations

2022-02-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488375#comment-17488375 ] Ning commented on BEAM-13606: - [~kenn] BEAM-13376 is a variation. The root cause is not in B

[jira] [Commented] (BEAM-13376) Missing error for nonexistent column family BigTable

2022-02-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488377#comment-17488377 ] Ning commented on BEAM-13376: - [~kenn] This should be a variation of BEAM-13606. The root ca

[jira] [Commented] (BEAM-13376) Missing error for nonexistent column family BigTable

2022-02-11 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491183#comment-17491183 ] Ning commented on BEAM-13376: - [~wangrobert] In that case, for this ticket, it doesn't sound

[jira] [Comment Edited] (BEAM-13376) Missing error for nonexistent column family BigTable

2022-02-11 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491183#comment-17491183 ] Ning edited comment on BEAM-13376 at 2/11/22, 10:30 PM: [~wangrob

[jira] [Commented] (BEAM-13691) insufficient error message on Cloud Logging

2022-02-28 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499203#comment-17499203 ] Ning commented on BEAM-13691: - Because if a service account is deleted or disabled, it's goin

[jira] [Work started] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14016 started by Ning. --- > > apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spa

[jira] [Commented] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500992#comment-17500992 ] Ning commented on BEAM-14016: - Just looking at the code, the [self.service_metric.call('ok')

[jira] [Comment Edited] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500992#comment-17500992 ] Ning edited comment on BEAM-14016 at 3/3/22, 8:11 PM: -- Just looking

[jira] [Comment Edited] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500992#comment-17500992 ] Ning edited comment on BEAM-14016 at 3/4/22, 12:54 AM: --- Just lookin

[jira] [Commented] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501092#comment-17501092 ] Ning commented on BEAM-14016: - The `table_metric` is meaningless here since the batch write i

[jira] [Comment Edited] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501092#comment-17501092 ] Ning edited comment on BEAM-14016 at 3/4/22, 1:16 AM: -- A single `tab

[jira] [Comment Edited] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501092#comment-17501092 ] Ning edited comment on BEAM-14016 at 3/4/22, 1:33 AM: -- A single `tab

[jira] [Comment Edited] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501092#comment-17501092 ] Ning edited comment on BEAM-14016 at 3/4/22, 1:39 AM: -- A single `tab

[jira] [Comment Edited] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501092#comment-17501092 ] Ning edited comment on BEAM-14016 at 3/4/22, 1:39 AM: -- A single `tab

[jira] [Commented] (BEAM-13691) insufficient error message on Cloud Logging

2022-03-04 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501482#comment-17501482 ] Ning commented on BEAM-13691: - Talked with Udi. I'll work on an one-pager to propose a soluti

[jira] [Updated] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-04 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14016: Fix Version/s: (was: 2.38.0) > > apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrat

[jira] [Updated] (BEAM-14016) apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest.test_spanner_update fails in Python3.7 Postcommits

2022-03-04 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14016: Fix Version/s: 2.38.0 Resolution: Fixed Status: Resolved (was: In Progress) > > apache_beam.io

[jira] [Updated] (BEAM-13670) Beam Dependency Update Request: ipython

2022-03-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-13670: Issue Type: Improvement (was: Bug) > Beam Dependency Update Request: ipython > ---

[jira] [Updated] (BEAM-13670) Beam Dependency Update Request: ipython

2022-03-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-13670: Priority: P3 (was: P2) > Beam Dependency Update Request: ipython > --- > >

[jira] [Updated] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-03-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-13670: Summary: Interactive Beam Dependency Update Request: ipython (was: Beam Dependency Update Request: ipython) > Int

[jira] [Commented] (BEAM-13670) Beam Dependency Update Request: ipython

2022-03-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502463#comment-17502463 ] Ning commented on BEAM-13670: - Lowered the priority and marked it an improvement instead of b

[jira] [Updated] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-03-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-13670: Component/s: runner-py-interactive > Interactive Beam Dependency Update Request: ipython >

[jira] [Created] (BEAM-14100) Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline

2022-03-14 Thread Ning (Jira)
Ning created BEAM-14100: --- Summary: Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline Key: BEAM-14100 URL: https://issues.apache.org/jira/browse/BEAM-14100 Project: Beam

[jira] [Updated] (BEAM-14100) Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline

2022-03-14 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14100: Attachment: 5wETU34vtmgk2de.png > Dataflow interactive runner throws exception when there is BigQuery I/O in > the

[jira] [Updated] (BEAM-14100) Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline

2022-03-14 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14100: Description: {code:java} ~/apache-beam-2.37.0/lib/python3.7/site-packages/apache_beam/coders/coders.py in (x)

[jira] [Updated] (BEAM-14100) Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline

2022-03-15 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14100: Description: {code:java} ~/apache-beam-2.37.0/lib/python3.7/site-packages/apache_beam/coders/coders.py in (x)

[jira] [Work started] (BEAM-14100) Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline

2022-03-16 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14100 started by Ning. --- > Dataflow interactive runner throws exception when there is BigQuery I/O in > the pipeline > ---

[jira] [Updated] (BEAM-14100) Dataflow interactive runner throws exception when there is BigQuery I/O in the pipeline

2022-03-16 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14100: Fix Version/s: Not applicable Resolution: Duplicate Status: Resolved (was: In Progress) > Datafl

[jira] [Updated] (BEAM-14112) ReadFromBigQuery cannot be used with the interactive runner

2022-03-17 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14112: Fix Version/s: 2.38.0 Resolution: Fixed Status: Resolved (was: Triage Needed) > ReadFromBigQuery

[jira] [Work started] (BEAM-14083) ReadFromBigquery examples throw pickling exception when using InteractiveRunner

2022-03-17 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14083 started by null. --- > ReadFromBigquery examples throw pickling exception when using > InteractiveRunner > ---

[jira] [Commented] (BEAM-14083) ReadFromBigquery examples throw pickling exception when using InteractiveRunner

2022-03-17 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508351#comment-17508351 ] Ning commented on BEAM-14083: - This is a duplicate of BEAM-14100 and BEAM-14112, the fix is i

[jira] [Updated] (BEAM-14083) ReadFromBigquery examples throw pickling exception when using InteractiveRunner

2022-03-17 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14083: Fix Version/s: 2.38.0 Assignee: Ning Resolution: Fixed Status: Resolved (was: In Progres

[jira] [Assigned] (BEAM-13670) Beam Dependency Update Request: ipython

2022-02-28 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-13670: --- Assignee: Ning > Beam Dependency Update Request: ipython > --- > >

[jira] [Work started] (BEAM-13691) insufficient error message on Cloud Logging

2022-02-28 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-13691 started by Ning. --- > insufficient error message on Cloud Logging > --- > >

[jira] [Commented] (BEAM-14211) Add "interactive" DataFrame operations that eagerly trigger execution

2022-03-30 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17514959#comment-17514959 ] Ning commented on BEAM-14211: - Thanks, Brian. Yes, we don't need to be tightly coupled. `ib.c

[jira] [Commented] (BEAM-14211) Add "interactive" DataFrame operations that eagerly trigger execution

2022-03-30 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17514972#comment-17514972 ] Ning commented on BEAM-14211: - In that case, should we consolidates the "_to_list()" and "_pl

[jira] [Assigned] (BEAM-14112) ReadFromBigQuery cannot be used with the interactive runner

2022-04-06 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-14112: --- Assignee: Ning (was: Chun Yang) > ReadFromBigQuery cannot be used with the interactive runner > ---

[jira] [Created] (BEAM-14373) Support using FlinkRunner with the beam_sql magic

2022-04-27 Thread Ning (Jira)
Ning created BEAM-14373: --- Summary: Support using FlinkRunner with the beam_sql magic Key: BEAM-14373 URL: https://issues.apache.org/jira/browse/BEAM-14373 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-12575) Beam Dependency Update Request: ipykernel

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-12575: --- Assignee: Ning > Beam Dependency Update Request: ipykernel > - > >

[jira] [Commented] (BEAM-12575) Beam Dependency Update Request: ipykernel

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530877#comment-17530877 ] Ning commented on BEAM-12575: - [~kenn], I'll make a PR to upgrade to the new major release. O

[jira] [Updated] (BEAM-12575) Beam Dependency Update Request: ipykernel

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12575: Issue Type: Improvement (was: Bug) > Beam Dependency Update Request: ipykernel > -

[jira] [Updated] (BEAM-12575) Beam Dependency Update Request: ipykernel

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12575: Priority: P2 (was: P3) > Beam Dependency Update Request: ipykernel > - > >

[jira] [Assigned] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-13670: --- Assignee: Ning > Interactive Beam Dependency Update Request: ipython > -

[jira] [Updated] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-13670: Priority: P2 (was: P3) > Interactive Beam Dependency Update Request: ipython > ---

[jira] [Work started] (BEAM-12575) Beam Dependency Update Request: ipykernel

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-12575 started by Ning. --- > Beam Dependency Update Request: ipykernel > - > >

[jira] [Work started] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-13670 started by Ning. --- > Interactive Beam Dependency Update Request: ipython > --

[jira] [Updated] (BEAM-12575) Beam Dependency Update Request: ipykernel

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12575: Fix Version/s: 2.39.0 Resolution: Fixed Status: Resolved (was: In Progress) > Beam Dependency Up

[jira] [Commented] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-05-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531002#comment-17531002 ] Ning commented on BEAM-13670: - v8 only works with Python>=3.8; upgraded but using the `python

[jira] [Updated] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-05-03 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-13670: Fix Version/s: 2.39.0 Resolution: Fixed Status: Resolved (was: In Progress) > Interactive Beam D

[jira] [Updated] (BEAM-14332) Improve the workflow of cluster management for Flink on Dataproc

2022-05-06 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14332: Fix Version/s: 2.40.0 Resolution: Fixed Status: Resolved (was: In Progress) > Improve the workfl

[jira] [Work started] (BEAM-14332) Improve the workflow of cluster management for Flink on Dataproc

2022-05-06 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14332 started by Ning. --- > Improve the workflow of cluster management for Flink on Dataproc > -

[jira] [Created] (BEAM-14449) Support cluster provisioning when using Flink on Dataproc

2022-05-09 Thread Ning (Jira)
Ning created BEAM-14449: --- Summary: Support cluster provisioning when using Flink on Dataproc Key: BEAM-14449 URL: https://issues.apache.org/jira/browse/BEAM-14449 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-14449) Support cluster provisioning when using Flink on Dataproc

2022-05-16 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14449: Attachment: image-2022-05-16-11-25-32-904.png > Support cluster provisioning when using Flink on Dataproc > ---

[jira] [Updated] (BEAM-14449) Support cluster provisioning when using Flink on Dataproc

2022-05-16 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14449: Description: Provide the capability for the user to explicitly provision a cluster. Current implementation provisi

[jira] [Updated] (BEAM-14449) Support cluster provisioning when using Flink on Dataproc

2022-05-16 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14449: Description: Provide the capability for the user to explicitly provision a cluster. Current implementation provisi

[jira] [Updated] (BEAM-14449) Support cluster provisioning when using Flink on Dataproc

2022-05-16 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14449: Attachment: image-2022-05-16-11-28-12-702.png > Support cluster provisioning when using Flink on Dataproc > ---

[jira] [Commented] (BEAM-14515) Decouple interactive Beam from Jupyter

2022-05-25 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542282#comment-17542282 ] Ning commented on BEAM-14515: - Our existing logic is coupled with IPython, not Jupyter; most

[jira] [Updated] (BEAM-14449) Support cluster provisioning when using Flink on Dataproc

2022-05-31 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14449: Fix Version/s: 2.40.0 Resolution: Fixed Status: Resolved (was: Open) > Support cluster provision

[jira] [Commented] (BEAM-13670) Interactive Beam Dependency Update Request: ipython

2022-04-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17519033#comment-17519033 ] Ning commented on BEAM-13670: - IPython is now on 8.2.0, we should be good to go to upgrade it

[jira] [Assigned] (BEAM-14288) Python PreCommit flaking in test_pformat_namedtuple_with_unnamed_fields

2022-04-11 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-14288: --- Assignee: Ning (was: Brian Hulette) > Python PreCommit flaking in test_pformat_namedtuple_with_unnamed_fiel

[jira] [Commented] (BEAM-14288) Python PreCommit flaking in test_pformat_namedtuple_with_unnamed_fields

2022-04-11 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520808#comment-17520808 ] Ning commented on BEAM-14288: - Got it, the root cause should be: {{repr()}} is not determini

[jira] [Commented] (BEAM-14288) Python PreCommit flaking in test_pformat_namedtuple_with_unnamed_fields

2022-04-12 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17521319#comment-17521319 ] Ning commented on BEAM-14288: - The root cause is that when building a Union type (typing._Gen

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2022-04-18 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523814#comment-17523814 ] Ning commented on BEAM-10708: - Hi [~nnamnielk], yes, I completely agree with that! We still h

[jira] [Created] (BEAM-14330) google.api_core.exceptions.MethodNotImplemented when tests run in parallel

2022-04-19 Thread Ning (Jira)
Ning created BEAM-14330: --- Summary: google.api_core.exceptions.MethodNotImplemented when tests run in parallel Key: BEAM-14330 URL: https://issues.apache.org/jira/browse/BEAM-14330 Project: Beam Issue

[jira] [Work started] (BEAM-14330) google.api_core.exceptions.MethodNotImplemented when tests run in parallel

2022-04-19 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14330 started by Ning. --- > google.api_core.exceptions.MethodNotImplemented when tests run in parallel > ---

[jira] [Created] (BEAM-14331) Make InteractiveRunner work without runner api roundtrip

2022-04-19 Thread Ning (Jira)
Ning created BEAM-14331: --- Summary: Make InteractiveRunner work without runner api roundtrip Key: BEAM-14331 URL: https://issues.apache.org/jira/browse/BEAM-14331 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-14332) Improve the workflow of cluster management for Flink on Dataproc

2022-04-19 Thread Ning (Jira)
Ning created BEAM-14332: --- Summary: Improve the workflow of cluster management for Flink on Dataproc Key: BEAM-14332 URL: https://issues.apache.org/jira/browse/BEAM-14332 Project: Beam Issue Type: Impr

[jira] [Updated] (BEAM-14288) Python PreCommit flaking in test_pformat_namedtuple_with_unnamed_fields

2022-04-19 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14288: Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: In Progress) > Python Pre

[jira] [Work started] (BEAM-14288) Python PreCommit flaking in test_pformat_namedtuple_with_unnamed_fields

2022-04-19 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-14288 started by Ning. --- > Python PreCommit flaking in test_pformat_namedtuple_with_unnamed_fields > --

[jira] [Updated] (BEAM-14112) ReadFromBigQuery cannot be used with the interactive runner

2022-04-20 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14112: Fix Version/s: 2.39.0 Resolution: Fixed Status: Resolved (was: Open) > ReadFromBigQuery cannot b

[jira] [Commented] (BEAM-14112) ReadFromBigQuery cannot be used with the interactive runner

2022-04-20 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525328#comment-17525328 ] Ning commented on BEAM-14112: - Added a fix and a TODO (BEAM-14331) for future solution. > Re

[jira] [Updated] (BEAM-14330) google.api_core.exceptions.MethodNotImplemented when tests run in parallel

2022-04-20 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-14330: Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: In Progress) Temporarily

[jira] [Commented] (BEAM-12657) Can't run Beam on separate Flink cluster. Official instructions don't work.

2021-07-26 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387515#comment-17387515 ] Ning commented on BEAM-12657: - The docker started cluster needs to use `--publish` option to

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-07-28 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388903#comment-17388903 ] Ning commented on BEAM-10708: - An update: I'm currently working on BEAM-12506 that could help

[jira] [Updated] (BEAM-12653) Dataflow validatesRunnerV2TestStreaming broken

2021-07-28 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12653: Priority: P1 (was: P2) > Dataflow validatesRunnerV2TestStreaming broken >

[jira] [Created] (BEAM-12674) SqlTransform IllegalArgumentException: key already present: SchemaCoder

2021-07-28 Thread Ning (Jira)
Ning created BEAM-12674: --- Summary: SqlTransform IllegalArgumentException: key already present: SchemaCoder Key: BEAM-12674 URL: https://issues.apache.org/jira/browse/BEAM-12674 Project: Beam Issue Typ

[jira] [Updated] (BEAM-12653) Dataflow validatesRunnerV2TestStreaming broken

2021-07-28 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12653: Priority: P2 (was: P1) > Dataflow validatesRunnerV2TestStreaming broken >

[jira] [Updated] (BEAM-12506) Change WindowedValueHolder into a Row Schema

2021-07-29 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12506: Resolution: Fixed Status: Resolved (was: Open) > Change WindowedValueHolder into a Row Schema > --

[jira] [Assigned] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-08-09 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-10708: --- Assignee: Ning > InteractiveRunner cannot execute pipeline with cross-language transform > -

[jira] [Assigned] (BEAM-12567) Beam should retry failing GCS uploads

2021-07-19 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-12567: --- Assignee: Ning > Beam should retry failing GCS uploads > -- > >

[jira] [Assigned] (BEAM-12567) Beam should retry failing GCS uploads

2021-07-19 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-12567: --- Assignee: (was: Ning) > Beam should retry failing GCS uploads > --

[jira] [Updated] (BEAM-12506) Change WindowedValueHolder into a Row Schema

2021-07-22 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12506: Labels: (was: stale-assigned) > Change WindowedValueHolder into a Row Schema > --

[jira] [Updated] (BEAM-12506) Change WindowedValueHolder into a Row Schema

2021-07-23 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12506: Description: The WindowedValueHolder is a Python type that requires a special `SafeFastPrimitivesCoder` instead of

[jira] [Assigned] (BEAM-7515) Support TestStream on the fn_api_runner

2021-08-31 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-7515: -- Assignee: Ning > Support TestStream on the fn_api_runner > --- > >

[jira] [Commented] (BEAM-7515) Support TestStream on the fn_api_runner

2021-08-31 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407794#comment-17407794 ] Ning commented on BEAM-7515: Hi Pablo, I could take the ticket since I'm trying to support Bea

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-01 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408370#comment-17408370 ] Ning commented on BEAM-10708: - Yes, customers could use the beam_sql magic instead of the Sql

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-01 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408399#comment-17408399 ] Ning commented on BEAM-10708: - It's a workaround for SQL only. There is no integration test f

[jira] [Comment Edited] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-01 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408370#comment-17408370 ] Ning edited comment on BEAM-10708 at 9/1/21, 10:08 PM: --- Yes, custom

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-01 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408457#comment-17408457 ] Ning commented on BEAM-10708: - *For streaming, a summary of the current status*: For the 2

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409012#comment-17409012 ] Ning commented on BEAM-10708: - Yes, we could deprecate the runner api roundtrip usage in Inte

[jira] [Work started] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-10708 started by Ning. --- > InteractiveRunner cannot execute pipeline with cross-language transform > --

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409016#comment-17409016 ] Ning commented on BEAM-10708: - Once FnApiRunner supports TestStream, streaming pipelines defi

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409032#comment-17409032 ] Ning commented on BEAM-10708: - Thanks for asking. Switching to "FnApiRunner" makes the deprec

[jira] [Comment Edited] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-02 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409032#comment-17409032 ] Ning edited comment on BEAM-10708 at 9/2/21, 6:43 PM: -- Thanks for as

[jira] [Commented] (BEAM-10708) InteractiveRunner cannot execute pipeline with cross-language transform

2021-09-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411363#comment-17411363 ] Ning commented on BEAM-10708: - (y) Thanks! That's good to know! > InteractiveRunner cannot e

[jira] [Assigned] (BEAM-7515) Support TestStream on the fn_api_runner

2021-09-07 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reassigned BEAM-7515: -- Assignee: (was: Ning) > Support TestStream on the fn_api_runner > --- >

[jira] [Created] (BEAM-12997) Upgrade apache-beam-jupyterlab-sidepanel to JupyterLab v3

2021-10-04 Thread Ning (Jira)
Ning created BEAM-12997: --- Summary: Upgrade apache-beam-jupyterlab-sidepanel to JupyterLab v3 Key: BEAM-12997 URL: https://issues.apache.org/jira/browse/BEAM-12997 Project: Beam Issue Type: Improvement

[jira] [Work started] (BEAM-12997) Upgrade apache-beam-jupyterlab-sidepanel to JupyterLab v3

2021-10-12 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-12997 started by Ning. --- > Upgrade apache-beam-jupyterlab-sidepanel to JupyterLab v3 >

[jira] [Updated] (BEAM-12997) Upgrade apache-beam-jupyterlab-sidepanel to JupyterLab v3

2021-10-12 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning updated BEAM-12997: Resolution: Fixed Status: Resolved (was: In Progress) Lab extension upgraded. For vulnerability scan iss

[jira] [Reopened] (BEAM-12997) Upgrade apache-beam-jupyterlab-sidepanel to JupyterLab v3

2021-10-14 Thread Ning (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning reopened BEAM-12997: - Use this ticket for release. > Upgrade apache-beam-jupyterlab-sidepanel to JupyterLab v3 > -

  1   2   >