[jira] [Comment Edited] (BEAM-14552) Extraneous warning message: "Make sure that locally built Python SDK docker image has Python X.Y interpreter"

2022-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545661#comment-17545661 ] Brian Hulette edited comment on BEAM-14552 at 6/2/22 9:23 PM: -

[jira] [Commented] (BEAM-14552) Extraneous warning message: "Make sure that locally built Python SDK docker image has Python X.Y interpreter"

2022-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545661#comment-17545661 ] Brian Hulette commented on BEAM-14552: -- I did some archaeology on this. I think the

[jira] [Updated] (BEAM-14552) Extraneous warning message: "Make sure that locally built Python SDK docker image has Python X.Y interpreter"

2022-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14552: - Status: Open (was: Triage Needed) > Extraneous warning message: "Make sure that locally built Py

[jira] [Updated] (BEAM-14552) Extraneous warning message: "Make sure that locally built Python SDK docker image has Python X.Y interpreter"

2022-06-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14552: - Description: This warning comes up whenever a Python pipeline is constructed. It never seems to

[jira] [Created] (BEAM-14552) Extraneous warning message: "Make sure that locally built Python SDK docker image has Python X.Y interpreter"

2022-06-02 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14552: Summary: Extraneous warning message: "Make sure that locally built Python SDK docker image has Python X.Y interpreter" Key: BEAM-14552 URL: https://issues.apache.org/jira/browse/B

[jira] [Commented] (BEAM-5336) Support for a Dask runner

2022-06-01 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545003#comment-17545003 ] Brian Hulette commented on BEAM-5336: - Linking here for easy access, this is the Pange

[jira] [Updated] (BEAM-14540) Native implementation for serialized Rows to/from Arrow

2022-05-31 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14540: - Description: With https://s.apache.org/batched-dofns (BEAM-14213), we want to encourage users to

[jira] [Updated] (BEAM-14540) Native implementation for serialized Rows to/from Arrow

2022-05-31 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14540: - Description: With https://s.apache.org/batched-dofns (BEAM-14213), we want to encourage users to

[jira] [Updated] (BEAM-14540) Native implementation for serialized Rows to/from Arrow

2022-05-31 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14540: - Description: With https://s.apache.org/batched-dofns (BEAM-14213), we want to encourage users to

[jira] [Updated] (BEAM-14540) Native implementation for serialized Rows to/from Arrow

2022-05-31 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14540: - Status: Open (was: Triage Needed) > Native implementation for serialized Rows to/from Arrow > --

[jira] [Commented] (BEAM-14540) Native implementation for serialized Rows to/from Arrow

2022-05-31 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544641#comment-17544641 ] Brian Hulette commented on BEAM-14540: -- To implement this we need a native "coder" w

[jira] [Created] (BEAM-14540) Native implementation for serialized Rows to/from Arrow

2022-05-31 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14540: Summary: Native implementation for serialized Rows to/from Arrow Key: BEAM-14540 URL: https://issues.apache.org/jira/browse/BEAM-14540 Project: Beam Issue Ty

[jira] [Updated] (BEAM-14537) Create a cross-language registrar for SchemaTransform

2022-05-31 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14537: - Status: Open (was: Triage Needed) > Create a cross-language registrar for SchemaTransform >

[jira] [Updated] (BEAM-13905) Apache Beam Python: Dataframe Transforms break when the option runtime_type_check is enabled.

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-13905: - Labels: (was: stale-assigned) > Apache Beam Python: Dataframe Transforms break when the option

[jira] [Assigned] (BEAM-5537) Beam Dependency Update Request: google-cloud-bigquery

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-5537: --- Assignee: (was: Brian Hulette) > Beam Dependency Update Request: google-cloud-bigquery >

[jira] [Assigned] (BEAM-9582) Beam Dependency Update Request: grpcio-tools

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-9582: --- Assignee: (was: Brian Hulette) > Beam Dependency Update Request: grpcio-tools > -

[jira] [Updated] (BEAM-14508) Parquetio should produce a schema'd PCollection

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14508: - Issue Type: Improvement (was: Bug) > Parquetio should produce a schema'd PCollection > -

[jira] [Updated] (BEAM-14178) Add support for inferring Beam schemas from dataclasses

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14178: - Labels: (was: stale-assigned) > Add support for inferring Beam schemas from dataclasses > -

[jira] [Commented] (BEAM-12572) All beam examples should get continuously exercised

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542643#comment-17542643 ] Brian Hulette commented on BEAM-12572: -- What work is remaining here? > All beam exa

[jira] [Updated] (BEAM-14180) Convert all type comments to type annotations with com2ann

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14180: - Labels: (was: stale-assigned) > Convert all type comments to type annotations with com2ann > --

[jira] [Commented] (BEAM-5336) Support for a Dask runner

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542605#comment-17542605 ] Brian Hulette commented on BEAM-5336: - The [Runner Guide|https://beam.apache.org/contr

[jira] [Comment Edited] (BEAM-5336) Support for a Dask runner

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542605#comment-17542605 ] Brian Hulette edited comment on BEAM-5336 at 5/26/22 5:38 PM: --

[jira] [Updated] (BEAM-14336) Access Denied: Table bigquery-samples:airline_ontime_data.flights

2022-05-26 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14336: - Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: In Progr

[jira] [Updated] (BEAM-14481) ScopedState can not be re-entered (regression caused by Batched DoFn worker changes)

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14481: - Summary: ScopedState can not be re-entered (regression caused by Batched DoFn worker changes) (w

[jira] [Updated] (BEAM-14481) OOM regression caused by Batched DoFn worker changes

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14481: - Description: We've observed some regressions in internal pipelines. We've narrowed the root caus

[jira] [Updated] (BEAM-14515) Decouple interactive Beam from Jupyter

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14515: - Description: Some aspects of interactive Beam (e.g. triggering execution with ib.collect) make s

[jira] [Updated] (BEAM-14515) Decouple interactive Beam from Jupyter

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14515: - Status: Open (was: Triage Needed) > Decouple interactive Beam from Jupyter > ---

[jira] [Commented] (BEAM-14515) Decouple interactive Beam from Jupyter

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542279#comment-17542279 ] Brian Hulette commented on BEAM-14515: -- CC: [~ningk] [~robertwb] > Decouple interac

[jira] [Commented] (BEAM-14515) Decouple interactive Beam from Jupyter

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542278#comment-17542278 ] Brian Hulette commented on BEAM-14515: -- This came up on SO: https://stackoverflow.co

[jira] [Created] (BEAM-14515) Decouple interactive Beam from Jupyter

2022-05-25 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14515: Summary: Decouple interactive Beam from Jupyter Key: BEAM-14515 URL: https://issues.apache.org/jira/browse/BEAM-14515 Project: Beam Issue Type: Improvement

[jira] [Comment Edited] (BEAM-14481) OOM regression caused by Batched DoFn worker changes

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542273#comment-17542273 ] Brian Hulette edited comment on BEAM-14481 at 5/25/22 11:18 PM: ---

[jira] [Commented] (BEAM-14481) OOM regression caused by Batched DoFn worker changes

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542273#comment-17542273 ] Brian Hulette commented on BEAM-14481: -- I managed to identify the root cause here. R

[jira] [Assigned] (BEAM-14481) OOM regression caused by Batched DoFn worker changes

2022-05-25 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-14481: Assignee: Brian Hulette > OOM regression caused by Batched DoFn worker changes > -

[jira] [Commented] (BEAM-14508) Parquetio should produce a schema'd PCollection

2022-05-24 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541760#comment-17541760 ] Brian Hulette commented on BEAM-14508: -- Agreed! I think the ideal solution here woul

[jira] [Updated] (BEAM-14294) MVP for SDK worker changes to support process_batch

2022-05-24 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14294: - Fix Version/s: 2.40.0 Resolution: Fixed Status: Resolved (was: Open) > MVP for

[jira] [Updated] (BEAM-14507) Add support for pandas 1.5

2022-05-24 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14507: - Status: Open (was: Triage Needed) > Add support for pandas 1.5 > -- > >

[jira] [Updated] (BEAM-14507) Add support for pandas 1.5

2022-05-24 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14507: - Description: Add support for pandas 1.5, once released (ideally we should run our tests against t

[jira] [Created] (BEAM-14507) Add support for pandas 1.5

2022-05-24 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14507: Summary: Add support for pandas 1.5 Key: BEAM-14507 URL: https://issues.apache.org/jira/browse/BEAM-14507 Project: Beam Issue Type: Improvement Com

[jira] [Commented] (BEAM-12366) GroupBy.describe generates an incorrect proxy

2022-05-24 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541720#comment-17541720 ] Brian Hulette commented on BEAM-12366: -- It looks like [https://github.com/pandas-dev

[jira] [Commented] (BEAM-14481) OOM regression caused by Batched DoFn worker changes

2022-05-23 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541229#comment-17541229 ] Brian Hulette commented on BEAM-14481: -- It turns out the issue in internal pipelines

[jira] [Commented] (BEAM-12000) Support Python 3.9 in Apache Beam

2022-05-23 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541216#comment-17541216 ] Brian Hulette commented on BEAM-12000: -- It looks like we have BEAM-5336 already for

[jira] [Updated] (BEAM-14328) DataFrame documentation should link to apache_beam.dataframe.frames as a reference for compliance status

2022-05-23 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14328: - Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: Open) >

[jira] [Commented] (BEAM-12000) Support Python 3.9 in Apache Beam

2022-05-23 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541173#comment-17541173 ] Brian Hulette commented on BEAM-12000: -- Hi [~rabernat], thanks for reaching out and

[jira] [Updated] (BEAM-14293) Add @DoFn.yields_batches and @DoFn.yields_elements decorators to override defaults

2022-05-23 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14293: - Labels: (was: stale-assigned) > Add @DoFn.yields_batches and @DoFn.yields_elements decorators t

[jira] [Updated] (BEAM-14477) Clean up/Fix runtime warning messages when generating a proxy at pipeline construction time

2022-05-19 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14477: - Component/s: dsl-dataframe (was: sdk-py-core) > Clean up/Fix runtime warning

[jira] [Updated] (BEAM-14477) Clean up/Fix runtime warning messages when generating a proxy at pipeline construction time

2022-05-19 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14477: - Status: Open (was: Triage Needed) > Clean up/Fix runtime warning messages when generating a prox

[jira] [Updated] (BEAM-14474) Clean up/Fix runtime warning messages in python unit test standard error

2022-05-19 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14474: - Status: Open (was: Triage Needed) > Clean up/Fix runtime warning messages in python unit test st

[jira] [Updated] (BEAM-14481) OOM regression caused by Batched DoFn worker changes

2022-05-17 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14481: - Status: Open (was: Triage Needed) > OOM regression caused by Batched DoFn worker changes > -

[jira] [Created] (BEAM-14481) OOM regression caused by Batched DoFn worker changes

2022-05-17 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14481: Summary: OOM regression caused by Batched DoFn worker changes Key: BEAM-14481 URL: https://issues.apache.org/jira/browse/BEAM-14481 Project: Beam Issue Type:

[jira] [Updated] (BEAM-14467) Failed test annotated with no_xdist passes github action python test

2022-05-17 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14467: - Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: Open) >

[jira] [Assigned] (BEAM-14447) BigQueryWriteIntegrationTests.test_big_query_write_insert_errors_reporting failing in Python PostCommit

2022-05-12 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reassigned BEAM-14447: Assignee: Pablo Estrada > BigQueryWriteIntegrationTests.test_big_query_write_insert_errors

[jira] [Updated] (BEAM-14447) BigQueryWriteIntegrationTests.test_big_query_write_insert_errors_reporting failing in Python PostCommit

2022-05-12 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14447: - Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: Open) R

[jira] [Commented] (BEAM-14412) Block release on impersonation FR

2022-05-10 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534623#comment-17534623 ] Brian Hulette commented on BEAM-14412: -- IMO this falls pretty squarely outside of th

[jira] [Updated] (BEAM-14447) BigQueryWriteIntegrationTests.test_big_query_write_insert_errors_reporting failing in Python PostCommit

2022-05-09 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14447: - Priority: P1 (was: P2) > BigQueryWriteIntegrationTests.test_big_query_write_insert_errors_report

[jira] [Updated] (BEAM-14447) BigQueryWriteIntegrationTests.test_big_query_write_insert_errors_reporting failing in Python PostCommit

2022-05-09 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14447: - Status: Open (was: Triage Needed) > BigQueryWriteIntegrationTests.test_big_query_write_insert_er

[jira] [Created] (BEAM-14447) BigQueryWriteIntegrationTests.test_big_query_write_insert_errors_reporting failing in Python PostCommit

2022-05-09 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14447: Summary: BigQueryWriteIntegrationTests.test_big_query_write_insert_errors_reporting failing in Python PostCommit Key: BEAM-14447 URL: https://issues.apache.org/jira/browse/BEAM-1

[jira] [Comment Edited] (BEAM-14337) Support **kwargs for PyTorch models.

2022-05-06 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533166#comment-17533166 ] Brian Hulette edited comment on BEAM-14337 at 5/7/22 12:51 AM:

[jira] [Commented] (BEAM-14337) Support **kwargs for PyTorch models.

2022-05-06 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533166#comment-17533166 ] Brian Hulette commented on BEAM-14337: -- No worries :) Right, the user isn't respons

[jira] [Commented] (BEAM-14337) Support **kwargs for PyTorch models.

2022-05-06 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533070#comment-17533070 ] Brian Hulette commented on BEAM-14337: -- > If there is no batch size, we assume that'

[jira] [Commented] (BEAM-14337) Support **kwargs for PyTorch models.

2022-05-06 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533061#comment-17533061 ] Brian Hulette commented on BEAM-14337: -- A couple more things I noticed looking at th

[jira] [Comment Edited] (BEAM-14337) Support **kwargs for PyTorch models.

2022-05-06 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533061#comment-17533061 ] Brian Hulette edited comment on BEAM-14337 at 5/6/22 7:35 PM: -

[jira] [Commented] (BEAM-9649) beam_python_mongoio_load_test started failing due to mismatched results

2022-05-06 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532946#comment-17532946 ] Brian Hulette commented on BEAM-9649: - Got it, thanks. Note [https://ci-beam.apache.o

[jira] [Comment Edited] (BEAM-9649) beam_python_mongoio_load_test started failing due to mismatched results

2022-05-05 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532482#comment-17532482 ] Brian Hulette edited comment on BEAM-9649 at 5/5/22 6:52 PM: -

[jira] [Commented] (BEAM-9649) beam_python_mongoio_load_test started failing due to mismatched results

2022-05-05 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532482#comment-17532482 ] Brian Hulette commented on BEAM-9649: - You can see current status here: [https://ci-b

[jira] [Comment Edited] (BEAM-14404) Some beam.dataframes.io functions does not support autocomplete

2022-05-05 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532451#comment-17532451 ] Brian Hulette edited comment on BEAM-14404 at 5/5/22 5:40 PM: -

[jira] [Commented] (BEAM-14404) Some beam.dataframes.io functions does not support autocomplete

2022-05-05 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532451#comment-17532451 ] Brian Hulette commented on BEAM-14404: -- Thanks for reporting this Dmitry. In what co

[jira] [Updated] (BEAM-14404) Some beam.dataframes.io functions does not support autocomplete

2022-05-05 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14404: - Status: Open (was: Triage Needed) > Some beam.dataframes.io functions does not support autocompl

[jira] [Commented] (BEAM-14410) FnRunnerTest with non-trivial (order 1000 elements) input flakes in non-cython environment

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531973#comment-17531973 ] Brian Hulette commented on BEAM-14410: -- It looks like using np.int64 instances as el

[jira] [Updated] (BEAM-14410) FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14410: - Summary: FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython env

[jira] [Commented] (BEAM-14230) Python JDBC API don't recognize "statement" parameter

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531942#comment-17531942 ] Brian Hulette commented on BEAM-14230: -- Just filed BEAM-14414 which I think is the a

[jira] [Created] (BEAM-14414) SchemaIO should encode config object in the top-level schema

2022-05-04 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14414: Summary: SchemaIO should encode config object in the top-level schema Key: BEAM-14414 URL: https://issues.apache.org/jira/browse/BEAM-14414 Project: Beam Is

[jira] [Created] (BEAM-14411) TypeCodersTest is never executed

2022-05-04 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14411: Summary: TypeCodersTest is never executed Key: BEAM-14411 URL: https://issues.apache.org/jira/browse/BEAM-14411 Project: Beam Issue Type: Bug Compo

[jira] [Updated] (BEAM-14410) FnRunnerTest with non-trivial (order 1000 elements) input flakes in non-cython environment

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14410: - Description: See [https://github.com/apache/beam/pull/17384#issuecomment-1117418018]   {code:jav

[jira] [Updated] (BEAM-14410) FnRunnerTest with non-trivial (order 1000 elements) input flakes in non-cython environment

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14410: - Status: Open (was: Triage Needed) > FnRunnerTest with non-trivial (order 1000 elements) input fl

[jira] [Created] (BEAM-14410) FnRunnerTest with non-trivial (order 1000 elements) input flakes in non-cython environment

2022-05-04 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14410: Summary: FnRunnerTest with non-trivial (order 1000 elements) input flakes in non-cython environment Key: BEAM-14410 URL: https://issues.apache.org/jira/browse/BEAM-14410

[jira] [Created] (BEAM-14409) Support per-key DoFn params in process_batch

2022-05-04 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14409: Summary: Support per-key DoFn params in process_batch Key: BEAM-14409 URL: https://issues.apache.org/jira/browse/BEAM-14409 Project: Beam Issue Type: Sub-tas

[jira] [Created] (BEAM-14408) batch-consuming DoFns should estimate byte size

2022-05-04 Thread Brian Hulette (Jira)
Brian Hulette created BEAM-14408: Summary: batch-consuming DoFns should estimate byte size Key: BEAM-14408 URL: https://issues.apache.org/jira/browse/BEAM-14408 Project: Beam Issue Type: Sub-

[jira] [Updated] (BEAM-14409) Support per-key DoFn params in process_batch

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14409: - Status: Open (was: Triage Needed) > Support per-key DoFn params in process_batch > -

[jira] [Commented] (BEAM-14340) Consider providing a dynamic API for declaring batch input type

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531753#comment-17531753 ] Brian Hulette commented on BEAM-14340: -- One simple solution would be to just let DoF

[jira] [Comment Edited] (BEAM-14340) Consider providing a dynamic API for declaring batch input type

2022-05-04 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531753#comment-17531753 ] Brian Hulette edited comment on BEAM-14340 at 5/4/22 2:44 PM: -

[jira] [Commented] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531281#comment-17531281 ] Brian Hulette commented on BEAM-12603: -- Re-opening this. Action is to investigate th

[jira] [Updated] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-12603: - Status: Open (was: Triage Needed) > Flaky: > apache_beam.runners.portability.fn_api_runner.fn_r

[jira] [Updated] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-12603: - Priority: P2 (was: P1) > Flaky: > apache_beam.runners.portability.fn_api_runner.fn_runner_test.

[jira] [Reopened] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette reopened BEAM-12603: -- Assignee: (was: Yichi Zhang) > Flaky: > apache_beam.runners.portability.fn_api_runner.fn_r

[jira] [Commented] (BEAM-13783) apache_beam.transforms.combinefn_lifecycle_test.LocalCombineFnLifecycleTest.test_combine is flaky

2022-05-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531279#comment-17531279 ] Brian Hulette commented on BEAM-13783: -- Thanks [~Ryan.Thompson] - FYI for test/infra

[jira] [Updated] (BEAM-13783) apache_beam.transforms.combinefn_lifecycle_test.LocalCombineFnLifecycleTest.test_combine is flaky

2022-05-03 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-13783: - Fix Version/s: Not applicable (was: 2.38.0) > apache_beam.transforms.combi

[jira] [Commented] (BEAM-14352) Add a TimestampedBatch analogue for TimestampedValue

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530995#comment-17530995 ] Brian Hulette commented on BEAM-14352: -- Alternatively, we could have a separate Assi

[jira] [Commented] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530968#comment-17530968 ] Brian Hulette commented on BEAM-12603: -- Unfortunately I can't glean anything particu

[jira] [Comment Edited] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530966#comment-17530966 ] Brian Hulette edited comment on BEAM-12603 at 5/2/22 11:15 PM:

[jira] [Commented] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530966#comment-17530966 ] Brian Hulette commented on BEAM-12603: -- another failure, this time with debug loggin

[jira] [Commented] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530961#comment-17530961 ] Brian Hulette commented on BEAM-12603: -- Got another local failure that looks like th

[jira] [Comment Edited] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530957#comment-17530957 ] Brian Hulette edited comment on BEAM-12603 at 5/2/22 10:19 PM:

[jira] [Comment Edited] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530959#comment-17530959 ] Brian Hulette edited comment on BEAM-12603 at 5/2/22 10:17 PM:

[jira] [Commented] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530959#comment-17530959 ] Brian Hulette commented on BEAM-12603: -- After 18 runs I got one relevant looking fai

[jira] [Comment Edited] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530957#comment-17530957 ] Brian Hulette edited comment on BEAM-12603 at 5/2/22 10:14 PM:

[jira] [Comment Edited] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530957#comment-17530957 ] Brian Hulette edited comment on BEAM-12603 at 5/2/22 10:14 PM:

[jira] [Commented] (BEAM-12603) Flaky: apache_beam.runners.portability.fn_api_runner.fn_runner_test.FnApiRunnerTestWithGrpcAndMultiWorkers

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530957#comment-17530957 ] Brian Hulette commented on BEAM-12603: -- I did a little bit of investigation I'll sum

[jira] [Updated] (BEAM-13951) mass_comment.py has outdated list of Run strings

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-13951: - Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: Open) >

[jira] [Commented] (BEAM-13951) mass_comment.py has outdated list of Run strings

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530944#comment-17530944 ] Brian Hulette commented on BEAM-13951: -- Closing this out as we've addressed the imme

[jira] [Updated] (BEAM-14392) Replace mass_comment.py with an automated solution

2022-05-02 Thread Brian Hulette (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Hulette updated BEAM-14392: - Status: Open (was: Triage Needed) > Replace mass_comment.py with an automated solution > ---

  1   2   3   4   5   6   7   8   9   10   >