[ https://issues.apache.org/jira/browse/BEAM-14068?focusedWorklogId=778289&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-778289 ]
ASF GitHub Bot logged work on BEAM-14068: ----------------------------------------- Author: ASF GitHub Bot Created on: 03/Jun/22 20:16 Start Date: 03/Jun/22 20:16 Worklog Time Spent: 10m Work Description: AnandInguva commented on PR #17462: URL: https://github.com/apache/beam/pull/17462#issuecomment-1146327462 Run Python 3.9 PostCommit Issue Time Tracking ------------------- Worklog Id: (was: 778289) Time Spent: 10h 10m (was: 10h) > RunInference Benchmarking tests > ------------------------------- > > Key: BEAM-14068 > URL: https://issues.apache.org/jira/browse/BEAM-14068 > Project: Beam > Issue Type: Sub-task > Components: sdk-py-core > Reporter: Anand Inguva > Assignee: Anand Inguva > Priority: P2 > Time Spent: 10h 10m > Remaining Estimate: 0h > > RunInference benchmarks will evaluate performance of Pipelines, which > represent common use cases of Beam + Dataflow in Pytorch, sklearn and > possibly TFX. These benchmarks would be the integration tests that exercise > several software components using Beam, PyTorch, Scikit learn and TensorFlow > extended. > we would use the datasets that's available publicly (Eg; Kaggle). > Size: small / 10 GB / 1 TB etc > The default execution runner would be Dataflow unless specified otherwise. > These tests would be run very less frequently(every release cycle). -- This message was sent by Atlassian Jira (v8.20.7#820007)