This is an automated email from the ASF dual-hosted git repository.
linxinyuan pushed a change to branch xinyuan-remove-jooq-gen
in repository https://gitbox.apache.org/repos/asf/texera.git
from f5c0585b1f update
add 7c35e427a2 feat: add account creation time (#3736)
add f90848e557 feat(auth): removed token refresh functionality (#3765)
add dbeb0a084e feat(access-control-service): AccessControlService added as
a new micro service (#3767)
add aee6095b7e fix: Persist & apply “Data Transfer Batch Size” from
Workflow Settings (#3770)
add ccf998034f fix(op): fix incorrect names for Machine Learning Operators
(#3776)
add 084b476ce2 fix(op): add ML training operators for linear and logistic
regression (#3779)
add feca1cd2b7 feat: cap number of concurrent file uploads (#3735)
add 5b1bba18ff fix: Correctly format workflow JSON when downloading from
hub (#3751)
add 1d2e9cce00 fix(ui): Prevent link delete buttons from overlapping
(#3602)
add 5be6420566 chore: Add publish section with whoami to .asf.yaml (#3785)
add f406e256ca fix(gui): reopen workflow websocket when switching
workflows (#3773)
add df0c899637 fix(ui): move quota diagrams to new tab (#3781)
add e7ded5f7ac fix(ci): add explicit jdbc driver loading in relevant e2e
tests (#3783)
add 75c69ed015 fix: pin R arrow package to version 14.0.2.1 in
computing-unit-master (#3761)
add bc260178be chore(deps): bump torch from 2.4.1 to 2.8.0 and
typing_extensions from 4.9.0 to 4.10.0 (#3800)
add 89af4b9045 chore(deps): bump scikit-learn from 1.4.0 to 1.5.0 in
/core/amber (#3799)
add af453d7af3 chore: refactor user avatar component (#3790)
add cf3bb462a2 chore(deps): bump axios from 1.7.7 to 1.12.2 in /core/gui
(#3797)
add 637cfc9116 chore(deps): bump form-data from 3.0.2 to 3.0.4 in
/core/gui (#3793)
add bf4d2b9073 fix(debugger): do not truncate debug messages (#3786)
add b62632db52 feat(config): allow default.conf to be set using
environment variables (#3757)
add b0075f6350 feat: display datasets version creation timestamp (#3803)
add ab30bb1e80 chore: Upgrade checkout and setup actions to latest
versions (#3808)
add a0c1918358 feat: add save button for sidebar tabs on the admin
settings page (#3801)
add 989e4d0e8b feat(dataset): allow datasets to have the same name across
different users (#3715)
add 61bd59b08a ci: automatically label PRs (#3536)
add 98582dd153 ci: fix labeler.yml glob pattern syntax (#3813)
add 80160aab6d ci: fix labeler configuration for file glob patterns (#3814)
add d1313346d0 feat(gui): display the owner's avatar next to each CU
(#3784)
add 60c84bd175 fix(ci): explicitly load jdbc driver when accessing iceberg
postgres catalog (#3817)
add 4acb11901b fix(ci): update backend file patterns in labeler.yml (#3815)
add 6c89f40c26 fix: delete button only clickable from outer ring (#3809)
add 0d3bf4ce74 chore: add bug report template (#3812)
add 1ec8022a1e chore(deps): bump @babel/helpers from 7.25.7 to 7.28.4 in
/core/gui (#3795)
add 24ba25d3ce fix: conditionally show upload panels based on upload
activity (#3818)
add f7482d25ef fix(image): exec format error in pylsp Docker container
(#3811)
add 625a9afa36 fix(gui): keep words complete in the workspace' comment
boxes (#3597)
add 1c812a5e2d chore: Improve Bug Issue Template (#3826)
add 20a38d54d7 chore(deps): bump transformers from 4.44.2 to 4.53.0 in
/core/amber (#3635)
add 62dd9d4667 fix(deployment): deduplicate SQL files under `deployment`
by using symlinks (#3824)
add 257fbe04c5 chore(ci): automatically assign an author of a PR (#3835)
add 83076ac501 feat(amber): enable user system by default (#3782)
add fa1470205a chore(deps): bump prismjs from 1.29.0 to 1.30.0 in
/core/gui (#3796)
add 5650e9538d fix(access-control-service): fix formatting of
`AccessControlResource` (#3838)
add 8d676fde4a chore(ci): revert automatically assign an author of a PR
(#3839)
add e6c9d7db32 fix(access-control-service): fix service file formats
(#3840)
add 8b28c196f6 feat(access-control-service): add `access-control-service`
to authorize the requests to `/wsapi` and `Computing Unit` endpoints (#3598)
add 356a240e2f fix(file-service): avoid manually constructing the Dataset
object through parameters (#3820)
add 84f696e1ed refactor(config): remove user-sys enabled flag (#3831)
add 379ac816a5 fix(gui): enable frontend undo-redo with bug-fix for shared
editing (#3836)
add bf8c942440 feat: enable canceling pending uploads before upload begins
(#3847)
add 04105b8249 feat: improve `file-service` Docker Compose file (#3834)
add 4d3c788b81 feat: prevent export of results from non-downloadable
datasets (#3772)
add 933054ba03 Merge branch 'main' into xinyuan-remove-jooq-gen
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 3 +
.github/ISSUE_TEMPLATE/bug-template.yaml | 84 ++++
.github/labeler.yml | 85 ++++
.github/workflows/github-action-build.yml | 25 +-
.../workflows/{check-header.yml => pr-labeler.yml} | 20 +-
.../build.sbt | 12 +-
.../project/build.properties | 0
.../access-control-service-web-config.yaml} | 8 +-
.../src/main/resources/logback.xml | 9 +-
.../ics/texera/service/AccessControlService.scala | 80 ++++
.../AccessControlServiceConfiguration.scala} | 6 +-
.../service/resource/AccessControlResource.scala | 135 ++++++
.../service/resource/HealthCheckResource.scala | 0
.../uci/ics/texera/AccessControlResourceSpec.scala | 236 +++++++++++
core/amber/operator-requirements.txt | 4 +-
core/amber/requirements.txt | 4 +-
.../uci/ics/texera/web/ComputingUnitMaster.scala | 44 +-
.../ics/texera/web/ServletAwareConfigurator.scala | 89 +++-
.../edu/uci/ics/texera/web/SessionState.scala | 7 +
.../uci/ics/texera/web/TexeraWebApplication.scala | 4 +-
.../uci/ics/texera/web/auth/GuestAuthFilter.scala | 3 +-
.../edu/uci/ics/texera/web/auth/JwtAuth.scala | 31 +-
.../ics/texera/web/auth/UserAuthenticator.scala | 6 +-
.../http/request/auth/RefreshTokenRequest.scala | 22 -
.../web/resource/WorkflowWebsocketResource.scala | 16 +-
.../texera/web/resource/auth/AuthResource.scala | 25 +-
.../web/resource/auth/GoogleAuthResource.scala | 2 -
.../dashboard/DatasetSearchQueryBuilder.scala | 8 +-
.../resource/dashboard/UnifiedResourceSchema.scala | 4 +-
.../dashboard/admin/user/AdminUserResource.scala | 6 +-
.../web/resource/dashboard/hub/HubResource.scala | 2 +-
.../user/workflow/WorkflowExecutionsResource.scala | 382 ++++++++++++-----
.../web/service/ExecutionConsoleService.scala | 36 +-
.../texera/web/service/ExecutionStatsService.scala | 122 +++---
.../service/ExecutionsMetadataPersistService.scala | 3 -
.../web/service/WorkflowExecutionService.scala | 3 -
.../ics/texera/web/service/WorkflowService.scala | 49 +--
.../ics/amber/engine/e2e/DataProcessingSpec.scala | 54 +--
.../edu/uci/ics/amber/engine/e2e/PauseSpec.scala | 22 +-
.../edu/uci/ics/amber/engine/e2e/TestUtils.scala | 89 ++++
.../dashboard/file/WorkflowResourceSpec.scala | 101 ++++-
.../scala/edu/uci/ics/texera/auth/JwtParser.scala | 2 +-
.../ics/texera/auth/util/ComputingUnitAccess.scala | 55 +++
.../uci/ics/texera/auth/util/HeaderField.scala} | 10 +-
core/build.sbt | 13 +
.../resource/ComputingUnitManagingResource.scala | 42 +-
.../texera/service/resource/ConfigResource.scala | 3 +-
core/config/src/main/resources/auth.conf | 2 +-
core/config/src/main/resources/default.conf | 35 +-
core/config/src/main/resources/storage.conf | 6 +
core/config/src/main/resources/user-system.conf | 3 -
.../edu/uci/ics/amber/config/StorageConfig.scala | 7 +-
.../scala/edu/uci/ics/amber/util/PathUtils.scala | 2 +
.../uci/ics/texera/config/UserSystemConfig.scala | 1 -
.../scala/edu/uci/ics/texera/dao/SqlServer.scala | 4 +
.../edu/uci/ics/texera/dao/MockTexeraDB.scala | 8 +-
core/file-service/build.sbt | 6 +-
.../src/main/resources/docker-compose.yml | 26 +-
.../texera/service/resource/DatasetResource.scala | 194 +++++----
.../edu/uci/ics/texera/service/MockLakeFS.scala | 124 ++++++
.../service/resource/DatasetResourceSpec.scala | 206 +++++++++
core/gui/src/app/app-routing.module.ts | 4 +-
.../app/common/service/gui-config.service.mock.ts | 1 -
.../src/app/common/service/gui-config.service.ts | 6 +-
.../app/common/service/user/auth-guard.service.ts | 2 +-
.../src/app/common/service/user/auth.service.ts | 34 --
.../src/app/common/service/user/user.service.ts | 7 +-
core/gui/src/app/common/type/gui-config.ts | 1 -
core/gui/src/app/common/type/user.ts | 4 +
.../admin/settings/admin-settings.component.html | 51 ++-
.../admin/settings/admin-settings.component.scss | 6 +
.../admin/settings/admin-settings.component.ts | 37 +-
.../component/admin/user/admin-user.component.html | 7 +
.../component/admin/user/admin-user.component.ts | 9 +-
.../user/share-access/share-access.component.html | 4 +-
.../user/user-avatar/user-avatar.component.html | 28 +-
.../user/user-avatar/user-avatar.component.scss | 35 +-
.../dataset-detail.component.html | 130 ++++--
.../dataset-detail.component.scss | 18 +-
.../dataset-detail.component.ts | 222 ++++++----
...user-dataset-staged-objects-list.component.html | 4 +-
...user-dataset-staged-objects-list.component.scss | 4 +
.../user/user-quota/user-quota.component.html | 23 +-
.../user/user-quota/user-quota.component.scss | 4 +-
.../service/user/dataset/dataset.service.ts | 19 +-
.../service/user/download/download.service.ts | 21 +-
.../input-autocomplete.component.ts | 2 +-
.../component/left-panel/left-panel.component.ts | 5 +-
.../left-panel/settings/settings.component.ts | 6 +
.../workspace/component/menu/menu.component.html | 57 +--
.../app/workspace/component/menu/menu.component.ts | 19 +-
.../computing-unit-selection.component.html | 16 +
.../computing-unit-selection.component.ts | 2 +-
.../operator-property-edit-frame.component.ts | 1 -
.../result-exportation.component.html | 248 ++++++-----
.../result-exportation.component.ts | 106 ++++-
.../nz-modal-comment-box.component.scss | 5 +-
.../workflow-editor.component.spec.ts | 100 +++--
.../workflow-editor/workflow-editor.component.ts | 155 +++++--
.../app/workspace/component/workspace.component.ts | 108 ++---
.../computing-unit-status.service.ts | 7 +-
.../workspace/service/joint-ui/joint-ui.service.ts | 38 --
.../workflow-cache/workflow-cache.service.spec.ts | 234 ----------
.../workflow-cache/workflow-cache.service.ts | 41 --
.../model/shared-model-change-handler.ts | 36 +-
.../service/workflow-graph/model/workflow-graph.ts | 13 +
.../workflow-result-export.service.spec.ts | 25 +-
.../workflow-result-export.service.ts | 235 +++++++++--
.../workflow-websocket.service.ts | 4 +-
.../app/workspace/types/workflow-computing-unit.ts | 2 +
...ing.png => SklearnTrainingAdaptiveBoosting.png} | Bin
...learnBagging.png => SklearnTrainingBagging.png} | Bin
....png => SklearnTrainingBernoulliNaiveBayes.png} | Bin
...png => SklearnTrainingComplementNaiveBayes.png} | Bin
...ionTree.png => SklearnTrainingDecisionTree.png} | Bin
.../{SklearnDummy.png => SklearnTrainingDummy.png} | Bin
...nExtraTree.png => SklearnTrainingExtraTree.png} | Bin
...xtraTrees.png => SklearnTrainingExtraTrees.png} | Bin
...s.png => SklearnTrainingGaussianNaiveBayes.png} | Bin
...ing.png => SklearnTrainingGradientBoosting.png} | Bin
.../{SklearnKNN.png => SklearnTrainingKNN.png} | Bin
...ion.png => SklearnTrainingLinearRegression.png} | Bin
...nLinearSVM.png => SklearnTrainingLinearSVM.png} | Bin
...n.png => SklearnTrainingLogisticRegression.png} | Bin
...png => SklearnTrainingLogisticRegressionCV.png} | Bin
...png => SklearnTrainingMultiLayerPerceptron.png} | Bin
...ng => SklearnTrainingMultinomialNaiveBayes.png} | Bin
...roid.png => SklearnTrainingNearestCentroid.png} | Bin
...ve.png => SklearnTrainingPassiveAggressive.png} | Bin
...erceptron.png => SklearnTrainingPerceptron.png} | Bin
...g => SklearnTrainingProbabilityCalibration.png} | Bin
...mForest.png => SklearnTrainingRandomForest.png} | Bin
.../{SklearnRidge.png => SklearnTrainingRidge.png} | Bin
...learnRidgeCV.png => SklearnTrainingRidgeCV.png} | Bin
.../{SklearnSDG.png => SklearnTrainingSDG.png} | Bin
.../{SklearnSVM.png => SklearnTrainingSVM.png} | Bin
core/gui/src/styles.scss | 6 +
core/gui/yarn.lock | 227 +++++++++-
core/scripts/sql/texera_ddl.sql | 35 +-
core/scripts/sql/updates/{12.sql => 14.sql} | 18 +-
core/scripts/sql/updates/{04.sql => 15.sql} | 19 +-
.../uci/ics/amber/core/storage/FileResolver.scala | 62 ++-
.../core/storage/model/DatasetFileDocument.scala | 18 +-
.../ics/amber/core/storage/model/OnDataset.scala | 2 +-
.../storage/result/ExecutionResourcesMapping.scala | 75 ----
.../core/storage/util/LakeFSStorageClient.scala | 16 +-
.../scala/edu/uci/ics/amber/util/IcebergUtil.scala | 3 +
.../uci/ics/amber/storage/FileResolverSpec.scala | 5 +-
.../edu/uci/ics/amber/operator/LogicalOp.scala | 67 ++-
...=> SklearnTrainingLinearRegressionOpDesc.scala} | 6 +-
...ockerfile => access-control-service.dockerfile} | 13 +-
deployment/computing-unit-master.dockerfile | 11 +-
.../files/iceberg_postgres_catalog.sql | 1 +
.../k8s/texera-helmchart/files/texera_ddl.sql | 469 +--------------------
.../k8s/texera-helmchart/files/texera_lakefs.sql | 1 +
...yaml => access-control-service-deployment.yaml} | 27 +-
...ce.yaml => access-control-service-service.yaml} | 10 +-
.../texera-helmchart/templates/envoy-config.yaml | 38 ++
.../templates/envoy-deployment.yaml | 2 +-
.../templates/postgresql-init-script-config.yaml | 20 +-
deployment/k8s/texera-helmchart/values.yaml | 8 +
deployment/pylsp/Dockerfile | 3 +-
162 files changed, 3727 insertions(+), 2171 deletions(-)
create mode 100644 .github/ISSUE_TEMPLATE/bug-template.yaml
create mode 100644 .github/labeler.yml
copy .github/workflows/{check-header.yml => pr-labeler.yml} (77%)
copy core/{workflow-compiling-service => access-control-service}/build.sbt
(93%)
copy core/{computing-unit-managing-service =>
access-control-service}/project/build.properties (100%)
copy core/{config-service/src/main/resources/config-service-web-config.yaml =>
access-control-service/src/main/resources/access-control-service-web-config.yaml}
(84%)
copy core/{amber => access-control-service}/src/main/resources/logback.xml
(90%)
create mode 100644
core/access-control-service/src/main/scala/edu/uci/ics/texera/service/AccessControlService.scala
copy core/{computing-unit-managing-service/project/plugins.sbt =>
access-control-service/src/main/scala/edu/uci/ics/texera/service/AccessControlServiceConfiguration.scala}
(84%)
create mode 100644
core/access-control-service/src/main/scala/edu/uci/ics/texera/service/resource/AccessControlResource.scala
copy core/{computing-unit-managing-service =>
access-control-service}/src/main/scala/edu/uci/ics/texera/service/resource/HealthCheckResource.scala
(100%)
create mode 100644
core/access-control-service/src/test/scala/edu/uci/ics/texera/AccessControlResourceSpec.scala
delete mode 100644
core/amber/src/main/scala/edu/uci/ics/texera/web/model/http/request/auth/RefreshTokenRequest.scala
create mode 100644
core/auth/src/main/scala/edu/uci/ics/texera/auth/util/ComputingUnitAccess.scala
copy
core/{amber/src/main/scala/edu/uci/ics/texera/web/TexeraWebConfiguration.java
=> auth/src/main/scala/edu/uci/ics/texera/auth/util/HeaderField.scala} (79%)
create mode 100644
core/file-service/src/test/scala/edu/uci/ics/texera/service/MockLakeFS.scala
create mode 100644
core/file-service/src/test/scala/edu/uci/ics/texera/service/resource/DatasetResourceSpec.scala
delete mode 100644
core/gui/src/app/workspace/service/workflow-cache/workflow-cache.service.spec.ts
delete mode 100644
core/gui/src/app/workspace/service/workflow-cache/workflow-cache.service.ts
copy core/gui/src/assets/operator_images/{SklearnAdaptiveBoosting.png =>
SklearnTrainingAdaptiveBoosting.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnBagging.png =>
SklearnTrainingBagging.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnBernoulliNaiveBayes.png =>
SklearnTrainingBernoulliNaiveBayes.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnComplementNaiveBayes.png =>
SklearnTrainingComplementNaiveBayes.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnDecisionTree.png =>
SklearnTrainingDecisionTree.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnDummy.png =>
SklearnTrainingDummy.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnExtraTree.png =>
SklearnTrainingExtraTree.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnExtraTrees.png =>
SklearnTrainingExtraTrees.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnGaussianNaiveBayes.png =>
SklearnTrainingGaussianNaiveBayes.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnGradientBoosting.png =>
SklearnTrainingGradientBoosting.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnKNN.png =>
SklearnTrainingKNN.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnLinearRegression.png =>
SklearnTrainingLinearRegression.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnLinearSVM.png =>
SklearnTrainingLinearSVM.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnLogisticRegression.png =>
SklearnTrainingLogisticRegression.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnLogisticRegressionCV.png =>
SklearnTrainingLogisticRegressionCV.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnMultiLayerPerceptron.png =>
SklearnTrainingMultiLayerPerceptron.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnMultinomialNaiveBayes.png =>
SklearnTrainingMultinomialNaiveBayes.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnNearestCentroid.png =>
SklearnTrainingNearestCentroid.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnPassiveAggressive.png =>
SklearnTrainingPassiveAggressive.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnPerceptron.png =>
SklearnTrainingPerceptron.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnProbabilityCalibration.png =>
SklearnTrainingProbabilityCalibration.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnRandomForest.png =>
SklearnTrainingRandomForest.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnRidge.png =>
SklearnTrainingRidge.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnRidgeCV.png =>
SklearnTrainingRidgeCV.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnSDG.png =>
SklearnTrainingSDG.png} (100%)
copy core/gui/src/assets/operator_images/{SklearnSVM.png =>
SklearnTrainingSVM.png} (100%)
copy core/scripts/sql/updates/{12.sql => 14.sql} (68%)
copy core/scripts/sql/updates/{04.sql => 15.sql} (74%)
delete mode 100644
core/workflow-core/src/main/scala/edu/uci/ics/amber/core/storage/result/ExecutionResourcesMapping.scala
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/training/{SklearnTrainingSDGOpDesc.scala
=> SklearnTrainingLinearRegressionOpDesc.scala} (84%)
copy deployment/{config-service.dockerfile =>
access-control-service.dockerfile} (78%)
create mode 120000
deployment/k8s/texera-helmchart/files/iceberg_postgres_catalog.sql
mode change 100644 => 120000
deployment/k8s/texera-helmchart/files/texera_ddl.sql
create mode 120000 deployment/k8s/texera-helmchart/files/texera_lakefs.sql
copy deployment/k8s/texera-helmchart/templates/{config-service-deployment.yaml
=> access-control-service-deployment.yaml} (68%)
copy deployment/k8s/texera-helmchart/templates/{config-service-service.yaml =>
access-control-service-service.yaml} (73%)
