This is an automated email from the ASF dual-hosted git repository.
xiaozhenliu pushed a change to branch xiaozhen-llm-chatbot
in repository https://gitbox.apache.org/repos/asf/texera.git
from 30a6255040 Change prompts to increase probability.
add 19fc7ab72b Add alpha value to Scatter Plot Operator (#3498)
add 4f4b383088 Add `Parquet` option in export workflow result types (#3478)
add da53b3788d Rename ControlPayload Class to Direct Control Message (DCM)
(#3492)
add 1452df993d Let WorkflowCompilingService send operators' output schemas
instead of input schemas (#3501)
add fb3dad48d8 Move the USER_SYS_DOMAIN from config deployment to
texeraEnvVars (#3503)
add e6c43f49b5 Fix email sharing to show actual sharer's email (#3505)
add 9e709a6fb7 Unify Count Retrieval APIs to improve community resources
browsing performance (#3442)
add 434d807271 Unify the `objectMapper` usage at amber and add
`objectMapper` warm-up thread in multiple micro services (#3504)
add e2caed19b0 Add ResourceQuota to cap the total resources for computing
units (#3493)
add 30199854f7 Set terminate_time of computing units in texera_db when
corresponding k8s pods die (#3513)
add 1c8076f31e Add Gauge Chart Visualization Operator (#3499)
add 3544219858 Add 2D Histogram Visualization Operator (#3454)
add 8ca4251138 Fix value `numOfPods` reference in file service deployment
template (#3514)
add ae04e1090d chore(build): correctly label artifacts as v1.0.0 (#3516)
add 727daa52e7 refactor(core): scala warnings clean up (#3521)
add e75455f94c feat: enable gui logo configuration CRUD using database
(#3511)
add 0621015972 fix(python): re-order python proto-generated code (#3522)
add 4da33ddeef chore(doc): add CONTRIBUTING.md (#3523)
add 9add627ba9 chore(ci): enforce Conventional Commits (#3520)
add 6de0502bbc feat(amber): enable terminating workers in a region upon
completion of region execution (#3468)
add 3d9248cf5b fix(auth): handle missing avatar in Google authentication
(#3539)
add 7cb16254e7 feat: enable sharing `write` access of a computing unit
between users (#3508)
add 7bf2382f69 feat(operator): treeplot operator (#3529)
add 3dc3767958 fix(operator): fixed typo in PythonUDF (#3545)
add 76d33f64c3 feat(gui): Improve UI for operator port metrics (#3477)
add 7e3738b4b3 refactor(amber): deprecate expansion-based greedy schedule
generator (#3542)
add d4fc5a24cf refactor(hub): retrieve `isLike`, `access` and `size` of
hub resources in batches (#3519)
add 940728453c fix(email): make notification subject lines more
informative (#3532) (#3548)
add b811f4addc feat(operator): time series plot operator (#3531)
add 472850437c feat(operator): enable re-ordering for projection operator
(#3543)
add ec9d0eef96 feat(operator): add sklearn training operators (#3535)
add 7db9dc979d fix: update import paths in Java UDF (#3547)
add 288a990b5f feat(operator): sleep operator (#3537)
add 19768964ca chore: Removal of extra operator statistics (#3558)
add 875708dd03 feat(amber): supporting consistent operator stats retrieval
(#3557)
add cac2c03cad chore(deps): update formly version to 6.3.12 (#3565)
add 7efe57441f fix(amber): fix output port writer thread closed by
finalizing an input port (#3566)
add c3b5f950cc feat: support max-concurrent-regions in ScheduleGenerator
(#3554)
add 729dd72c80 chore(gui): Improved visualization of port statistics
(#3569)
add ece56ec9a4 fix(ui): temporarily disable frontend undo and redo (#3571)
add 275c4c4ad9 feat: enable dynamic sidebar tabs customization (#3533)
add fff20e66ea fix: Dataset share panel 404 error by correcting API
endpoint URL (#3575)
add 3aba925fc9 fix: Hub page now only shows public workflows/datasets
instead of all accessible workflows/datasets (#3574)
add fb6645c5dd feat(gui): alert broken workflow (#3573)
add 82cb96c0f2 fix(ui): refine result panel: compact stats row, resize,
and highlight reset (#3568)
add 0b187c0a1b fix: make the default access for sharing from READ to WRITE
(#3582)
add 7c125205a6 chore(gui): Adjustment to Position of Eye icon (#3585)
add f804894db7 feat: rename computing unit (#3591)
add 98de576f8d chore(dep): bump pyarrow to 21.0.0 to fix CI (#3600)
add 9ab2cdfec1 chore(gui): fix admin dashboard columns (#3594)
add 3d5914cc37 feat(auth): add conformation before user login requests
(#3541)
add be6e67b38a chore: moving broken workflow check code to a function
(#3596)
add 43d0b3d577 feat: double click on operator displays result panel.
(#3603)
add a49cac2d09 chore(gui): Enhance visibility of “Create” buttons in
Workflows & Datasets panels (#3601)
add 89b49ceb92 feat(gui): Refresh Computing Unit List When Clicking
Computer Unit Drop Down Button (#3604)
add 80a74fc295 feat(gui): Automatically reconnect edge in between
operators (#3606)
add 24210ab892 feat(upload): enable real-time progress feedback (#3612)
add 593ab86f6a chore(ci): replace erisu/apache-rat-action with
apache/skywalking-eyes (#3639)
add b1781bffa7 chore(ci): let new commits trigger PR linter CI (#3641)
add c4dfa3cd23 chore: Create DISCLAIMER (#3631)
add 0ee8422daf chore: Create .asf.yaml (#3632)
add 35f8a49426 chore: update .asf.yaml to include PR settings (#3644)
add 7a49052870 chore(ci): remove R test from CI (#3643)
add 9e9ca60071 chore: Update NOTICE (#3629)
add 90efbe1b61 chore: Redirect jobs notifications to [email protected] (#3646)
add 299ffb04ff chore: create merge protections rules on a test branch
(#3645)
add e261518524 chore: fix typo in .asf.yaml (#3648)
add b98a47798c chore(doc): update CONTRIBUTING.md (#3611)
add 1ee7e0cc62 chore: revert changes on .asf.yaml (#3649)
add 175955c512 fix: CONTRIBUTING.md (#3633)
add d2773b8871 fix(docker): use JDK instead of JRE for Java UDF
compilation (#3628)
add 6aabc9a68d chore: call the project Apache Texera (#3637)
add f4727a6209 feat: enable configurable multipart upload settings using
database (#3622)
add f3175d6459 fix(ui): improve button label clarity for version creation
(#3623)
add f2214a1828 feat: switch single-file dataset downloads to use browser
native downloads (#3621)
add 3e41b94480 fix(clone): add clone button (#3651)
add 5e5ad2f0df feat(Ingress): Add ingress class name to values (#3652)
add a67da0799f feat: add user's activeness to admin dashboard (#3625)
add 12849accf7 feat(gui): Enhance Deleting Edges (#3636)
add 9e3bcad6a7 fix: yield tuple in GeneratorOperator example (#3657)
add e264a74262 fix: return error when attribute type is not set in UDF
(#3656)
add 61081f5458 fix(ui): Highlight "Workflows" tab when inside workspace
(#3653)
add f836a1e966 fix(ui): improve upload behavior to prevent progress
confusion (#3658)
add d03f3bffaf feat: inline dataset version creation and remove modal flow
(#3659)
add bab934ee77 feat: disallow dataset download (#3663)
add eeaaa96d76 chore: revert "feat: switch single-file dataset downloads
to use browser native downloads (#3621)" (#3669)
add 53bdcce600 feat: enforce S3 multipart-upload limits in configuration
(#3664)
add 6d73a946ae chore: add time_log table to deployment/texera_ddl.sql
(#3671)
add 77673b317b fix: private dataset can be set as downloadable (#3666)
add 594f9ef660 feat: enable file upload speed and time display (#3662)
add 9fff156192 chore: change master branch to main (#3676)
add c7fcd9f427 refactor(amber): move resource allocator into cost
estimator (#3550)
add 79761e8601 Merge remote-tracking branch 'refs/remotes/origin/main'
into xiaozhen-llm-chatbot
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 80 ++
.github/workflows/check-header.yml | 20 +-
.github/workflows/github-action-build.yml | 15 +-
.../gui-dev.sh => .github/workflows/lint-pr.yml | 24 +-
.licenserc.yaml | 26 +
.ratignore | 24 -
CONTRIBUTING.md | 128 ++
DISCLAIMER | 10 +
NOTICE | 4 +-
README.md | 4 +-
core/amber/DESCRIPTION | 2 +-
core/amber/build.sbt | 2 +-
core/amber/requirements.txt | 2 +-
.../engine/architecture/rpc/controlcommands.proto | 2 +-
.../engine/architecture/rpc/controlreturns.proto | 3 +-
.../engine/architecture/rpc/workerservice.proto | 1 +
.../engine/architecture/worker/statistics.proto | 1 +
.../uci/ics/amber/engine/common/ambermessage.proto | 4 +-
.../handlers/actorcommand/backpressure_handler.py | 8 +-
..._operation_handler.py => end_worker_handler.py} | 25 +-
.../handlers/control/start_worker_handler.py | 6 +-
.../core/architecture/rpc/async_rpc_client.py | 12 +-
.../rpc/async_rpc_handler_initializer.py | 2 +
.../core/architecture/rpc/async_rpc_server.py | 10 +-
.../src/main/python/core/models/internal_queue.py | 14 +-
.../src/main/python/core/runnables/main_loop.py | 60 +-
.../main/python/core/runnables/network_receiver.py | 10 +-
.../main/python/core/runnables/network_sender.py | 12 +-
.../python/core/runnables/test_console_message.py | 4 +-
.../main/python/core/runnables/test_main_loop.py | 174 ++-
.../python/core/runnables/test_network_receiver.py | 14 +-
.../input_port_materialization_reader_runnable.py | 4 +-
.../ics/amber/engine/architecture/rpc/__init__.py | 1438 ++++++++++----------
.../amber/engine/architecture/worker/__init__.py | 1 +
.../edu/uci/ics/amber/engine/common/__init__.py | 46 +-
.../pytexera/udf/examples/generator_operator.py | 3 +-
.../udf/examples/test_generator_operator.py | 5 +-
.../common/AkkaActorRefMappingService.scala | 4 +
.../architecture/common/AmberProcessor.scala | 9 +-
.../architecture/controller/Controller.scala | 13 +-
.../controller/ControllerProcessor.scala | 1 +
.../controller/WorkflowScheduler.scala | 24 +-
.../controller/execution/ExecutionUtils.scala | 9 +-
.../controller/execution/OperatorExecution.scala | 1 +
.../controller/promisehandlers/PauseHandler.scala | 4 +-
.../QueryWorkerStatisticsHandler.scala | 127 +-
.../controller/promisehandlers/ResumeHandler.scala | 2 +-
.../WorkerStateUpdatedHandler.scala | 2 +-
.../deploysemantics/layer/WorkerExecution.scala | 55 +-
.../messaginglayer/NetworkOutputGateway.scala | 4 +-
.../pythonworker/PythonProxyClient.scala | 5 +-
.../pythonworker/PythonProxyServer.scala | 2 +-
.../pythonworker/PythonWorkflowWorker.scala | 2 +-
.../pythonworker/WorkerBatchInternalQueue.scala | 11 +-
.../scheduling/CostBasedScheduleGenerator.scala | 61 +-
.../architecture/scheduling/CostEstimator.scala | 30 +-
.../ExpansionGreedyScheduleGenerator.scala | 74 +-
.../scheduling/RegionExecutionCoordinator.scala | 120 +-
.../scheduling/ScheduleGenerator.scala | 126 +-
.../architecture/scheduling/SchedulingUtils.scala | 57 +
.../scheduling/WorkflowExecutionCoordinator.scala | 11 +-
.../resourcePolicies/ResourceAllocator.scala | 10 +-
.../engine/architecture/worker/DPThread.scala | 8 +-
.../engine/architecture/worker/DataProcessor.scala | 4 +-
.../DataProcessorRPCHandlerInitializer.scala | 1 +
.../InputPortMaterializationReaderThread.scala | 1 -
...{StartChannelHandler.scala => EndHandler.scala} | 33 +-
.../InitializeExecutorHandler.scala | 5 +-
.../edu/uci/ics/amber/engine/common/Utils.scala | 14 +-
...oad.scala => DirectControlMessagePayload.scala} | 2 +-
.../amber/engine/common/client/ClientActor.scala | 4 +-
.../uci/ics/texera/web/ComputingUnitMaster.scala | 5 +-
.../edu/uci/ics/texera/web/SessionState.scala | 2 +-
.../uci/ics/texera/web/TexeraWebApplication.scala | 3 +
.../event/OperatorStatisticsUpdateEvent.scala | 2 +
.../web/resource/CollaborationResource.scala | 4 +-
.../ics/texera/web/resource/EmailTemplate.scala | 31 +-
.../web/resource/WorkflowWebsocketResource.scala | 2 +-
.../texera/web/resource/auth/AuthResource.scala | 9 +-
.../web/resource/auth/GoogleAuthResource.scala | 8 +-
.../admin/settings/AdminSettingsResource.scala | 51 +-
.../dashboard/admin/user/AdminUserResource.scala | 39 +
.../web/resource/dashboard/hub/ActionType.scala | 49 +
.../web/resource/dashboard/hub/EntityTables.scala | 32 +-
.../web/resource/dashboard/hub/EntityType.scala} | 76 +-
.../web/resource/dashboard/hub/HubResource.scala | 601 +++++---
.../user/workflow/WorkflowExecutionsResource.scala | 44 +-
.../dashboard/user/workflow/WorkflowResource.scala | 37 +-
.../user/workflow/WorkflowVersionResource.scala | 2 +-
.../web/service/ExecutionResultService.scala | 20 +-
.../texera/web/service/ExecutionStatsService.scala | 9 +
.../texera/web/service/ResultExportService.scala | 97 +-
.../control/utils/TrivialControlTester.scala | 8 +-
.../scheduling/DefaultCostEstimatorSpec.scala | 35 +-
.../ExpansionGreedyScheduleGeneratorSpec.scala | 2 +
.../architecture/worker/DataProcessorSpec.scala | 6 +-
.../workflow/WorkflowVersionResourceSpec.scala | 2 +-
.../ics/texera/workflow/WorkflowRewriterSpec.scala | 20 -
core/auth/build.sbt | 3 +-
.../scala/edu/uci/ics/texera/auth/JwtAuth.scala | 8 +-
.../edu/uci/ics/texera/auth/JwtAuthFilter.scala | 15 +-
core/build.sbt | 25 +-
core/computing-unit-managing-service/build.sbt | 7 +-
.../service/ComputingUnitManagingService.scala | 7 +-
.../resource/ComputingUnitAccessResource.scala | 215 +++
.../resource/ComputingUnitManagingResource.scala | 247 +++-
.../texera/service/util/ComputingUnitHelpers.scala | 61 +
.../ComputingUnitManagingServiceException.scala | 70 +
.../ics/texera/service/util/KubernetesClient.scala | 7 +-
core/config-service/build.sbt | 3 +-
.../edu/uci/ics/texera/service/ConfigService.scala | 45 +-
.../texera/service/resource/ConfigResource.scala | 9 +-
core/config/build.sbt | 3 +-
core/config/src/main/resources/application.conf | 4 +-
core/config/src/main/resources/auth.conf | 3 -
core/config/src/main/resources/computing-unit.conf | 6 +
core/config/src/main/resources/default.conf | 64 +
core/config/src/main/resources/gui.conf | 29 -
.../uci/ics/amber/config/ApplicationConfig.scala | 3 +-
.../ics/amber/config/EnvironmentalVariable.scala | 1 +
.../edu/uci/ics/texera/config/AuthConfig.scala | 3 -
.../ics/texera/config/ComputingUnitConfig.scala | 1 +
.../edu/uci/ics/texera/config/DefaultsConfig.scala | 45 +
.../edu/uci/ics/texera/config/GuiConfig.scala | 14 -
core/dao/build.sbt | 2 +-
.../uci/ics/texera/dao/ASFGeneratorStrategy.scala | 19 +
.../edu/uci/ics/texera/dao/JooqCodeGenerator.scala | 2 +-
.../uci/ics/texera/dao/jooq/generated/Keys.java | 12 +
.../uci/ics/texera/dao/jooq/generated/Tables.java | 18 +
.../ics/texera/dao/jooq/generated/TexeraDb.java | 21 +
.../generated/tables/ComputingUnitUserAccess.java | 193 +++
.../texera/dao/jooq/generated/tables/Dataset.java | 13 +-
.../dao/jooq/generated/tables/SiteSettings.java | 163 +++
.../tables/{UserConfig.java => TimeLog.java} | 86 +-
.../jooq/generated/tables/WorkflowExecutions.java | 12 +-
.../tables/daos/ComputingUnitUserAccessDao.java | 104 ++
.../dao/jooq/generated/tables/daos/DatasetDao.java | 15 +
.../generated/tables/daos/SiteSettingsDao.java | 133 ++
.../dao/jooq/generated/tables/daos/TimeLogDao.java | 103 ++
.../tables/daos/WorkflowExecutionsDao.java | 30 +-
...erAccess.java => IComputingUnitUserAccess.java} | 30 +-
.../jooq/generated/tables/interfaces/IDataset.java | 10 +
.../{IUserConfig.java => ISiteSettings.java} | 45 +-
.../{IPublicProject.java => ITimeLog.java} | 27 +-
.../tables/interfaces/IWorkflowExecutions.java | 20 +-
...serAccess.java => ComputingUnitUserAccess.java} | 48 +-
.../dao/jooq/generated/tables/pojos/Dataset.java | 24 +-
.../pojos/{UserConfig.java => SiteSettings.java} | 98 +-
.../pojos/{DatasetUserLikes.java => TimeLog.java} | 50 +-
.../generated/tables/pojos/WorkflowExecutions.java | 44 +-
...ord.java => ComputingUnitUserAccessRecord.java} | 80 +-
.../generated/tables/records/DatasetRecord.java | 61 +-
...erConfigRecord.java => SiteSettingsRecord.java} | 159 ++-
...PublicProjectRecord.java => TimeLogRecord.java} | 86 +-
.../tables/records/WorkflowExecutionsRecord.java | 198 +--
core/file-service/build.sbt | 3 +-
.../texera/service/resource/DatasetResource.scala | 215 ++-
core/gui/package.json | 4 +-
core/gui/proxy.config.json | 5 +
core/gui/src/app/app-routing.constant.ts | 2 +-
core/gui/src/app/app-routing.module.ts | 8 +-
core/gui/src/app/app.module.ts | 4 +
core/gui/src/app/common/formly/formly-config.ts | 2 +
core/gui/src/app/common/formly/formly-utils.ts | 8 +-
.../formly/repeat-dnd/repeat-dnd.component.css} | 46 +-
.../formly/repeat-dnd/repeat-dnd.component.html | 63 +
.../formly/repeat-dnd/repeat-dnd.component.ts | 51 +
.../app/common/service/gui-config.service.mock.ts | 7 +-
.../src/app/common/service/user/auth.service.ts | 17 +-
.../workflow-persist/workflow-persist.service.ts | 32 +-
core/gui/src/app/common/type/dataset.ts | 1 +
core/gui/src/app/common/type/gui-config.ts | 21 +-
core/gui/src/app/common/type/user.ts | 1 +
core/gui/src/app/common/util/format.util.ts | 56 +
.../common/util/logical-operator-port-serde.ts} | 34 +-
.../src/app/common/util/port-identity-serde.ts} | 14 +-
.../src/app/common/util/workflow-check.ts} | 19 +-
.../app/common/util/workflow-compilation-utils.ts | 76 ++
.../admin/execution/admin-execution.component.html | 2 +-
.../admin/settings/admin-settings.component.html | 198 ++-
.../admin/settings/admin-settings.component.scss | 45 +-
.../admin/settings/admin-settings.component.ts | 134 +-
.../component/admin/user/admin-user.component.html | 8 +-
.../component/admin/user/admin-user.component.scss | 12 +
.../component/admin/user/admin-user.component.ts | 11 +
.../component/button-style.scss} | 41 +-
.../dashboard/component/dashboard.component.html | 118 +-
.../app/dashboard/component/dashboard.component.ts | 52 +-
.../files-uploader/files-uploader.component.ts | 20 +-
.../user/filters/filters.component.spec.ts | 3 +-
.../user/list-item/list-item.component.html | 4 +-
.../user/list-item/list-item.component.ts | 111 +-
.../component/user/search/search.component.ts | 89 +-
.../user/share-access/share-access.component.html | 6 +-
.../user/share-access/share-access.component.ts | 16 +-
.../dataset-detail.component.html | 85 +-
.../dataset-detail.component.scss | 73 +-
.../dataset-detail.component.ts | 192 ++-
...user-dataset-staged-objects-list.component.html | 8 +-
.../user-dataset-staged-objects-list.component.ts | 10 +
.../user-dataset-version-creator.component.html | 24 +-
.../user-dataset-version-creator.component.scss | 24 +
.../user-dataset-version-creator.component.ts | 7 +
.../user/user-dataset/user-dataset.component.html | 28 +-
.../user/user-dataset/user-dataset.component.scss | 1 +
.../user/user-dataset/user-dataset.component.ts | 81 +-
.../user-workflow/user-workflow.component.html | 25 +-
.../user-workflow/user-workflow.component.scss | 6 +-
.../user/user-workflow/user-workflow.component.ts | 57 +-
.../admin/settings/admin-settings.service.ts | 26 +-
.../service/admin/user/admin-user.service.ts | 2 +-
.../service/user/dataset/dataset.service.ts | 190 ++-
.../service/user/download/download.service.spec.ts | 8 +-
.../service/user/download/download.service.ts | 4 +-
.../app/dashboard/service/user/search.service.ts | 186 ++-
.../dashboard/service/user/stub-search.service.ts | 49 +-
core/gui/src/app/dashboard/type/dashboard-entry.ts | 56 +-
core/gui/src/app/dashboard/type/search-result.ts | 7 +
.../browse-section/browse-section.component.ts | 33 +-
.../hub-search-result.component.ts | 66 +-
core/gui/src/app/hub/component/hub.component.html | 6 +-
core/gui/src/app/hub/component/hub.component.ts | 2 +
.../landing-page/landing-page.component.ts | 79 +-
.../detail/hub-workflow-detail.component.html | 15 +-
.../detail/hub-workflow-detail.component.ts | 40 +-
core/gui/src/app/hub/service/hub.service.ts | 142 +-
.../code-debugger.component.spec.ts | 36 +-
.../operator-menu/operator-menu.component.ts | 10 +-
.../workspace/component/menu/menu.component.html | 32 +-
.../app/workspace/component/menu/menu.component.ts | 1 +
.../computing-unit-selection.component.html | 49 +-
.../computing-unit-selection.component.scss | 16 +
.../computing-unit-selection.component.ts | 148 +-
.../operator-property-edit-frame.component.ts | 16 +-
.../type-casting-display.component.ts | 4 +-
.../result-exportation.component.html | 3 +
.../result-exportation.component.ts | 3 +-
.../result-panel/result-panel.component.ts | 4 +-
.../result-table-frame.component.scss | 15 +-
.../result-table-frame.component.ts | 45 +-
.../context-menu/context-menu.component.html | 46 +-
.../context-menu/context-menu.component.spec.ts | 14 +-
.../context-menu/context-menu.component.ts | 39 +-
.../workflow-editor.component.spec.ts | 100 +-
.../workflow-editor/workflow-editor.component.ts | 83 +-
.../app/workspace/component/workspace.component.ts | 15 +-
.../compile-workflow/workflow-compiling.service.ts | 148 +-
.../computing-unit-status.service.ts | 44 +-
.../service/drag-drop/drag-drop.service.ts | 268 +++-
.../execute-workflow/execute-workflow.service.ts | 5 +-
.../workspace/service/joint-ui/joint-ui.service.ts | 136 +-
.../operator-debug/udf-debug.service.spec.ts | 2 +
.../validation/validation-workflow.service.ts | 27 +
.../workflow-computing-unit-managing.service.ts | 15 +-
.../model/workflow-action.service.ts | 1 +
.../workflow-result/workflow-result.service.ts | 4 +-
.../workflow-status/workflow-status.service.ts | 2 +
.../workspace/types/execute-workflow.interface.ts | 5 +-
.../types/workflow-compiling.interface.ts | 17 +-
.../app/workspace/types/workflow-computing-unit.ts | 2 +
core/gui/src/assets/operator_images/GaugeChart.png | Bin 0 -> 3622 bytes
.../gui/src/assets/operator_images/Histogram2D.png | Bin 0 -> 19725 bytes
core/gui/src/assets/operator_images/Sleep.png | Bin 0 -> 59428 bytes
.../src/assets/operator_images/TimeSeriesPlot.png | Bin 0 -> 2838 bytes
core/gui/src/assets/operator_images/TreePlot.png | Bin 0 -> 11918 bytes
core/gui/yarn.lock | 22 +-
core/scripts/build-services.sh | 20 +-
core/scripts/computing-unit-managing-service.sh | 2 +-
core/scripts/config-service.sh | 2 +-
core/scripts/file-service.sh | 2 +-
core/scripts/server.sh | 2 +-
core/scripts/sql/texera_ddl.sql | 23 +
core/scripts/sql/updates/{05.sql => 09.sql} | 21 +-
.../sql/{texera_lakefs.sql => updates/10.sql} | 15 +-
core/scripts/sql/updates/{05.sql => 11.sql} | 19 +-
core/scripts/workflow-compiling-service.sh | 2 +-
core/scripts/workflow-computing-unit.sh | 4 +-
core/workflow-compiling-service/build.sbt | 3 +-
.../uci/ics/amber/compiler/WorkflowCompiler.scala | 47 +-
.../texera/service/WorkflowCompilingService.scala | 3 +
.../resource/WorkflowCompilationResource.scala | 29 +-
.../resource/WorkflowCompilationResourceSpec.scala | 7 +-
core/workflow-core/build.sbt | 3 +-
.../storage/result/iceberg/IcebergDocument.scala | 78 +-
.../edu/uci/ics/amber/core/tuple/Attribute.java | 7 +-
.../uci/ics/amber/core/workflow/PhysicalPlan.scala | 47 +
.../util/serde/PortIdentityKeySerializer.scala | 9 +-
core/workflow-operator/build.sbt | 3 +-
.../edu/uci/ics/amber/operator/LogicalOp.scala | 96 ++
.../operator/metadata/OperatorGroupConstants.scala | 3 +-
.../metadata/OperatorMetadataGenerator.scala | 1 -
.../SklearnTrainingAdaptiveBoostingOpDesc.scala} | 6 +-
.../SklearnTrainingBaggingOpDesc.scala} | 6 +-
...SklearnTrainingBernoulliNaiveBayesOpDesc.scala} | 6 +-
...klearnTrainingComplementNaiveBayesOpDesc.scala} | 6 +-
.../SklearnTrainingDecisionTreeOpDesc.scala} | 6 +-
.../SklearnTrainingDummyClassifierOpDesc.scala} | 6 +-
.../SklearnTrainingExtraTreeOpDesc.scala} | 6 +-
.../SklearnTrainingExtraTreesOpDesc.scala} | 6 +-
.../SklearnTrainingGaussianNaiveBayesOpDesc.scala} | 6 +-
.../SklearnTrainingGradientBoostingOpDesc.scala} | 6 +-
.../SklearnTrainingKNNOpDesc.scala} | 6 +-
.../SklearnTrainingLinearSVMOpDesc.scala} | 6 +-
...klearnTrainingLogisticRegressionCVOpDesc.scala} | 6 +-
.../SklearnTrainingLogisticRegressionOpDesc.scala} | 6 +-
...klearnTrainingMultiLayerPerceptronOpDesc.scala} | 6 +-
...learnTrainingMultinomialNaiveBayesOpDesc.scala} | 6 +-
.../SklearnTrainingNearestCentroidOpDesc.scala} | 6 +-
.../SklearnTrainingOpDesc.scala} | 43 +-
.../SklearnTrainingPassiveAggressiveOpDesc.scala} | 6 +-
.../SklearnTrainingPerceptronOpDesc.scala} | 6 +-
...earnTrainingProbabilityCalibrationOpDesc.scala} | 6 +-
.../SklearnTrainingRandomForestOpDesc.scala} | 6 +-
.../SklearnTrainingRidgeCVOpDesc.scala} | 6 +-
.../SklearnTrainingRidgeOpDesc.scala} | 6 +-
.../SklearnTrainingSDGOpDesc.scala} | 6 +-
.../SklearnTrainingSVMOpDesc.scala} | 6 +-
.../SleepOpDesc.scala} | 29 +-
.../UnionOpExec.scala => sleep/SleepOpExec.scala} | 8 +-
.../operator/timeSeriesPlot/TimeSeriesPlot.scala | 139 ++
.../amber/operator/udf/java/JavaUDFOpDesc.scala | 6 +-
.../python/DualInputPortsPythonUDFOpDescV2.scala | 2 +-
.../operator/udf/python/PythonUDFOpDescV2.scala | 2 +-
.../gaugeChart/GaugeChartOpDesc.scala | 189 +++
.../gaugeChart/GaugeChartSteps.scala} | 16 +-
.../histogram2d/Histogram2DOpDesc.scala | 121 ++
.../histogram2d/NormalizationType.java} | 22 +-
.../scatterplot/ScatterplotOpDesc.scala | 8 +-
.../visualization/treeplot/TreeplotOpDesc.scala | 189 +++
.../uci/ics/amber/util/ObjectMapperUtils.scala} | 33 +-
deployment/computing-unit-master.dockerfile | 6 +-
deployment/computing-unit-worker.dockerfile | 4 +-
deployment/config-service.dockerfile | 4 +-
deployment/file-service.dockerfile | 4 +-
deployment/k8s/texera-helmchart/Chart.yaml | 2 +-
.../k8s/texera-helmchart/files/texera_ddl.sql | 32 +
.../templates/config-service-deployment.yaml | 3 -
.../templates/file-service-deployment.yaml | 2 +-
.../k8s/texera-helmchart/templates/ingress.yaml | 2 +-
...=> workflow-computing-unit-resource-quota.yaml} | 19 +-
deployment/k8s/texera-helmchart/values.yaml | 13 +
deployment/texera-web-application.dockerfile | 4 +-
deployment/workflow-compiling-service.dockerfile | 4 +-
...flow-computing-unit-managing-service.dockerfile | 4 +-
344 files changed, 9263 insertions(+), 3749 deletions(-)
create mode 100644 .asf.yaml
copy core/scripts/gui-dev.sh => .github/workflows/lint-pr.yml (68%)
create mode 100644 .licenserc.yaml
delete mode 100644 .ratignore
create mode 100644 CONTRIBUTING.md
create mode 100644 DISCLAIMER
copy
core/amber/src/main/python/core/architecture/handlers/control/{no_operation_handler.py
=> end_worker_handler.py} (50%)
create mode 100644
core/amber/src/main/scala/edu/uci/ics/amber/engine/architecture/scheduling/SchedulingUtils.scala
copy
core/amber/src/main/scala/edu/uci/ics/amber/engine/architecture/worker/promisehandlers/{StartChannelHandler.scala
=> EndHandler.scala} (62%)
rename
core/amber/src/main/scala/edu/uci/ics/amber/engine/common/ambermessage/{ControlPayload.scala
=> DirectControlMessagePayload.scala} (92%)
create mode 100644
core/amber/src/main/scala/edu/uci/ics/texera/web/resource/dashboard/hub/ActionType.scala
copy
core/{gui/src/app/dashboard/component/admin/user/admin-user.component.scss =>
amber/src/main/scala/edu/uci/ics/texera/web/resource/dashboard/hub/EntityType.scala}
(52%)
delete mode 100644
core/amber/src/test/scala/edu/uci/ics/texera/workflow/WorkflowRewriterSpec.scala
create mode 100644
core/computing-unit-managing-service/src/main/scala/edu/uci/ics/texera/service/resource/ComputingUnitAccessResource.scala
create mode 100644
core/computing-unit-managing-service/src/main/scala/edu/uci/ics/texera/service/util/ComputingUnitHelpers.scala
create mode 100644
core/computing-unit-managing-service/src/main/scala/edu/uci/ics/texera/service/util/ComputingUnitManagingServiceException.scala
create mode 100644 core/config/src/main/resources/default.conf
create mode 100644
core/config/src/main/scala/edu/uci/ics/texera/config/DefaultsConfig.scala
create mode 100644
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/ComputingUnitUserAccess.java
create mode 100644
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/SiteSettings.java
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/{UserConfig.java
=> TimeLog.java} (50%)
create mode 100644
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/daos/ComputingUnitUserAccessDao.java
create mode 100644
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/daos/SiteSettingsDao.java
create mode 100644
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/daos/TimeLogDao.java
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/interfaces/{IWorkflowUserAccess.java
=> IComputingUnitUserAccess.java} (69%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/interfaces/{IUserConfig.java
=> ISiteSettings.java} (63%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/interfaces/{IPublicProject.java
=> ITimeLog.java} (73%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/pojos/{DatasetUserAccess.java
=> ComputingUnitUserAccess.java} (67%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/pojos/{UserConfig.java
=> SiteSettings.java} (54%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/pojos/{DatasetUserLikes.java
=> TimeLog.java} (65%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/records/{WorkflowUserAccessRecord.java
=> ComputingUnitUserAccessRecord.java} (65%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/records/{UserConfigRecord.java
=> SiteSettingsRecord.java} (51%)
copy
core/dao/src/main/scala/edu/uci/ics/texera/dao/jooq/generated/tables/records/{PublicProjectRecord.java
=> TimeLogRecord.java} (64%)
copy
core/gui/src/app/{dashboard/component/user/search-bar/search-bar.component.scss
=> common/formly/repeat-dnd/repeat-dnd.component.css} (61%)
create mode 100644
core/gui/src/app/common/formly/repeat-dnd/repeat-dnd.component.html
create mode 100644
core/gui/src/app/common/formly/repeat-dnd/repeat-dnd.component.ts
create mode 100644 core/gui/src/app/common/util/format.util.ts
copy core/{config/src/main/scala/edu/uci/ics/amber/util/ConfigParserUtil.scala
=> gui/src/app/common/util/logical-operator-port-serde.ts} (58%)
copy
core/{amber/src/main/scala/edu/uci/ics/amber/engine/common/AmberConfig.scala =>
gui/src/app/common/util/port-identity-serde.ts} (57%)
copy
core/{amber/src/main/scala/edu/uci/ics/amber/engine/common/AmberConfig.scala =>
gui/src/app/common/util/workflow-check.ts} (53%)
create mode 100644 core/gui/src/app/common/util/workflow-compilation-utils.ts
copy
core/gui/src/app/{workspace/component/input-autocomplete/input-autocomplete.component.scss
=> dashboard/component/button-style.scss} (64%)
create mode 100644 core/gui/src/assets/operator_images/GaugeChart.png
create mode 100644 core/gui/src/assets/operator_images/Histogram2D.png
create mode 100644 core/gui/src/assets/operator_images/Sleep.png
create mode 100644 core/gui/src/assets/operator_images/TimeSeriesPlot.png
create mode 100644 core/gui/src/assets/operator_images/TreePlot.png
copy core/scripts/sql/updates/{05.sql => 09.sql} (71%)
copy core/scripts/sql/{texera_lakefs.sql => updates/10.sql} (79%)
copy core/scripts/sql/updates/{05.sql => 11.sql} (73%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnAdaptiveBoostingOpDesc.scala
=> training/SklearnTrainingAdaptiveBoostingOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnBaggingOpDesc.scala
=> training/SklearnTrainingBaggingOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnBernoulliNaiveBayesOpDesc.scala
=> training/SklearnTrainingBernoulliNaiveBayesOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnComplementNaiveBayesOpDesc.scala
=> training/SklearnTrainingComplementNaiveBayesOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnDecisionTreeOpDesc.scala
=> training/SklearnTrainingDecisionTreeOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnDummyClassifierOpDesc.scala
=> training/SklearnTrainingDummyClassifierOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnExtraTreeOpDesc.scala
=> training/SklearnTrainingExtraTreeOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnExtraTreesOpDesc.scala
=> training/SklearnTrainingExtraTreesOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnGaussianNaiveBayesOpDesc.scala
=> training/SklearnTrainingGaussianNaiveBayesOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnGradientBoostingOpDesc.scala
=> training/SklearnTrainingGradientBoostingOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnKNNOpDesc.scala
=> training/SklearnTrainingKNNOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnLinearSVMOpDesc.scala
=> training/SklearnTrainingLinearSVMOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnLogisticRegressionCVOpDesc.scala
=> training/SklearnTrainingLogisticRegressionCVOpDesc.scala} (80%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnLogisticRegressionOpDesc.scala
=> training/SklearnTrainingLogisticRegressionOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnMultiLayerPerceptronOpDesc.scala
=> training/SklearnTrainingMultiLayerPerceptronOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnMultinomialNaiveBayesOpDesc.scala
=> training/SklearnTrainingMultinomialNaiveBayesOpDesc.scala} (80%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnNearestCentroidOpDesc.scala
=> training/SklearnTrainingNearestCentroidOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnClassifierOpDesc.scala
=> training/SklearnTrainingOpDesc.scala} (73%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnPassiveAggressiveOpDesc.scala
=> training/SklearnTrainingPassiveAggressiveOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnPerceptronOpDesc.scala
=> training/SklearnTrainingPerceptronOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnProbabilityCalibrationOpDesc.scala
=> training/SklearnTrainingProbabilityCalibrationOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnRandomForestOpDesc.scala
=> training/SklearnTrainingRandomForestOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnRidgeCVOpDesc.scala
=> training/SklearnTrainingRidgeCVOpDesc.scala} (81%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnRidgeOpDesc.scala
=> training/SklearnTrainingRidgeOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnSDGOpDesc.scala
=> training/SklearnTrainingSDGOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/sklearn/{SklearnSVMOpDesc.scala
=> training/SklearnTrainingSVMOpDesc.scala} (82%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/{randomksampling/RandomKSamplingOpDesc.scala
=> sleep/SleepOpDesc.scala} (69%)
copy
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/{union/UnionOpExec.scala
=> sleep/SleepOpExec.scala} (77%)
create mode 100644
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/timeSeriesPlot/TimeSeriesPlot.scala
create mode 100644
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/visualization/gaugeChart/GaugeChartOpDesc.scala
copy
core/{config/src/main/scala/edu/uci/ics/texera/config/ComputingUnitConfig.scala
=>
workflow-operator/src/main/scala/edu/uci/ics/amber/operator/visualization/gaugeChart/GaugeChartSteps.scala}
(69%)
create mode 100644
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/visualization/histogram2d/Histogram2DOpDesc.scala
copy
core/{config/src/main/scala/edu/uci/ics/texera/config/ComputingUnitConfig.scala
=>
workflow-operator/src/main/scala/edu/uci/ics/amber/operator/visualization/histogram2d/NormalizationType.java}
(66%)
create mode 100644
core/workflow-operator/src/main/scala/edu/uci/ics/amber/operator/visualization/treeplot/TreeplotOpDesc.scala
copy core/{config/src/main/scala/edu/uci/ics/amber/util/ConfigParserUtil.scala
=>
workflow-operator/src/main/scala/edu/uci/ics/amber/util/ObjectMapperUtils.scala}
(58%)
copy
deployment/k8s/texera-helmchart/templates/{workflow-computing-units-service.yaml
=> workflow-computing-unit-resource-quota.yaml} (59%)
