This is an automated email from the ASF dual-hosted git repository.
skrawcz pushed a change to branch stefan/fix-unit-tests
in repository https://gitbox.apache.org/repos/asf/hamilton.git
omit 9163f73b Updates other unit tests
omit 4808cde3 Updates polars tests
omit 73afeec6 Updates pydantic model use to use model_dump
omit 989aaa76 Fixes hugging face test
omit 7db7a479 Updates UTC use
omit d77c3814 Update AST check due to deprecation
omit 8102ee87 Fix hamilton-lsp
add 10d1e529 Bump urllib3 from 2.5.0 to 2.6.0 in /ui/backend/server
add 61f5bb74 Bump django from 4.2.24 to 4.2.27 in /ui/backend/server
add 82ef0c9a Bump node-forge from 1.3.1 to 1.3.2 in /ui/frontend
add 39f1235b Bump js-yaml from 3.14.1 to 3.14.2 in /ui/frontend
add 77b7d97f Removes reference to contrib -- that will go in contrib
LICENSE file
add dd457ea8 Adds license header to template files
add 9fd1bda2 Fixes #1421 and adds disclaimer
add b0f71a54 Adds more licenses and utilities for license checking (#1425)
add 83761b48 Fix hamilton-lsp
add 6bd85f08 Update AST check due to deprecation
add 0ef947e2 Updates UTC use
add 53e18cc6 Fixes hugging face test
add 243f3f59 Updates pydantic model use to use model_dump
add 31119f4c Updates polars tests
add 090d69bd Updates other unit tests
add 7f22b017 Adds more headers and updates license check files
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9163f73b)
\
N -- N -- N refs/heads/stefan/fix-unit-tests (7f22b017)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/hamilton-lsp.yml | 3 +
.github/workflows/hamilton-main.yml | 5 +
.github/workflows/hamilton-sdk.yml | 3 +
.github/workflows/hamilton-ui-backend.yml | 3 +
.github/workflows/hamilton-ui-frontend.yml | 3 +
LICENSE | 27 --
README.md | 27 ++
contrib/README.md | 27 ++
contrib/docs/DEV_SETUP.md | 19 ++
contrib/docs/README.md | 19 ++
contrib/docs/blog/2023-11-13-welcome/index.md | 19 ++
contrib/docs/docs/README.md | 19 ++
contrib/docs/src/components/example_code.tsx | 19 ++
contrib/docs/src/pages/leaderboard.md | 19 ++
contrib/docs/src/pages/markdown-page.md | 19 ++
contrib/hamilton/contrib/dagworks/author.md | 19 ++
.../contrib/dagworks/conversational_rag/README.md | 19 ++
.../hamilton/contrib/dagworks/faiss_rag/README.md | 19 ++
.../contrib/dagworks/simple_eval_grader/README.md | 19 ++
.../contrib/dagworks/sphinx_doc_chunking/README.md | 19 ++
.../dagworks/sphinx_doc_chunking/test.ipynb | 7 +
.../contrib/dagworks/text_summarization/README.md | 19 ++
.../contrib/dagworks/text_summarization/test.ipynb | 7 +
.../dagworks/translate_to_hamilton/README.md | 19 ++
.../dagworks/translate_to_hamilton/test.ipynb | 7 +
.../hamilton/contrib/user/elijahbenizzy/author.md | 19 ++
.../user/elijahbenizzy/caption_images/README.md | 19 ++
.../user/elijahbenizzy/convert_images_s3/README.md | 19 ++
.../user/elijahbenizzy/generate_images/README.md | 19 ++
.../generate_images/generate_images.ipynb | 7 +
.../parallel_load_dataframes_s3/README.md | 19 ++
.../user/example_dataflow_template/author.md | 19 ++
.../dataflow_template/README.md | 19 ++
.../user/skrawcz/air_quality_analysis/README.md | 19 ++
contrib/hamilton/contrib/user/skrawcz/author.md | 19 ++
.../user/skrawcz/customize_embeddings/README.md | 19 ++
.../skrawcz/customize_embeddings/notebook.ipynb | 7 +
.../contrib/user/skrawcz/fine_tuning/Dockerfile | 17 ++
.../contrib/user/skrawcz/fine_tuning/README.md | 19 ++
.../contrib/user/skrawcz/hello_world/README.md | 19 ++
contrib/hamilton/contrib/user/zilto/author.md | 19 ++
.../contrib/user/zilto/lancedb_vdb/README.md | 19 ++
.../contrib/user/zilto/lancedb_vdb/run.ipynb | 7 +
.../contrib/user/zilto/llm_generate_code/README.md | 19 ++
.../contrib/user/zilto/nixtla_mlforecast/README.md | 19 ++
.../contrib/user/zilto/nixtla_mlforecast/run.ipynb | 7 +
.../user/zilto/nixtla_statsforecast/README.md | 19 ++
.../user/zilto/nixtla_statsforecast/run.ipynb | 7 +
.../user/zilto/text_summarization/README.md | 19 ++
.../contrib/user/zilto/webscraper/README.md | 19 ++
.../contrib/user/zilto/webscraper/run.ipynb | 7 +
.../contrib/user/zilto/xgboost_optuna/README.md | 19 ++
.../contrib/user/zilto/xgboost_optuna/run.ipynb | 7 +
dev_tools/language_server/README.md | 27 ++
dev_tools/vscode_extension/DEVELOPER_SETUP.md | 19 ++
dev_tools/vscode_extension/README.md | 37 ++-
.../walkthrough/1_extensionDependencies.md | 19 ++
.../resources/walkthrough/2_pythonInterpreter.md | 19 ++
.../resources/walkthrough/3_pythonDependencies.md | 19 ++
.../resources/walkthrough/4_reloadVscode.md | 19 ++
.../resources/walkthrough/4_visitLSP.md | 19 ++
.../walkthrough/5_visitDataflowWebview.md | 19 ++
.../resources/walkthrough/6_tips.md | 19 ++
docs/README.md | 19 ++
docs/community/index.md | 19 ++
docs/conf.py | 17 ++
docs/data_adapters_extension.py | 17 ++
docs/get-started/install.md | 19 ++
docs/get-started/learning-resources.md | 19 ++
docs/get-started/why-hamilton.md | 19 ++
docs/how-tos/caching-tutorial.ipynb | 7 +
docs/how-tos/cli-reference.md | 19 ++
docs/how-tos/llm-workflows.md | 19 ++
docs/how-tos/pre-commit-hooks.md | 19 ++
docs/how-tos/use-hamilton-for-lineage.md | 19 ++
docs/how-tos/use-in-jupyter-notebook.md | 19 ++
docs/index.md | 19 ++
docs/integrations/dlt/index.md | 19 ++
docs/integrations/fastapi.md | 19 ++
docs/integrations/ibis/index.md | 19 ++
docs/integrations/streamlit.md | 19 ++
docs/main.md | 19 ++
docs/make_testimonials.py | 17 ++
docs/reference/disabling-telemetry.md | 19 ++
examples/Dockerfile | 17 ++
examples/LLM_Workflows/GraphRAG/README.md | 19 ++
examples/LLM_Workflows/GraphRAG/application.py | 17 ++
examples/LLM_Workflows/GraphRAG/graph_schema.py | 17 ++
examples/LLM_Workflows/GraphRAG/hamilton_ingest.py | 17 ++
examples/LLM_Workflows/GraphRAG/ingest_fighters.py | 17 ++
examples/LLM_Workflows/GraphRAG/ingest_fights.py | 17 ++
.../LLM_Workflows/GraphRAG/ingest_notebook.ipynb | 7 +
examples/LLM_Workflows/GraphRAG/notebook.ipynb | 7 +
examples/LLM_Workflows/GraphRAG/utils.py | 17 ++
examples/LLM_Workflows/NER_Example/README.md | 19 ++
.../LLM_Workflows/NER_Example/lancedb_module.py | 17 ++
.../LLM_Workflows/NER_Example/ner_extraction.py | 17 ++
examples/LLM_Workflows/NER_Example/notebook.ipynb | 7 +
examples/LLM_Workflows/NER_Example/run.py | 17 ++
.../RAG_document_extract_chunk_embed/README.md | 19 ++
.../RAG_document_extract_chunk_embed/pipeline.py | 17 ++
.../simple_pipeline.ipynb | 7 +
examples/LLM_Workflows/README.md | 19 ++
examples/LLM_Workflows/image_telephone/README.md | 19 ++
examples/LLM_Workflows/image_telephone/adapters.py | 17 ++
.../LLM_Workflows/image_telephone/application.py | 17 ++
.../LLM_Workflows/image_telephone/notebook.ipynb | 7 +
.../LLM_Workflows/image_telephone/streamlit.py | 17 ++
.../LLM_Workflows/knowledge_retrieval/README.md | 19 ++
.../knowledge_retrieval/arxiv_articles.py | 17 ++
.../LLM_Workflows/knowledge_retrieval/functions.py | 17 ++
.../LLM_Workflows/knowledge_retrieval/state.py | 17 ++
.../knowledge_retrieval/summarize_text.py | 17 ++
.../LLM_Workflows/langchain_comparison/README.md | 19 ++
.../langchain_comparison/hamilton_anthropic.py | 17 ++
.../langchain_comparison/hamilton_async.py | 17 ++
.../langchain_comparison/hamilton_batch.py | 17 ++
.../langchain_comparison/hamilton_completion.py | 17 ++
.../langchain_comparison/hamilton_fallbacks.py | 17 ++
.../langchain_comparison/hamilton_invoke.py | 17 ++
.../langchain_comparison/hamilton_logging.py | 17 ++
.../langchain_comparison/hamilton_streamed.py | 17 ++
.../langchain_comparison/lcel_anthropic.py | 17 ++
.../langchain_comparison/lcel_async.py | 17 ++
.../langchain_comparison/lcel_batch.py | 17 ++
.../langchain_comparison/lcel_completion.py | 17 ++
.../langchain_comparison/lcel_fallbacks.py | 17 ++
.../langchain_comparison/lcel_invoke.py | 17 ++
.../langchain_comparison/lcel_logging.py | 17 ++
.../langchain_comparison/lcel_streamed.py | 17 ++
.../langchain_comparison/vanilla_anthropic.py | 17 ++
.../langchain_comparison/vanilla_async.py | 17 ++
.../langchain_comparison/vanilla_batch.py | 17 ++
.../langchain_comparison/vanilla_completion.py | 17 ++
.../langchain_comparison/vanilla_fallbacks.py | 17 ++
.../langchain_comparison/vanilla_invoke.py | 17 ++
.../langchain_comparison/vanilla_logging.py | 17 ++
.../langchain_comparison/vanilla_streamed.py | 17 ++
.../LLM_Workflows/llm_logging/summarization.py | 17 ++
examples/LLM_Workflows/modular_llm_stack/README.md | 19 ++
.../LLM_Workflows/modular_llm_stack/data_module.py | 17 ++
.../modular_llm_stack/embedding_module.py | 17 ++
.../modular_llm_stack/lancedb_module.py | 17 ++
.../modular_llm_stack/marqo_module.py | 17 ++
.../modular_llm_stack/pinecone_module.py | 17 ++
.../modular_llm_stack/qdrant_module.py | 17 ++
examples/LLM_Workflows/modular_llm_stack/run.py | 17 ++
.../modular_llm_stack/weaviate_module.py | 17 ++
.../observability_openllmetry/README.md | 19 ++
.../observability_openllmetry/notebook.ipynb | 7 +
.../LLM_Workflows/observability_openllmetry/run.py | 17 ++
examples/LLM_Workflows/pdf_summarizer/README.md | 19 ++
.../pdf_summarizer/backend/Dockerfile | 17 ++
.../backend/parallel_summarization.py | 17 ++
.../LLM_Workflows/pdf_summarizer/backend/server.py | 17 ++
.../pdf_summarizer/backend/summarization.py | 17 ++
.../pdf_summarizer/frontend/Dockerfile | 17 ++
.../LLM_Workflows/pdf_summarizer/frontend/app.py | 17 ++
.../pdf_summarizer/run_on_spark/README.md | 19 ++
.../pdf_summarizer/run_on_spark/run.ipynb | 7 +
.../pdf_summarizer/run_on_spark/run.py | 17 ++
.../run_on_spark/run_with_columns.py | 17 ++
.../run_on_spark/spark_pdf_pipeline.py | 17 ++
.../pdf_summarizer/run_on_spark/summarization.py | 17 ++
.../retrieval_augmented_generation/README.md | 19 ++
.../backend/Dockerfile | 17 ++
.../backend/ingestion.py | 17 ++
.../backend/retrieval.py | 17 ++
.../backend/server.py | 17 ++
.../backend/vector_db.py | 17 ++
.../retrieval_augmented_generation/build_app.sh | 17 ++
.../frontend/Dockerfile | 17 ++
.../frontend/Information.py | 17 ++
.../frontend/client.py | 17 ++
.../frontend/pages/1_Ingestion.py | 17 ++
.../frontend/pages/2_Retrieval.py | 17 ++
.../LLM_Workflows/scraping_and_chunking/README.md | 19 ++
.../scraping_and_chunking/doc_pipeline.py | 17 ++
.../scraping_and_chunking/notebook.ipynb | 7 +
.../LLM_Workflows/scraping_and_chunking/run.py | 17 ++
.../scraping_and_chunking/run_dask.py | 17 ++
.../LLM_Workflows/scraping_and_chunking/run_ray.py | 17 ++
.../scraping_and_chunking/spark/README.md | 19 ++
.../scraping_and_chunking/spark/doc_pipeline.py | 17 ++
.../scraping_and_chunking/spark/notebook.ipynb | 7 +
.../scraping_and_chunking/spark/spark_pipeline.py | 17 ++
examples/README.md | 19 ++
examples/airflow/Dockerfile | 17 ++
examples/airflow/README.md | 19 ++
.../dags/hamilton/absenteeism_prediction_dag.py | 17 ++
.../airflow/dags/hamilton/hamilton_how_to_dag.py | 17 ++
.../airflow/plugins/absenteeism/evaluate_model.py | 17 ++
.../airflow/plugins/absenteeism/prepare_data.py | 17 ++
.../airflow/plugins/absenteeism/train_model.py | 17 ++
.../plugins/function_modules/data_loaders.py | 17 ++
.../plugins/function_modules/feature_logic.py | 17 ++
examples/async/README.md | 19 ++
examples/async/async_module.py | 17 ++
examples/async/fastapi_example.py | 17 ++
examples/aws/glue/README.md | 19 ++
.../aws/glue/app/hamilton_functions/functions.py | 17 ++
examples/aws/glue/app/setup.py | 17 ++
examples/aws/glue/processing.py | 17 ++
examples/aws/lambda/Dockerfile | 17 ++
examples/aws/lambda/README.md | 19 ++
examples/aws/lambda/app/functions.py | 17 ++
examples/aws/lambda/app/lambda_handler.py | 17 ++
examples/aws/sagemaker/README.md | 19 ++
examples/aws/sagemaker/app/functions.py | 17 ++
examples/aws/sagemaker/container/Dockerfile | 17 ++
examples/aws/sagemaker/notebook.ipynb | 7 +
examples/aws/sagemaker/processing.py | 17 ++
examples/caching/README.md | 19 ++
examples/caching/in_memory_tutorial.ipynb | 7 +
examples/caching/materializer_tutorial.ipynb | 7 +
examples/caching/tutorial.ipynb | 7 +
examples/caching_nodes/README.md | 19 ++
examples/caching_nodes/caching.ipynb | 7 +
.../caching_nodes/caching_graph_adapter/README.md | 19 ++
.../caching_graph_adapter/business_logic.py | 17 ++
.../caching_graph_adapter/caching_nodes.ipynb | 7 +
.../caching_graph_adapter/data_loaders.py | 17 ++
.../caching_nodes/caching_graph_adapter/run.py | 17 ++
examples/caching_nodes/diskcache_adapter/README.md | 19 ++
.../caching_nodes/diskcache_adapter/functions.py | 18 ++
.../caching_nodes/diskcache_adapter/notebook.ipynb | 7 +
examples/caching_nodes/diskcache_adapter/run.py | 17 ++
examples/cli/DOCS.md | 19 ++
examples/cli/README.md | 19 ++
examples/cli/config.py | 17 ++
examples/cli/example_script.py | 17 ++
examples/cli/module_v1.py | 17 ++
examples/cli/watcher.py | 17 ++
examples/contrib/README.md | 19 ++
examples/contrib/notebook.ipynb | 7 +
.../notebooks/dagworks-translate_to_hamilton.ipynb | 7 +
examples/contrib/run.py | 17 ++
examples/dagster/README.md | 19 ++
examples/dagster/dagster_code/README.md | 19 ++
examples/dagster/dagster_code/setup.py | 17 ++
examples/dagster/dagster_code/tutorial/assets.py | 17 ++
examples/dagster/hamilton_code/README.md | 19 ++
examples/dagster/hamilton_code/dataflow.py | 17 ++
examples/dagster/hamilton_code/mock_api.py | 17 ++
examples/dagster/hamilton_code/notebook.ipynb | 7 +
examples/dagster/hamilton_code/run.py | 17 ++
examples/dask/README.md | 19 ++
examples/dask/community_demo/README.md | 19 ++
.../dask/community_demo/demo_day_notebook.ipynb | 7 +
examples/dask/community_demo/my_functions.py | 17 ++
examples/dask/hello_world/README.md | 19 ++
examples/dask/hello_world/data_loaders.py | 17 ++
examples/dask/hello_world/notebook.ipynb | 7 +
examples/dask/hello_world/run.py | 17 ++
examples/dask/hello_world/run_with_delayed.py | 17 ++
.../run_with_delayed_and_dask_objects.py | 17 ++
examples/data_loaders/README.md | 19 ++
examples/data_loaders/data_loaders.ipynb | 7 +
examples/data_loaders/load_data_csv.py | 17 ++
examples/data_loaders/load_data_duckdb.py | 17 ++
examples/data_loaders/load_data_mock.py | 17 ++
examples/data_loaders/prep_data.py | 17 ++
examples/data_loaders/run.py | 17 ++
examples/data_quality/pandera/README.md | 19 ++
examples/data_quality/pandera/data_loaders.py | 17 ++
examples/data_quality/pandera/feature_logic.py | 17 ++
.../data_quality/pandera/feature_logic_spark.py | 17 ++
examples/data_quality/pandera/run.py | 17 ++
examples/data_quality/pandera/run_dask.py | 17 ++
examples/data_quality/pandera/run_ray.py | 17 ++
examples/data_quality/pandera/run_spark.py | 17 ++
examples/data_quality/simple/README.md | 19 ++
examples/data_quality/simple/data_loaders.py | 17 ++
examples/data_quality/simple/feature_logic.py | 17 ++
examples/data_quality/simple/run.py | 17 ++
examples/data_quality/simple/run_dask.py | 17 ++
examples/data_quality/simple/run_ray.py | 17 ++
examples/data_quality/simple/run_spark.py | 17 ++
examples/dbt/README.md | 19 ++
examples/dbt/models/raw_passengers.sql | 17 ++
examples/dbt/models/train_and_infer.py | 17 ++
examples/dbt/python_transforms/data_loader.py | 17 ++
.../dbt/python_transforms/feature_transforms.py | 17 ++
examples/dbt/python_transforms/model_pipeline.py | 17 ++
examples/decoupling_io/README.md | 19 ++
examples/decoupling_io/adapters.py | 17 ++
examples/decoupling_io/components/feature_data.py | 17 ++
.../decoupling_io/components/model_evaluation.py | 17 ++
.../decoupling_io/components/model_training.py | 17 ++
examples/decoupling_io/run.py | 17 ++
examples/dlt/README.md | 19 ++
examples/dlt/dlt_plugin.ipynb | 7 +
examples/dlt/notebook.ipynb | 7 +
examples/dlt/run.py | 17 ++
examples/dlt/slack/README.md | 19 ++
examples/dlt/slack/helpers.py | 17 ++
examples/dlt/slack/settings.py | 17 ++
examples/dlt/transform.py | 17 ++
examples/due_date_probabilities/README.md | 19 ++
examples/due_date_probabilities/base_dates.py | 17 ++
examples/due_date_probabilities/notebook.ipynb | 7 +
examples/due_date_probabilities/probabilities.py | 17 ++
.../probability_estimation.py | 17 ++
examples/experiment_management/README.md | 19 ++
examples/experiment_management/analysis.py | 17 ++
examples/experiment_management/notebook.ipynb | 7 +
examples/experiment_management/run.py | 17 ++
examples/feast/README.md | 19 ++
examples/feast/default_feature_store/README.md | 19 ++
.../feature_repo/example_repo.py | 17 ++
.../feature_repo/test_workflow.py | 17 ++
.../feature_repo/demo_inputs.py | 17 ++
.../feature_repo/feature_transformations.py | 17 ++
.../feature_repo/retrieval.ipynb | 7 +
.../integration_feature_store/feature_repo/run.py | 17 ++
.../feature_repo/store_definitions.py | 17 ++
.../feature_repo/store_operations.py | 17 ++
.../feature_repo/demo_inputs.py | 17 ++
.../feast/simple_feature_store/feature_repo/run.py | 17 ++
.../feature_repo/store_definitions.py | 17 ++
.../feature_repo/store_operations.py | 17 ++
examples/feature_engineering/README.md | 19 ++
.../README.md | 19 ++
.../scenario_1/README.md | 19 ++
.../scenario_1/etl.py | 17 ++
.../scenario_1/fastapi_server.py | 17 ++
.../scenario_1/features.py | 17 ++
.../scenario_1/named_model_feature_sets.py | 17 ++
.../scenario_1/offline_loader.py | 17 ++
.../scenario_2/README.md | 19 ++
.../scenario_2/etl.py | 17 ++
.../scenario_2/fastapi_server.py | 17 ++
.../scenario_2/features.py | 17 ++
.../scenario_2/named_model_feature_sets.py | 17 ++
.../scenario_2/offline_loader.py | 17 ++
.../scenario_2/online_loader.py | 17 ++
.../write_once_run_everywhere_blog_post/README.md | 19 ++
.../components/aggregations.py | 17 ++
.../components/data_loaders.py | 17 ++
.../components/features.py | 17 ++
.../components/joins.py | 17 ++
.../components/model.py | 17 ++
.../components/utils.py | 17 ++
.../contexts/batch.py | 17 ++
.../contexts/online.py | 17 ++
.../contexts/streaming.py | 17 ++
.../mpg-translation/MPGSimple.ipynb | 7 +
.../mpg-translation/MPGSimpleAdvancedTarget.ipynb | 7 +
.../mpg-translation/MPGSimpleTarget.ipynb | 7 +
.../mpg-translation/ProceduralMPGNotebook.ipynb | 7 +
.../hamilton-tutorials/mpg-translation/README.md | 19 ++
.../mpg-translation/mpg_pipeline.py | 17 ++
.../mpg_pipeline_advanced_target.py | 17 ++
.../mpg-translation/mpg_pipeline_target.py | 17 ++
.../mpg-translation/mpg_script.py | 17 ++
examples/hamilton_ui/README.md | 19 ++
.../hamilton_ui/components/feature_transforms.py | 17 ++
examples/hamilton_ui/components/iris_loader.py | 17 ++
examples/hamilton_ui/components/model_fitting.py | 17 ++
examples/hamilton_ui/components/models.py | 17 ++
examples/hamilton_ui/notebook.ipynb | 7 +
examples/hamilton_ui/run.py | 17 ++
examples/hello_world/README.md | 19 ++
examples/hello_world/my_dag.png | Bin 68544 -> 63764 bytes
examples/hello_world/my_functions.py | 17 ++
examples/hello_world/my_notebook.ipynb | 7 +
examples/hello_world/my_script.py | 17 ++
examples/ibis/feature_engineering/README.md | 19 ++
.../ibis/feature_engineering/column_dataflow.py | 17 ++
examples/ibis/feature_engineering/run.py | 17 ++
.../ibis/feature_engineering/table_dataflow.py | 17 ++
examples/ibis/jaffle_shop/README.md | 19 ++
.../ibis/jaffle_shop/dataflows/customer_flow.py | 17 ++
examples/ibis/jaffle_shop/dataflows/order_flow.py | 17 ++
examples/ibis/jaffle_shop/dataflows/staging.py | 17 ++
examples/ibis/jaffle_shop/run.py | 17 ++
examples/ibisml/README.md | 19 ++
examples/ibisml/model_training.py | 17 ++
examples/ibisml/run.py | 17 ++
examples/ibisml/table_dataflow.py | 17 ++
examples/jupyter_notebook_magic/README.md | 19 ++
examples/jupyter_notebook_magic/example.ipynb | 11 +-
examples/kedro/README.md | 19 ++
examples/kedro/hamilton-code/README.md | 19 ++
.../hamilton-code/notebooks/interactive.ipynb | 7 +
.../src/hamilton_code/data_processing.py | 17 ++
.../src/hamilton_code/data_science.py | 17 ++
.../kedro/hamilton-code/src/hamilton_code/run.py | 17 ++
.../kedro/hamilton-code/tests/test_dataflow.py | 17 ++
examples/kedro/kedro-code/README.md | 19 ++
examples/kedro/kedro-code/conf/README.md | 19 ++
.../kedro/kedro-code/src/kedro_code/__main__.py | 17 ++
.../kedro-code/src/kedro_code/pipeline_registry.py | 17 ++
.../kedro_code/pipelines/data_processing/nodes.py | 17 ++
.../pipelines/data_processing/pipeline.py | 17 ++
.../src/kedro_code/pipelines/data_science/nodes.py | 17 ++
.../kedro_code/pipelines/data_science/pipeline.py | 17 ++
.../kedro/kedro-code/src/kedro_code/settings.py | 17 ++
.../tests/pipelines/data_science/test_pipeline.py | 17 ++
examples/kedro/kedro-code/tests/test_run.py | 17 ++
examples/kedro/kedro-plugin/README.md | 19 ++
.../kedro/kedro-plugin/kedro_to_hamilton.ipynb | 261 +++++++++---------
examples/lineage/README.md | 19 ++
examples/lineage/data_loading.py | 17 ++
examples/lineage/features.py | 17 ++
examples/lineage/lineage_commands.py | 17 ++
examples/lineage/lineage_script.py | 17 ++
examples/lineage/lineage_snippets.ipynb | 7 +
examples/lineage/model_pipeline.py | 17 ++
examples/lineage/sets.py | 17 ++
examples/make_python_virtualenv.sh | 17 ++
examples/materialization/README.md | 19 ++
examples/materialization/custom_materializers.py | 17 ++
examples/materialization/data_loaders.py | 17 ++
.../datasaver_dataloader_example/README.md | 19 ++
.../datasaver_dataloader_example/notebook.ipynb | 7 +
.../datasaver_dataloader_example/run.py | 17 ++
.../datasaver_dataloader_example/simple_etl.py | 17 ++
examples/materialization/model_training.py | 17 ++
examples/materialization/notebook.ipynb | 7 +
examples/materialization/run.py | 17 ++
examples/mlflow/README.md | 19 ++
examples/mlflow/tutorial.ipynb | 7 +
examples/model_examples/README.md | 19 ++
examples/model_examples/modular_example/README.md | 19 ++
.../model_examples/modular_example/features.py | 17 ++
.../model_examples/modular_example/inference.py | 17 ++
.../model_examples/modular_example/notebook.ipynb | 7 +
.../model_examples/modular_example/pipeline.py | 17 ++
examples/model_examples/modular_example/run.py | 17 ++
examples/model_examples/modular_example/train.py | 17 ++
.../scikit-learn/Hamilton_for_ML_dataflows.ipynb | 7 +
examples/model_examples/scikit-learn/README.md | 19 ++
.../model_examples/scikit-learn/digit_loader.py | 17 ++
.../model_examples/scikit-learn/iris_loader.py | 17 ++
.../scikit-learn/my_train_evaluate_logic.py | 17 ++
examples/model_examples/scikit-learn/run.py | 17 ++
.../time-series/Hamilton-TimeSeriesmodel.ipynb | 7 +
examples/model_examples/time-series/README.md | 19 ++
.../model_examples/time-series/data_loaders.py | 17 ++
.../model_examples/time-series/model_pipeline.py | 17 ++
examples/model_examples/time-series/run.py | 17 ++
examples/model_examples/time-series/transforms.py | 17 ++
examples/model_examples/time-series/utils.py | 17 ++
examples/module_overrides/README.md | 19 ++
examples/module_overrides/module_a.py | 18 ++
examples/module_overrides/module_b.py | 18 ++
examples/module_overrides/run.py | 17 ++
.../mutate/abstract_functionality_blueprint/README | 19 ++
.../abstract_functionality_blueprint/mutate.py | 17 ++
.../mutate_on_output.py | 17 ++
.../mutate_twice_the_same.py | 17 ++
.../notebook.ipynb | 7 +
.../pipe_output.py | 17 ++
.../pipe_output_on_output.py | 17 ++
.../abstract_functionality_blueprint/procedural.py | 17 ++
examples/narwhals/README.md | 19 ++
examples/narwhals/example.py | 17 ++
examples/narwhals/notebook.ipynb | 7 +
examples/numpy/air-quality-analysis/README.md | 19 ++
.../numpy/air-quality-analysis/analysis_flow.py | 17 ++
.../air-quality-analysis/hamilton_notebook.ipynb | 7 +
.../numpy/air-quality-analysis/run_analysis.py | 17 ++
examples/openlineage/README.md | 19 ++
examples/openlineage/fake_data.py | 17 ++
examples/openlineage/notebook.ipynb | 7 +
examples/openlineage/pipeline.py | 17 ++
examples/openlineage/run.py | 17 ++
examples/opentelemetry/README.md | 19 ++
examples/pandas/materialization/my_functions.py | 17 ++
examples/pandas/materialization/my_script.py | 17 ++
examples/pandas/materialization/notebook.ipynb | 7 +
examples/pandas/split-apply-combine/README.md | 19 ++
.../pandas/split-apply-combine/my_functions.py | 17 ++
examples/pandas/split-apply-combine/my_script.py | 17 ++
examples/pandas/split-apply-combine/my_wrapper.py | 17 ++
examples/pandas/split-apply-combine/notebook.ipynb | 7 +
examples/pandas/with_columns/README | 19 ++
examples/pandas/with_columns/my_functions.py | 17 ++
examples/pandas/with_columns/notebook.ipynb | 7 +
examples/parallelism/README.md | 19 ++
examples/parallelism/file_processing/README.md | 19 ++
.../parallelism/file_processing/aggregate_data.py | 17 ++
examples/parallelism/file_processing/list_data.py | 17 ++
.../parallelism/file_processing/notebook.ipynb | 7 +
.../parallelism/file_processing/process_data.py | 17 ++
examples/parallelism/file_processing/run.py | 17 ++
examples/parallelism/graceful_running/README.md | 19 ++
examples/parallelism/graceful_running/functions.py | 17 ++
examples/parallelism/graceful_running/run.py | 17 ++
.../lazy_threadpool_execution/README.md | 19 ++
.../lazy_threadpool_execution/my_functions.py | 17 ++
.../my_functions_async.py | 17 ++
.../lazy_threadpool_execution/notebook.ipynb | 7 +
.../parallelism/lazy_threadpool_execution/run.py | 17 ++
examples/parallelism/star_counting/README.md | 19 ++
examples/parallelism/star_counting/functions.py | 17 ++
examples/parallelism/star_counting/notebook.ipynb | 7 +
examples/parallelism/star_counting/run.py | 17 ++
examples/people_data_labs/README.md | 19 ++
examples/people_data_labs/analysis.py | 17 ++
examples/people_data_labs/download_data.py | 17 ++
examples/people_data_labs/notebook.ipynb | 7 +
examples/people_data_labs/run.py | 17 ++
examples/plotly/README.md | 19 ++
examples/plotly/model_training.py | 17 ++
examples/plotly/notebook.ipynb | 7 +
examples/polars/README.md | 19 ++
examples/polars/lazyframe/README.md | 19 ++
examples/polars/lazyframe/my_functions.py | 17 ++
examples/polars/lazyframe/my_script.py | 17 ++
examples/polars/materialization/README.md | 19 ++
examples/polars/materialization/my_functions.py | 17 ++
examples/polars/materialization/my_script.py | 17 ++
examples/polars/materialization/notebook.ipynb | 7 +
examples/polars/my_functions.py | 17 ++
examples/polars/my_script.py | 17 ++
examples/polars/notebook.ipynb | 7 +
examples/polars/with_columns/README | 19 ++
examples/polars/with_columns/my_functions.py | 17 ++
examples/polars/with_columns/my_functions_lazy.py | 17 ++
examples/polars/with_columns/notebook.ipynb | 7 +
examples/prefect/README.md | 19 ++
examples/prefect/evaluate_model.py | 17 ++
examples/prefect/hamilton_prefect_notebook.ipynb | 7 +
examples/prefect/prepare_data.py | 17 ++
examples/prefect/run.py | 17 ++
examples/prefect/train_model.py | 17 ++
examples/ray/README.md | 19 ++
examples/ray/hello_world/README.md | 19 ++
examples/ray/hello_world/data_loaders.py | 17 ++
examples/ray/hello_world/notebook.ipynb | 7 +
examples/ray/hello_world/run.py | 17 ++
examples/ray/ray_Hamilton_UI_tracking/README | 19 ++
.../hamilton_notebook.ipynb | 11 +-
.../ray/ray_Hamilton_UI_tracking/ray_lineage.py | 17 ++
.../ray/ray_Hamilton_UI_tracking/run_lineage.py | 19 +-
examples/reusing_functions/README.md | 19 ++
examples/reusing_functions/main.py | 17 ++
examples/reusing_functions/reusable_subdags.py | 17 ++
examples/reusing_functions/reusing_functions.ipynb | 7 +
examples/reusing_functions/unique_users.py | 17 ++
examples/reverse_etl/README.md | 19 ++
examples/reverse_etl/notebook.ipynb | 7 +
examples/reverse_etl/upload_timesheet.py | 17 ++
examples/schema/README.md | 19 ++
examples/schema/dataflow.py | 17 ++
examples/schema/multi_dataflow.py | 17 ++
.../species_distribution_modeling/README.md | 19 ++
.../species_distribution_modeling/grids.py | 17 ++
.../hamilton_notebook.ipynb | 7 +
.../species_distribution_modeling/load_data.py | 17 ++
.../original_script.py | 17 ++
.../postprocessing_results.py | 17 ++
.../species_distribution_modeling/preprocessing.py | 17 ++
.../species_distribution_modeling/run.py | 17 ++
.../train_and_predict.py | 17 ++
.../train_and_predict_using_mutate.py | 17 ++
examples/scikit-learn/transformer/README.md | 19 ++
.../transformer/hamilton_notebook.ipynb | 7 +
.../scikit-learn/transformer/my_functions_a.py | 17 ++
.../scikit-learn/transformer/my_functions_b.py | 17 ++
examples/scikit-learn/transformer/run.py | 17 ++
examples/slack/README.md | 19 ++
examples/slack/notebook.ipynb | 7 +
examples/slack/slack_notification_example.py | 63 +++--
examples/snowflake/hamilton_ui/Dockerfile | 45 +++-
examples/snowflake/hamilton_ui/README.md | 19 ++
examples/snowflake/hamilton_ui/my_functions.py | 59 ++--
.../snowflake/hamilton_ui/pipeline_endpoint.py | 17 ++
examples/snowflake/hamilton_ui/snowflake.sql | 223 +++++++++-------
examples/spark/README.md | 19 ++
examples/spark/pandas_on_spark/README.md | 19 ++
examples/spark/pandas_on_spark/data_loaders.py | 17 ++
examples/spark/pandas_on_spark/run.py | 17 ++
examples/spark/pyspark/README.md | 19 ++
examples/spark/pyspark/dataflow.py | 17 ++
examples/spark/pyspark/map_transforms.py | 17 ++
examples/spark/pyspark/notebook.ipynb | 7 +
examples/spark/pyspark/run.py | 17 ++
.../pyspark_feature_catalog/column_features.py | 17 ++
.../pyspark_feature_catalog/example_usage.ipynb | 7 +
examples/spark/pyspark_feature_catalog/features.py | 17 ++
examples/spark/pyspark_udfs/README.md | 19 ++
examples/spark/pyspark_udfs/pandas_udfs.py | 17 ++
examples/spark/pyspark_udfs/run.py | 17 ++
examples/spark/pyspark_udfs/vanilla_udfs.py | 17 ++
examples/spark/tpc-h/README.md | 19 ++
examples/spark/tpc-h/csv_data_loaders.py | 17 ++
examples/spark/tpc-h/query_1.py | 17 ++
examples/spark/tpc-h/query_12.py | 17 ++
examples/spark/tpc-h/query_8.py | 17 ++
examples/spark/tpc-h/run.py | 17 ++
examples/spark/world_of_warcraft/README.md | 19 ++
.../world_of_warcraft__pandas.ipynb | 7 +
.../world_of_warcraft__spark_v1.ipynb | 7 +
.../world_of_warcraft__spark_v2.ipynb | 7 +
.../world_of_warcraft/zone_features__common.py | 17 ++
.../world_of_warcraft/zone_features__pandas.py | 17 ++
.../world_of_warcraft/zone_features__spark_v1.py | 17 ++
.../world_of_warcraft/zone_features__spark_v2.py | 17 ++
examples/streamlit/README.md | 19 ++
examples/streamlit/app.py | 17 ++
examples/streamlit/logic.py | 17 ++
examples/styling_visualization/README.md | 19 ++
examples/styling_visualization/dag.png | Bin 297452 -> 333312 bytes
examples/styling_visualization/data_loading.py | 17 ++
examples/styling_visualization/features.py | 17 ++
examples/styling_visualization/model_pipeline.py | 17 ++
examples/styling_visualization/run.py | 17 ++
examples/styling_visualization/sets.py | 17 ++
examples/vaex/README.md | 19 ++
examples/vaex/my_functions.py | 17 ++
examples/vaex/my_script.py | 17 ++
examples/vaex/notebook.ipynb | 7 +
examples/validate_examples.py | 140 +++++++---
examples/validation/static_validator/README.md | 19 ++
examples/validation/static_validator/bad_module.py | 17 ++
.../validation/static_validator/good_module.py | 17 ++
.../validation/static_validator/notebook.ipynb | 7 +
examples/validation/static_validator/run.py | 17 ++
hamilton/dataflows/template/README.md | 18 ++
hamilton/dataflows/template/author.md | 19 ++
hamilton/experimental/databackend.py | 17 ++
hamilton/function_modifiers/README | 19 ++
hamilton/plugins/README.md | 19 ++
plugin_tests/README.md | 19 ++
scripts/add_license_headers.py | 296 +++++++++++++++++++++
scripts/build_conda.sh | 17 ++
scripts/check_license_headers.py | 262 ++++++++++++++++++
scripts/test_memory.py | 17 ++
scripts/update_blogs_in_learning_resources.py | 17 ++
ui/README.md | 19 ++
ui/backend/Dockerfile.backend | 17 ++
ui/backend/Dockerfile.backend-prod | 17 ++
ui/backend/server/entrypoint.sh | 17 ++
ui/backend/server/requirements.txt | 4 +-
ui/backend/server/tests/conftest.py | 17 ++
.../server/tests/test_db_methods/test_api_keys.py | 17 ++
.../test_db_methods/test_auth_synchronization.py | 17 ++
.../tests/test_db_methods/test_permissions.py | 17 ++
ui/backend/server/tests/test_db_methods/utils.py | 17 ++
.../server/tests/test_lifecycle/test_auth.py | 17 ++
.../server/tests/test_lifecycle/test_projects.py | 17 ++
.../tests/test_lifecycle/test_run_tracking.py | 17 ++
.../server/tests/test_lifecycle/test_templates.py | 17 ++
ui/backend/server/trackingserver_auth/README.md | 19 ++
ui/backend/server/trackingserver_base/tests.py | 17 ++
ui/buildx_and_push.sh | 17 ++
ui/common.sh | 17 ++
ui/dev.sh | 17 ++
ui/frontend/Dockerfile.frontend | 17 ++
ui/frontend/Dockerfile.frontend-prod | 17 ++
ui/frontend/README.md | 19 ++
ui/frontend/package-lock.json | 75 ++++--
ui/frontend/src/App.test.tsx | 19 ++
ui/frontend/src/App.tsx | 19 ++
ui/frontend/src/auth/LocalAccount.tsx | 19 ++
ui/frontend/src/auth/Login.tsx | 19 ++
ui/frontend/src/components/Home.tsx | 19 ++
ui/frontend/src/components/common/Checkbox.tsx | 19 ++
ui/frontend/src/components/common/CommonLinks.tsx | 19 ++
ui/frontend/src/components/common/Datetime.tsx | 19 ++
ui/frontend/src/components/common/DeleteButton.tsx | 19 ++
ui/frontend/src/components/common/Dropdown.tsx | 19 ++
ui/frontend/src/components/common/Error.tsx | 19 ++
.../src/components/common/GenericTabbedView.tsx | 19 ++
ui/frontend/src/components/common/GenericTable.tsx | 19 ++
ui/frontend/src/components/common/HelpTooltip.tsx | 19 ++
ui/frontend/src/components/common/Loading.tsx | 19 ++
.../components/common/ProjectVersionSelector.tsx | 19 ++
.../src/components/common/RunDurationChart.tsx | 19 ++
ui/frontend/src/components/common/TagSelector.tsx | 19 ++
ui/frontend/src/components/common/Tooltip.tsx | 19 ++
ui/frontend/src/components/common/WithHelpIcon.tsx | 19 ++
.../src/components/dashboard/Account/Account.tsx | 19 ++
ui/frontend/src/components/dashboard/Alerts.tsx | 19 ++
.../components/dashboard/Catalog/CatalogOutlet.tsx | 19 ++
.../dashboard/Catalog/NodeRunExpansion.tsx | 19 ++
.../components/dashboard/Catalog/SearchTable.tsx | 19 ++
ui/frontend/src/components/dashboard/Code/Code.tsx | 19 ++
.../src/components/dashboard/Code/CodeExplorer.tsx | 19 ++
.../src/components/dashboard/Code/CodeOutlet.tsx | 19 ++
.../components/dashboard/Code/CodeViewUtils.tsx | 19 ++
.../src/components/dashboard/Code/Function.tsx | 19 ++
.../dashboard/Code/FunctionGraphView.tsx | 19 ++
ui/frontend/src/components/dashboard/Dashboard.tsx | 19 ++
.../src/components/dashboard/NavBreadCrumb.tsx | 19 ++
.../src/components/dashboard/Project/Project.tsx | 19 ++
.../dashboard/Project/ProjectDocumentation.tsx | 19 ++
.../dashboard/Project/ProjectLogInstructions.tsx | 19 ++
.../src/components/dashboard/Project/Projects.tsx | 19 ++
.../src/components/dashboard/Runs/Dashboarding.tsx | 19 ++
.../components/dashboard/Runs/Run/DAGRunView.tsx | 19 ++
.../src/components/dashboard/Runs/Run/Run.tsx | 19 ++
.../components/dashboard/Runs/Run/TaskTable.tsx | 19 ++
.../dashboard/Runs/Run/WaterfallChart.tsx | 19 ++
.../src/components/dashboard/Runs/RunSummary.tsx | 19 ++
ui/frontend/src/components/dashboard/Runs/Runs.tsx | 19 ++
.../src/components/dashboard/Runs/RunsOutlet.tsx | 19 ++
.../src/components/dashboard/Runs/RunsTable.tsx | 19 ++
.../src/components/dashboard/Runs/Status.tsx | 19 ++
.../components/dashboard/Runs/Task/CodeView.tsx | 19 ++
.../components/dashboard/Runs/Task/ErrorView.tsx | 19 ++
.../src/components/dashboard/Runs/Task/Task.tsx | 19 ++
.../dashboard/Runs/Task/TaskRunOutlet.tsx | 19 ++
.../Task/result-summaries/DAGWorksDescribe.tsx | 19 ++
.../Task/result-summaries/DataObservability.tsx | 19 ++
.../Runs/Task/result-summaries/DictView.tsx | 19 ++
.../Runs/Task/result-summaries/HTMLView.tsx | 19 ++
.../Runs/Task/result-summaries/PandasDescribe.tsx | 19 ++
.../Runs/Task/result-summaries/SchemaView.tsx | 19 ++
.../src/components/dashboard/Search/search.tsx | 19 ++
.../src/components/dashboard/Settings/Account.tsx | 19 ++
.../src/components/dashboard/Settings/ApiKeys.tsx | 19 ++
.../src/components/dashboard/Settings/Settings.tsx | 19 ++
.../src/components/dashboard/Versions/Versions.tsx | 19 ++
.../dashboard/Versions/VersionsOutlet.tsx | 19 ++
.../src/components/dashboard/Visualize/DAGRun.tsx | 19 ++
.../src/components/dashboard/Visualize/DAGViz.tsx | 19 ++
.../src/components/dashboard/Visualize/Legend.tsx | 19 ++
.../dashboard/Visualize/NodeHierarchyManager.tsx | 19 ++
.../dashboard/Visualize/VisualizeOutlet.tsx | 19 ++
.../components/dashboard/Visualize/VizConsole.tsx | 19 ++
ui/frontend/src/components/dashboard/Welcome.tsx | 19 ++
.../components/notimplemented/NotImplemented.tsx | 19 ++
ui/frontend/src/components/tutorial/HelpVideo.tsx | 19 ++
ui/frontend/src/index.tsx | 19 ++
ui/frontend/src/state/urlState.tsx | 19 ++
ui/run.sh | 17 ++
ui/sdk/README.md | 27 ++
ui/sdk/developer_setup.md | 19 ++
ui/sdk/tests/conftest.py | 17 ++
ui/sdk/tests/resources/basic_dag_with_config.py | 17 ++
ui/sdk/tests/resources/parallel_dag.py | 17 ++
ui/sdk/tests/resources/parallel_dag_error.py | 17 ++
ui/sdk/tests/test_adapters.py | 17 ++
ui/sdk/tests/test_driver.py | 17 ++
ui/sdk/tests/test_package_to_hash/submodule1.py | 17 ++
ui/sdk/tests/test_package_to_hash/submodule2.py | 17 ++
ui/sdk/tests/test_tracking.py | 17 ++
ui/sdk/tests/tracking/test_constants.py | 17 ++
ui/sdk/tests/tracking/test_dataframe_stats.py | 17 ++
ui/sdk/tests/tracking/test_ibis_stats.py | 17 ++
ui/sdk/tests/tracking/test_langchain_stats.py | 17 ++
ui/sdk/tests/tracking/test_pandas_col_stats.py | 17 ++
ui/sdk/tests/tracking/test_pandas_stats.py | 17 ++
ui/sdk/tests/tracking/test_polars_col_stats.py | 17 ++
ui/sdk/tests/tracking/test_polars_stats.py | 17 ++
ui/sdk/tests/tracking/test_pydantic_stats.py | 17 ++
ui/sdk/tests/tracking/test_pyspark_stats.py | 17 ++
ui/sdk/tests/tracking/test_runs.py | 17 ++
ui/sdk/tests/tracking/test_stats.py | 17 ++
ui/sdk/tests/tracking/test_utils.py | 17 ++
ui/stop.sh | 17 ++
writeups/basics.md | 19 ++
writeups/data_quality.md | 19 ++
writeups/decorators.md | 19 ++
writeups/developer_setup.md | 19 ++
writeups/garbage_collection/memory_test.py | 17 ++
writeups/garbage_collection/post.md | 19 ++
761 files changed, 13480 insertions(+), 377 deletions(-)
create mode 100755 scripts/add_license_headers.py
create mode 100755 scripts/check_license_headers.py
