See
<https://builds.apache.org/job/beam_SeedJob/2132/display/redirect?page=changes>
Changes:
[altay] Add custom sources and sinks for Python page
[dhalperi] [BEAM-475] update release instructions for javadoc
[dhalperi] Minor tweaks
[melissapa] Fix broken links due to code path changes
[davor] Add Apache in front of initial Beam reference
[sourabhbajaj] [BEAM-1320] Update release guide to create pydocs
[sourabhbajaj] Fix broken links
[staslevin] Adding testing related info: TestPipeline, API surface.
[altay] Fix the quickstart documentation
[altay] Update quickstart to have runner specific examples
[thomas.haines] BEAM-1559 add HBase docs
[davor] Add contrib guide comments about using squash & force push.
[davor] Comment Ostatic link as it has been broken for a few weeks
[iemejia] [BEAM-325] Add Slack details to website
[mairbek] Typo fix in "Reading Data Into Your Pipeline" example.
[wnsdud1861] Fixed typos (from distributed to distributed)
[altay] Finding a typo in a code block
[davor] Fix possible erranous naming conventions reference
[azur] Add IntelliJ files to .gitignore
[davor] [BEAM-1652] Code style instructions for IntelliJ in contribution guide.
[davor] Documentation changes for 0.6.0 release.
[sourabhbajaj] Add htaccess back
[altay] Changes to web site related to recently released Python SDK
[devon.meunier] Typo fix
[davor] Blog post for 0.6.0 release with python sdk
[kirpichov] Add jkff as committer
[iemejia] Add iemejia as committer
[davor] Add Pipeline I/O section to website - outline + move some existing
[davor] Add chamikara as a committer
[azur] Add aviemzur as committer
[iemejia] Improve committing website changes section in the contribution guide
[iemejia] Fix timezone to America/Los_Angeles
[peihe0] Change peihe company affiliation to Alibaba.
[davor] Simplify merge process section
[davor] Add windowing section to programming guide
[altay] Simplify python quick start.
[davor] add code snippet to page design-your-pipeline
[klk] Reword RunnableOnService to ValidatesRunner
[aljoscha.krettek] Update Capability Matrix: Flink supports state/timers in
batch mode
[sourabhbajaj] Fix the link to the apache ICLA
[sourabhbajaj] [BEAM-1711] Add information about extra requires in Python
Quickstart
[altay] Docker server command should run non-incremental build
[altay] Add "In-Progress" info to the Built-in I/O Transforms page
[altay] Add Read Transform content for Authoring I/O Transforms - Overview
[sisk] Add to in-progress IO list and alphabetize
[azur] Add JSON as a planned IO to built-in IOs page.
[github] Update quickstart-java.md
[dhalperi] [BEAM-1949] Associated doc changes for renaming sideOutput to output
[dhalperi] add CoGroupByKey to chapter 'Using GroupByKey'
[aljoscha.krettek] remove extra streaming refs in capability matrix: Flink
state/timers
[davor] Track RestIO in In-Progress I/O Transforms
[dhalperi] [BEAM-1272] Align the naming of "generateInitialSplits" and
[davor] [BEAM-1949] Doc changes for Python SideOutputValue to OutputValue rename
[davor] [BEAM-1741] Update direct and Cloud Dataflow runner pages with Python
[davor] Update overview page.
[davor] update release notes post 0.6.0 release
[aljoscha.krettek] Update flink page ref from language-python to language-py
and add toggle
[davor] [BEAM-919] Remove remaining old use/learn links from website src
[davor] [BEAM-825] Fill in the documentation/runners/apex portion of the website
[davor] Fix Apex runner instructions (pending review comments and other changes)
[davor] [BEAM-1452] Add composite transforms section to programming guide
[davor] [BEAM-1011] Add triggers content to the programming guide
[altay] [BEAM-1695] Improve Python-SDK's programming guide
[lcwik] Fix broken HDFS link on built-in IO page
[altay] [BEAM-2142] Add composite transforms Python snippets to programming
[altay] Add Python snippets to Mobile Gaming.
[klk] [BEAM-969] Add a gearpump runner web page
[klk] Minor touch-ups to Gearpump listing on overview
[davor] add SQL_DSL to page 'work-in-progress'
[davor] Transfer some content from Create Your Pipeline to the Programming
[davor] Add trademark symbol to the Downloads page
[altay] Remove README.md references from the website
[altay] Migrate hadoop inputformat to website
[altay] Move extension README files to website
[melissapa] Add quickstart step re: Python 2.7.x requirement
[altay] fix typos in hadoop io documentation
[davor] Release guide: fix instructions
[davor] Revise WordCount Example Walkthrough
[altay] Quick start should not default to java quickstart
[kirpichov] Rewrites the section on Coders to not talk about them as a parsing
[kirpichov] [BEAM-1353] Style Guide fixups
[dhalperi] [BEAM-501] Large visual refresh of Apache Beam website homepage
[dhalperi] Shorten quotes and fix a typo
[dhalperi] [BEAM-501] fix quotes
[dhalperi] Update latest version metadata information
[dhalperi] Add version 2.0.0 to Downloads page
[dhalperi] Python: fix links to PipelineOptions after move from utils to options
[dhalperi] Update Java Quickstart to stop using snapshot repos
[davor] Add a draft of the Beam FSR blog post
[github] TikaIO JIRA number fix
[github] Added Cloud Spanner Connector
[hadarh] Add 'how to run' directions to WordCount for all runners.
[dhalperi] remove note about JIRA
[dhalperi] Changing Aggregators to Metrics in capability matrix
[dhalperi] fixups
[dhalperi] Do not use BeautifulSoup prettify, which is known to corrupt HTML
[chamikara] Updates contribution guide to include development and testing
[iemejia] Add HadoopInputFormatIO example to read from Hive's HCatalog
[klk] Add support for "no-toggle" code snippets
[klk] Add Beam Runner Guide
[iemejia] Update IO with CassandraIO
[iemejia] Add Hive (HCatalog) to the list of available I/O transforms
[altay] Mention python setup.py sdist and link to its docs
[altay] [BEAM-2437] Input path should be flexible in quickstart
[iemejia] Add Amazon DynamoDB example using HadoopInputFormatIO
[aljoscha.krettek] Update to more recent Flink version in example
[aljoscha.krettek] Add note about Scala version when setting up Flink cluster
[github] Remove references to Travis.
[github] No longer working title
[mergebot] Update build-in IO list with AMQP
[mergebot] Remove AMQPIO from in-progress list
[mergebot] Fix missing closing element
[mergebot] Add JingsongLee as committer
[mergebot] Restore index.html and fix order
[thw] update apex runner properties example
[github] Remove incorrect info from testing page.
[github] Drop the word reviewer from the contribution guide
[mariagh] Fix broken links
[mariagh] Update to latest version
[mariagh] Address review comments
[mariagh] Address review comments
[mergebot] Includes Splittable DoFn in the capability matrix
[mergebot] [BEAM-2500] List Amazon S3 File System as a planned I/O.
[mergebot] Port of Google doc
[mergebot] IO Testing, unit tests: update after readthrough
[mergebot] fixup! IO Testing, unit tests: update after readthrough
[mergebot] fixup! fixup! IO Testing, unit tests: update after readthrough
[mergebot] [BEAM-2638] Add Elasticsearch (v2 and upcoming v5) and MQTT to
Built-in
[mergebot] [BEAM-2126] Add JStorm runner to ongoing projects.
[mergebot] Add initial text for I/O Integration Test documentation
[mergebot] fixup! Add initial text for I/O Integration Test documentation
[mergebot] Updated IO IT docs based on PR feedback
[mergebot] Update JDBC IO IT docs based on PR feedback.
[kirpichov] Update a dead link to Jenkins builds.
[kirpichov] Add Apache Solr to the list of Built-In I/O Transforms
[kirpichov] A couple of fixes to website
[kirpichov] Expands the sections on Coders and Validation in Style Guide
[mxm] Update company affiliation
[azur] Update PMC
[altay] Update PMC
[mergebot] Add MapReduce and Tez runners to ongoing projects.
[mergebot] Splittable DoFn blog post.
[mergebot] Add Manu Zhang to committers list
[mergebot] add a page for DSLs:SQL
[mergebot] fix typo issues
[mergebot] add intro of BeamSqlRow, trigger settings of aggregation/join,
[mergebot] typo fix
[mergebot] change page dsls/sql.md into a blog post
[mergebot] split into 1 blog + 1 development doc.
[mergebot] fix broken link
[mergebot] update to latest API/usages
[mergebot] remove post page move internal imple to the end of page
[altay] Publish release 2.1.0
[altay] Fix quote
[mergebot] [BEAM-2780] Fix Window sample code in programming guide
[takidau] [BEAM-2800] Revamp sections 1 and 2 of DSL SQL docs: - Expand
BeamRecord
[takidau] Remove TODO
[altay] Add tfrecord io to builtin io list
[mingmxu] add SQL grammar in BNF
[mingmxu] correct the syntax of ORDER_BY LIMIT
[klk] Add blog post with timely processing
[kirpichov] Adds guidance on how to test transform configuration/validation
[altay] [rebase] add MingminXu to team.md
[altay] Add James Xu(xumingming) as committer
[altay] Add Reuven Lax to committers list.
[kirpichov] Fixes SDF blog post after rename of Match to FileIO.match
[altay] Document stale PR policy
[huafengw] Update Gearpump runner related pages
[melissapa] [BEAM-2510] Link to SDK pages from the quickstarts
[mergebot] [BEAM-2869] Add dates to releases on downloads page
[mergebot] [BEAM-1534] Add docker images documentation to the website
[mergebot] [BEAM-2726] Fix typo in programming guide
[mergebot] [BEAM-893] Update mobile gaming example
[mergebot] Update with review feedback
[mergebot] [BEAM-2839, BEAM-2838] Add MapReduce runner to Beam asf-site.
[mergebot] fixup: address comments.
[mergebot] fixup: address comments.
[mergebot] fixup: address comments.
[melissapa] [BEAM-667] Verify and update wordcount snippets
[melissapa] Update with review feedback
[melissapa] Update with review feedback
[melissapa] [BEAM-2039] Number programming guide chapters
[melissapa] Updates with review feedback
[mergebot] Update Mapreduce capability matrix when/how entries
[mergebot] Remove extraneous type variable from StateSpec in state blog post
[melissapa] Add Cloud Resource Manager API to the required API list
[melissapa] Add new execution model page and associated images
[melissapa] Update with review feedback and new diagrams
[melissapa] More updates from review feedback
[basti.lj] [BEAM-2666] Add JStorm runner to Beam asf-site.
[mergebot] Update source-repository.md
[mergebot] [BEAM-2335] Document how to run NeedsRunner tests.
[mergebot] fixup! [BEAM-2335] Document how to run NeedsRunner tests.
[mergebot] Manually add missed files from content dir
[iemejia] [BEAM-2727] Add build information to the vote email template
[altay] [BEAM-2853] Move the nexmark documentation to the website
[altay] fixups
[melissapa] Fix dead link
[mergebot] [MINOR] Updated hero and cards background to use background-size:
cover
[jbonofre] Add RedisIO in the built-in set
[jbonofre] Move Elasticsearch v5.x from in-progress to built-in
[altay] [BEAM-664] Update docs: MinimalWordCount in Java is intentionally
[herohde] [BEAM-3121] Remove broken docker script and documentation
[klk] New top menu plus side nav layout
[mergebot] [BEAM-1934] Add more CoGroupByKey content/examples
[mergebot] Update with Java snippet tags
[mergebot] Add melap as committer
[mergebot] Add page for the portability framework
[mergebot] Add portability to contribute section
[mergebot] Update PMC
[mergebot] [BEAM-3123] Update status of BEAM-1035 and BEAM-1037 in Nexmark.
[mergebot] Update IntelliJ Checkstyle instructions
[mergebot] Address
[mergebot] Address
[pgerver] [BEAM-3162] Add IBM Streams Runner to compatability matrix
[github] Update testing docs to account for Python.
[echauchot] Add Etienne Chauchot as a committer
[jbonofre] Update SCM URL to use gitbox instead of git-wip-us
[echauchot] [BEAM-2853] Fix left menu in nexmark page
[echauchot] [BEAM-2853] Move nexmark page to documentation/sdks/java/nexmark
[melissapa] Fix ptransform guide links to use site variable
[altay] Capabilities Matrix: Stateful processing support in Apex Runner
[relax] documentation changes for 2.2.0-RC1
[relax] Cherry pick for pr/3578
[herohde] Add links to the Go SDK
[mergebot] Add Reuven Lax as PMC member.
[mergebot] Update release date for 2.2.0 release
[melissapa] Fix broken SQL branch links
[klk] Move reporter.apache.org step to finalize section
[klk] Expand instructions for pushing release version tag
[klk] Make contribution-guide.md markdown readable
[klk] Revamp the contribution guide
[mergebot] [BEAM-3338] Add SDK specific pages to SDK left nav
[mergebot] [BEAM-3374] Fix missing/stretched images, improve alt text
[mergebot] [BEAM-2664] Make latest stable version more visible
[xiliu] BEAM-3079: Samza runner
[xiliu] Populate beam job name to Samza
[mergebot] Adding update to Wikipedia to release guide.
[xiliu] Remove the offsets calculation/comparison in UnboundedSourceSystem admin
[mergebot] Fixed an example of shading the application jar to it run on Spark
[mergebot] Add link to Scio (Scala) interface.
[mergebot] Manually set hight of scala logo.
[iemejia] [BEAM-3467] Remove Java 7 from the docker development images
[melissapa] Fix broken JIRA component links
[mergebot] fix language tabs after a language specific paragraph
[melissapa] [BEAM-3117] Fix reference to bundles and windows
[xiliu] Turn on validation tests
[jbonofre] Add 2017 look back blog post
[xiliu] Add license header to the tests
[melissapa] Fix broken links due to code directory moves
[github] Replaces sources/sinks in programming guide with IOs
[jbonofre] Announce 2.3.0 release
[mergebot] Add blog post for the release of Beam 2.3.0
[aromanenko.dev] Fixed number of contributors and duplication of name of Alexey
Romanenko
[taro.murao] Java variable names should be in CamelCase
[mergebot] Clarify runtime type checking documentation
[mergebot] Add nightly snapshot build to the release guide
[mergebot] [BEAM-3430] Update workdcount example for Java8 for Java SDK
[mergebot] Add procedure to create a self executing Jar for DataFlow
[mergebot] Don't pass the pom.xml as an input
[mergebot] Updates list of built-in IO transforms
[klk] Update Gemfile.lock
[klk] Explicitly define section id due to kramdown id generation changes
[altay] Update site to mention the 2 Python lint envs
[lcwik] [BEAM-3846] Add a link to be able to self join the Apache Beam slack
[lcwik] [BEAM-3852] Update slack channel link and slack invite for new channel.
[robertwb] Update instructions on cryptographic hashes.
[mergebot] Increase link checking timeouts
[mergebot] Update SQL doc to match new APIs
[mergebot] Update current release to 2.4.0.
[mergebot] Update download page (including signature and checksum).
[mergebot] Add instructions on how to build and use the Python tarball.
[mergebot] Update nexmark support matrix for timer and state APIs
[echauchot] Make minor fixes to Nexmark page
[echauchot] Use {{ site.release_latest }} instead of [version]
[echauchot] Make gs paths coherent for runs on dataflow runner
[mergebot] expand and collpase navigation side bar new feature
[mergebot] mark active item on navigation side bar
[melissapa] [BEAM-4026] Remove link to deleted Go SDK branch
[melissapa] parallelise test
[mergebot] [BEAM-3252] Updating contributor's guide to reference Gradle.
[mergebot] Fix project names to reflect changes required for release.
[mergebot] Drop using gradle clean in favor of --rerun-tasks
[mergebot] [BEAM-3252] Adding a step to the IntelliJ setup for gradle.
[mergebot] [BEAM-3252] Removing Annotation Processing section.
[mergebot] Stop recommending we use auto-import
[mergebot] Update checkstyle comment to correspond to the current version
[mergebot] Update instructions to run linter.
[mergebot] Change first occurance of MyOptions to PipelineOptions
[ehudm] Document Gradle command for testing Beam SDK.
[melissapa] [BEAM-4101] Fix broken links
[melissapa] Update Eclipse documentation for Gradle build.
[melissapa] [BEAM-3036] Adding Checkstyle version warning.
[melissapa] Add TODO with linked JIRA to update Docker documentation for Gradle.
[kpeterson] Allow a GCP project to be explicitly set for a load job, instead of
[robertwb] Ignore jstorm.io to unblock presubmits.
[mergebot] Friendlier contribution guide; link to starter tasks
[mergebot] Cleanup now that GitHub is not the mirror.
[mergebot] Update contribution guide to reflect current practices.
[mergebot] Further refinement.
[mergebot] Update Nexmark launch instructions for Gradle
[lukasz.gajowy] [BEAM-4119] Update i/o testing documentation to use gradle
[mergebot] Add Jason Kuster as Committer
[github] Adding pabloem to the list of team members.
[github] Sorting by last name
[github] Adding gris as committer as well.
[mergebot] Document Java extensions for parsing Apache HTTPD logfiles and
Useragent
[mergebot] Fixed some layout issues
[mergebot] Moved the 3rd party extensions to a separate page
[mergebot] [BEAM-4177] Clarify thread contraint in Programming Guide 4.3.2
[coheigea] Typo fix in the programming guide
[klk] Add "Become a Committer" with PMC guidelines
[klk] Remove Team page in favor of link to ASF roster
[klk] Remove/correct references to Team page
[klk] Do not validate links from datatorrent.com
[melissapa] Updates for Python streaming
[aljoscha.krettek] Move _CreateSource to its own package to make it pickelable
[tgroh] Add extra documentation to RemoteBundle#close
[kmj] Bugfix: Read BQ bytes processed from correct field.
[github] Undefined names: import MetricKey, MetricName
[klk] Add top-level Community section
[klk] Remove obsolete Maturity Model section
[herohde] Add Go integration tests
[kenn] Remove redundant bits of job file names
[matthias] Futurize metrics subpackage
[klk] Move Release Guide to committers section
[klk] Move committer section to the bottom (we can find it :-)
[klk] Streamline the contribution section
[tgroh] Migrate ImpulseEvaluatorFactory
[tgroh] Migrate FlattenEvaluatorFactoryTest
[tgroh] Migrate GroupByKeyOnly to the RR
[tgroh] Use ModelCoders in LengthPrefixUnknownCoders
[robbe.sneyders] Add py27-lint3 test to gradle.build
[klk] Google has scrapped research, now only AI
[tgroh] Add a static constructor to GrpcStateService
[tgroh] Log when Handler Delegation Throws
[kirpichov] fromQuery().withTemplateCompatibility() should do the same thing as
[klk] Temporarily suppress validation of ai.google links
[iemejia] Fix error-prone warnings for HBaseIO
[timrobertson100] Fix error-prone warnings for SolrIO
[timrobertson100] Fix error-prone warnings for ElasticsearchIO
[timrobertson100] Fix error-prone and some static analysis warnings in
[mergebot] Add link to portability support sheet
[timrobertson100] Fix error-prone and some static analysis warnings in XmlIO
[Pablo] Fix error-prone warnings for file-based-io-tests
[kedin] [SQL] Add integration test for PubsubIO JSON -> SQL
[kedin] [SQL] Fix typos, add rewindowing and retriggering to TestPubsubSignal
[apilloud] [BEAM-3983] Add utils for converting to BigQuery types
[apilloud] [BEAM-3983][SQL] Add BigQuery table provider
[apilloud] [BEAM-4248] Copy enums from com.google.cloud
[kedin] Add SQL postCommit to main javaPostCommit
[wcn] Fix log statement to mark sink as generator of info.
[timrobertson100] Fix error-prone warnings for io/hadoop-common
[mairbek] Make Cloud Spanner transaction id public. Allows to build non-library
[daniel.o.programmer] [BEAM-4277] Adding unshaded jars used by Dataflow to poms.
[tgroh] Revert "Log when Handler Delegation Throws"
[tgroh] Log when Handler Delegation Throws
[tgroh] squash! Revert "Log when Handler Delegation Throws"
[Pablo] [BEAM-4249] Fix failing validates container test
[valentyn] Add a Python 3 entry to the list of ongoing projects.
[lcwik] [BEAM-4127] Flink streaming translation for portable pipeline. (#5358)
[herohde] [BEAM-3826] Add missing package comments
[kedin] [SQL] Add support for DQL to PubsubJsonTable
[mergebot] Add Go SDK quickstart and minimal documentation page
[mergebot] Add Go to the Wordcount example
[mergebot] Fix mailing list links and docker image
[Pablo] Add a dependency on future.
[timrobertson100] Fix error-prone and some static analysis warnings in
[lukasz.gajowy] [BEAM-4140] Utilize beam_location perfkit flag
[github] Update index.md
[kpeterson] Adding a ValueProvider interface.
[klk] Reorganize SQL documentation into sections
[Scott Wegner] Upgrade Byte Buddy and FindBugs annotations dependencies.
[Scott Wegner] Fix ErrorProne warnings
[Scott Wegner] Remove isTriggerSpecified from WindowingStategy equality checks.
[kpeterson] Fixing checkstyle error.
[lcwik] Add window mapping transform.
[lcwik] Use the coder from the side input PCollection definition by removing the
[lcwik] Remove garbage collection from PValueCache
[Pablo] Fixing incorrect assert in dependency_test.py
[kedin] [SQL] Add integration test for Pubsub Json Table DLQ
[github] [BEAM-4300] Fix ValidatesRunner tests in Python: run with same
mechanism
[tgroh] Add an IdGenerator class to java/fn-execution
[ringwalt] Improve the TaggedOutput error when a tuple is passed as a tag.
[lukasz.gajowy] [BEAM-214] Add ParquetIO
[lukasz.gajowy] [BEAM-214] Add gradle build in ParquetIO
[lukasz.gajowy] [BEAM-214] Refactore the reads to leverage FileIO
[lukasz.gajowy] [BEAM-214] Use Parquet 1.10.0 version in ParquetIO.Sink
[lukasz.gajowy] [BEAM-214] Add ParquetIOIT
[lukasz.gajowy] [BEAM-214] Update ReadFn to an non deprecated, newest Parquet
API
[lukasz.gajowy] [BEAM-214] Simplify the IO by removing redundant PTransforms
[lukasz.gajowy] [BEAM-214] Implement writing slices of bytes in BeamOutputStream
[apilloud] [BEAM-3733] [SQL] Use saffron.properties for charset
[Pablo] [BEAM-4331] Disable integrationTest task caching
[tgroh] Add a new DockerEnvironmentFactory Constructor
[Pablo] Fixing Seed Job
[samuelw] [BEAM-3776] Fix issue with merging late windows where a watermark hold
[Pablo] Add future dependency to the Dockerfile
[apilloud] [SQL] Add jdbc:beam:
[apilloud] [SQL] Use CalciteConnection as context
[axelmagn] Create jobsubmission package for job management.
[axelmagn] Add Job Invocation Interfaces
[axelmagn] Add in-memory implementation of JobService
[Pablo] Remove stale TODO comments for adding archetype to java precommit
[Pablo] Upgrade Gradle shadowJar plugin to latest.
[github] Mention adding a reviewer in PR template. (#5397)
[kedin] Fix Maven build
[rober] Update generated protos in Go SDK
[herohde] Invoke Go Dataflow integration tests from post-commit
[herohde] Add the Go SDK to the README
[timrobertson100] [BEAM-4342] Enforce ErrorProne analysis in hadoop IO, and
static
[timrobertson100] [BEAM-4340] Enforce ErrorProne analysis in file-based-io-tests
[timrobertson100] [BEAM-4341] Enforce ErrorProne analysis in
google-cloud-platform IO
[timrobertson100] [BEAM-4335] Enforce ErrorProne analysis in
amazon-web-services IO
[timrobertson100] [BEAM-4339] Enforce ErrorProne analysis in elasticsearch IO
[timrobertson100] [BEAM-4355] Enforce ErrorProne analysis in XML IO
[timrobertson100] [BEAM-4338] Enforce ErrorProne analysis in common IO
[timrobertson100] [BEAM-4337] Enforce ErrorProne analysis in cassandra IO
[timrobertson100] [BEAM-4355] Reduces scope of findbugs annotations to build
time only
[timrobertson100] [BEAM-4353] Enforce ErrorProne analysis in solr IO
[timrobertson100] [BEAM-4345] Enforce ErrorProne analysis in JDBC IO
[timrobertson100] [BEAM-4336] Enforce ErrorProne analysis in AMQP IO
[timrobertson100] [BEAM-4347] Enforce ErrorProne analysis in kafka IO
[dariusz.aniszewski] [BEAM-4041] Increase timeout for getting K8s LoadBalancer
external IP
[timrobertson100] [BEAM-4346] Enforce ErrorProne analysis in JMS IO
[timrobertson100] [BEAM-4352] Enforce ErrorProne analysis in Redis IO
[lcwik] [BEAM-4271] Support side inputs for ExecutableStage and provide runner
[daniel.o.programmer] [BEAM-2937] Add new Combine URNs.
[tgroh] Update worker_id Documentation
[robbe.sneyders] Futurize internal subpackage
[dariusz.aniszewski] fixed typo
[mariagh] Add validation for streaming wordcount (streaming_wordcount_debugging)
[Pablo] Increasing the concurrent test execution count (#5408)
[tgroh] Add a Default RemoteEnvironment Implementation
[sidhom] Require explicit IdGenerator for all DockerEnvironmentFactory
[sidhom] [BEAM-4148] Add pluggable UrlFactory to ServerFactory
[sidhom] [BEAM-4267] Docker-based JobBundleFactory
[tgroh] Add a Window-only State Context
[lcwik] Address Ben's comments.
[github] Make hash function in Coder base class more conservative.
[github] updated right documentation for HCatalogIO.write
[sidhom] Fix DataStreamsTest checkstyle error
[ankurgoenka] Updating python container version to beam-master-20180518
[wcn] Fix the test to properly run.
[ankurgoenka] Reverting fnapi container version
[ankurgoenka] Copyting dependency.py and dependency_test.py
[ankurgoenka] reformatting code
[ankurgoenka] Introducing classes
[ankurgoenka] gruping public and non public methods
[ankurgoenka] Renaming method and updating reference for file_copy and
file_download
[ankurgoenka] Removing Google specific code and unused code in stager.
[ankurgoenka] Removing reference to Google/GCS/Dataflow and restructuring a bit
of
[ankurgoenka] Fixing Stager Tests
[ankurgoenka] Making dependency.py use stager.py and fixing dependency_test.py
test
[ankurgoenka] Moving stager to portability
[ankurgoenka] Removing stage_job_resources from dependencies.py and other minor
[ankurgoenka] Merging filehandler in stager
[ankurgoenka] renaming GCSStager to _ParameterizedStager
[ankurgoenka] Making a few methods static and moving code around
[ankurgoenka] Applying changes from rebase
[szewinho] HDFS large cluster configuration. Jenkins job updated to use large
[ankurgoenka] Fixing lint
[iemejia] [BEAM-4343] Enforce ErrorProne analysis in HBaseIO
[iemejia] [BEAM-4344] Enforce ErrorProne analysis in the HCatalogIO
[tgroh] Add a BundleFactoryOutputReceiverFactory
[tgroh] Add a DirectJobBundleFactory
[tgroh] Fix Copyright Headers in sdks/java/fn-execution
[yifanzou] rollback BEAM-3256 add archetype testing to gradle build PreCommits
[ankurgoenka] Adding ArtifactStagingFileHandler to push files to staging server
[ankurgoenka] Adding filesystem based artifact service to ULR job service
[ankurgoenka] Adding context manager to ArtifactStagingFileHandler
[ankurgoenka] Converting ArtifactServiceFileHandler to PortableStager based on
[ankurgoenka] Simplifying numeric constants
[ekirpichov] [BEAM-4375] Replaces usage of JUnit runners that do not work well
with
[matthias] Futurize options subpackage
[szewinho] [BEAM-4065] Basic performance tests analysis added.
[szewinho] Fixed typo in env name, added unit tests for create report logic,
slack
[szewinho] Jenkins job will run tests before executing script. Extended testing
of
[timrobertson100] [BEAM-4347] Improve ErrorProne analysis in kafka IO
[timrobertson100] [BEAM-4348] Enforce ErrorProne analysis in kinesis IO
[timrobertson100] [BEAM-4349] Enforce ErrorProne analysis in mongodb IO
[timrobertson100] [BEAM-4351] Enforce ErrorProne analysis in mqtt IO
[lcwik] [BEAM-4060] Add the pom.xml and pom.properties file to the artifact when
[github] [BEAM-1755] Add a directory with build-specific scripts to clear up the
[ankurgoenka] Logging and naming changes
[ankurgoenka] Enhancing test cases
[tgroh] Add an InProcessEnvironmentFactory
[timrobertson100] [BEAM-4348] Removes double-checked locking to aid readability
[ankurgoenka] Updating the dostring
[tgroh] Update InProcessManagedChannelFactory
[tgroh] Add a RemoteStageEvaluatorFactory
[timrobertson100] [BEAM-4354] Enforce ErrorProne analysis in tika IO
[iemejia] Fix build with Maven (Again!)
[lukasz.gajowy] [BEAM-214] Apply reviewer's suggestions
[timrobertson100] [BEAM-4347] Minor changes following PR review
[timrobertson100] [BEAM-4347] Correction of typo following PR review
[tgroh] Use WindowOnlyContext in ReduceFnContextFactory
[tgroh] Update GroupAlsoByWindowEvaluatorFactory
[tgroh] Move InProcessEnvironmentFactory to java-fn-execution
[klk] Autoformat sdks/java/extensions/sql
[klk] Add spotless config to global gradle file
[klk] Activate spotless for SQL module
[boyuanz] Solve BEAM-4393: Missing copyright notices for shaded packages
[iemejia] Remove repeated GCPIO dependency in SQL module (Again!)
[iemejia] Enforce error-prone in ParquetIO, fix missing javadoc and refine deps
[katarzyna.kucharczyk] Replaced created datetime to jenkins build id in
kubernetes namespace.
[schroederc] Use ElementEncoders for beam.Create
[boyuanz] Change bulid rules of sdks/java/harness to make harness as a uber-jar
[Scott Wegner] Remove DoFnTester from testing guide.
[robertwb] Slowly ramp up wait time in state sampler.
[tgroh] Move the Local Artifact Services to the DirectRunner
[tgroh] Migrate the ReferenceRunnerJobServer to runners-direct
[tgroh] Fix License Headers
[schroederc] Add test case for proto oneof fields in create_test.go
[tgroh] Add a test to show Flatten Execution
[apilloud] [SQL] Fix transitive dependencies
[apilloud] [SQL] Run tests against actual jar
[boyuanz] [BEAM-4393]: Copy root repo's LICENSE & NOTICE into shadowJar
[herohde] Tweak Go integration test driver
[tgroh] Update Docker Command
[iemejia] [BEAM-4306] Enforce ErrorProne analysis in apex runner
[daniel.o.programmer] [BEAM-4406] Updating Java portable environment major
version.
[daniel.o.programmer] [BEAM-4406] Updating Python portable environment major
version.
[ehudm] Add a custom _url_dirname for local filesystems.
[tgroh] Add a Portable TransformEvaluatorRegistry
[tgroh] Consistent Parameter Order in Evaluator Factories
[tgroh] Make ImmutableExecutableStage Public
[mergebot] Fix typo in becoming-a-committer docs
[iemejia] Fix broken build (again third time this week yay!)
[timrobertson100] [BEAM-4361] Document usage of HBase TableSnapshotInputFormat
[jbonofre] Fix Maven parent version in ParquetIO
[iemejia] [BEAM-4312] Enforce ErrorProne analysis in gearpump runner
[mergebot] Add Apache Kudu IO to the planned IOs table
[mergebot] Add next Java LTS to the WIP section of the contribution guide
[mergebot] Add PubSubIO to Python IO table row
[iemejia] [BEAM-4307] Enforce ErrorProne analysis in
[mergebot] Change ParquetIO status in built-in I/O section
[iemejia] [BEAM-4308] Enforce ErrorProne analysis in runners-core-java
[ammons] Say that merging windows are not supported in Distinct.java.
[lcwik] [BEAM-4411] Update Jackson version to latest to pick up security fixes.
[kenn] Implement UNNEST operator for SQL
[iemejia] [BEAM-4317] Enforce ErrorProne analysis in runners/reference/java
[iemejia] Refine dependencies, make new ones explicit and minor maven plugins
[iemejia] [BEAM-4323] Enforce ErrorProne analysis in sketching extensions
[iemejia] [BEAM-4324] Enforce ErrorProne analysis in sorter extensions
[iemejia] [BEAM-4321] Enforce ErrorProne analysis in join-library extensions
[kenn] Add equals, hashCode, and structuralValue to Nexmark model objects
[thw] [BEAM-4297] Streaming executable stage translation and operator for
[thw] [BEAM-4297] Add serialization test and make output mapping stable.
[lcwik] Add link to design docs and template to the contribution guide.
[timrobertson100] [BEAM-4389] Enable partial updates in ElasticsearchIO
[kenn] Force load of Calcite JDBC driver (avoids internal error)
[kenn] Explicitly load Beam JDBC driver before test
[iemejia] [BEAM-3813] Support (de)serialization of S3 encryption options via
JSON
[Pablo] [BEAM-4426]: Addressed DataflowDistributionAccumulatorTest failure on
[aaltay] Support installing Beam SDK from a wheel distribution in SDK
containers.
[cademarkegard] fix errorprone annotations and enable failOnWarning
[lukasz.gajowy] Add Performance Testing to "Work in Progress" section
[iemejia] Update postgres version to 42.2.2 (Java 8)
[coheigea] Update README to include virtualenv in the build instructions
[iemejia] [BEAM-4356] Enforce ErrorProne analysis in nexmark
[kenn] Finish RowType -> Schema rename
[kenn] Add convenience aliases for nullary type constructors
[kenn] Add MAP field support to Schema.Builder
[kenn] Add static factories for array, row, map types
[kenn] Schema fields are non-null by default
[kenn] TestUtils.RowsBuilder to use FieldType instead of TypeName
[kenn] Clean up CalciteUtils conversions a bit
[Pablo] enable failOnWarning for build-tools
[apilloud] Run everything with shadowJar
[apilloud] guava is on kinesis public API
[apilloud] Fix direct runner shadow config
[kenn] Add more field conveniences to Schema.Builder
[kenn] Remove extraneous RowSqlTypes
[Pablo] [BEAM-4322] Enforce ErrorProne analysis in protobuf extensions project
[apilloud] Run test on shadowJar on a flag
[kenn] Remove Schema.TypeName.type()
[kenn] Remove unsafe builder methods from FieldType
[apilloud] [SQL] Build mega jar for JDBC
[apilloud] [SQL] JDBC Class Loader IT
[ankurgoenka] proto changes to support artifact_staging_id
[ankurgoenka] Doc changes
[ankurgoenka] Renaming artifact_staging_id to staging_session_token
[ankurgoenka] Fixing python code for staging_session_token proto changes
[marek.simunek] [BEAM-4368] add euphoria java 8 dsl documentation section
[coheigea] Avoid fully qualified class names, when there is an existing (static)
[coheigea] Fixing ErrorProne MissingOverrides warnings
[kedin] [SQL] Fix PubsubsJsonIT
[apilloud] [SQL] Init compiler factory with JDBC class loader
[Pablo] clean generated files prior to lint
[ankurgoenka] Fixing java code for staging_session_token proto changes
[ankurgoenka] Go proto update
[amaliujia] Add LIKE operator to Beam SQL.
[kedin] [SQL] Replace planner.compilePipeline() with sqlEnv.parseQuery()
[kedin] [SQL] Add sqlEnv.executeDdl()
[kedin] [SQL] Make planner package-private
[kedin] [SQL] Add factory methods to BeamSqlEnv
[kedin] [SQL] Rename ReadOnlyTableProvider
[coheigea] Fixing some ErrorProne warnings
[github] print() is a function in Python 3
[cademarkegard] [BEAM-4303] Enforce ErrorProne analysis in examples project
[boyuanz] Address BEAM-4328: :beam-sdks-java-io-google-cloud-platform:test
failure
[kedin] [SQL] Wrap SQL parsing exceptions in ParseException
[tgroh] Add an abstraction for State and Timers
[tgroh] DirectRunner Cleanups
[tgroh] Link up the Portable DirectRunner
[tgroh] Reuse ID Generators across Environments
[tgroh] Use the Current Users Container as the Environment
[aromanenko.dev] [BEAM-4421] Fix for issue with reading s3 files using ParquetIO
[github] Fix flaky comparison in log_handler_test.py
[tgroh] Use the Current Users Container as the Environment
[tgroh] Enable Docker in the PortableDirectRunner
[tgroh] Move DirectJobBundleFactory to fn-execution
[tgroh] Cleanups to the PortableDirectRunner
[tgroh] Cleanups and Wiring for the ReferenceRunnerJobService
[amyrvold] [BEAM-4253] Update dataflow worker to fix ParDoTest fails in Dataflow
[kedin] [SQL] Add ParseException to sqlEnv.explain()
[kedin] [SQL] Add integration tests for BigQuery writes
[kedin] Add TestBigQuery rule
[tgroh] Use an UnsupportedArtifactRetrievalService
[altay] Move assert_that's new keyword argument to the end
[jhsueh] [BEAM-4320] Enforce ErrorProne analysis in jackson extensions project
[jiangkai] introduce optimized logic plan
[jiangkai] update
[jiangkai] fix unit tests failed
[iemejia] [BEAM-4310] Enforce ErrorProne analysis in
[jiangkai] address comments
[relax] Now that Dataflow is updated, we can finish updating tests and usages to
[szewinho] [BEAM-3214] Add integration test for HBaseIO.
[iemejia] [BEAM-4137] Remove MongoDB specific options from
[ankurgoenka] Code review comments fixes
[ajamato] Add new metrics protos based on s.apache.org/beam-fn-api-metrics
[jiangkai] separate rules into sets
[amaliujia] Address comments: 1. Use SqlFunction.like to implement like
operator. 2.
[apilloud] [SQL] Use AutoService for jdbc
[apilloud] [SQL] AutoService for TableProvider
[apilloud] [SQL] Don't cache IT results
[apilloud] [SQL] Test that TextIO and Direct Runner work
[apilloud] [SQL] Add context class loader hack
[rober] [BEAM-4276] Add combiner lifting support to Go SDK
[rober] fixup! Address comments.
[herohde] [BEAM-4474] Ensure unbounded Dataflow jobs are submitted as streaming
[herohde] Fix build break due to artifact staging change
[relax] Add a test with ReferenceRunner
[aromanenko.dev] Added design docs page
[aromanenko.dev] Added first intro sentence.
[aromanenko.dev] Moved one doc to other section and added several new docs
[aromanenko.dev] Added more docs
[github] [BEAM-4480] Fixed deprecated method invoking
[lcwik] [BEAM-4481] Remove duplicate definitions of dependencies.
[herohde] [BEAM-4475] Add container boot code to Go precommit
[herohde] [BEAM-4475] Add Go submodule build to Go precommit
[axelmagn] Fix ProvisionInfo in DockerJobBundleFactory
[github] Improve default value for experiments set in RuntimeValueProvider
[cademarkegard] [BEAM-4326] Enforce ErrorProne analysis in the fn-execution
project
[alan] [BEAM-4423] Mark pull requests stale after 60 days; close 7 days after
[jbonofre] Moving to 2.6.0-SNAPSHOT on master branch
[lukasz.gajowy] [BEAM-4415] Add jenkins job for HDFS ParquetIOIT
[lukasz.gajowy] [BEAM-4137] Extract file-related options from
IOTestPipelineOptions
[lukasz.gajowy] [BEAM-4137] Extract postgres related options from
IOTestPipelineOptions
[timrobertson100] [BEAM-4311] Enforce ErrorProne analysis in Flink runner
[github] [BEAM-4517] Add maven status in README
[jiangkai] add expression boolean casting
[coheigea] Removing extraneous whitespace around the equals operator
[katarzyna.kucharczyk] Changed a namespace to parsed job name with current job
number.
[jiangkai] add boolean type for agg function
[jiangkai] support EXISTS operator
[github] Update Environments.java
[github] Remove unneeded collection import.
[github] Combine immutability type fixes. (#3)
[github] fixup!
[lcwik] BEAM-3876 avoid NPE if checkpoint is null in an unbounded source
[lcwik] testing npe fix and exception rethrow in unit tests
[lcwik] Update https://github.com/apache/beam/pull/4894 to correspond with
[github] [BEAM-4276] Add missing scope line
[jiangkai] explain plan unit tests
[lcwik] [BEAM-4517] Add PyPI status badge.
[aljoscha.krettek] [BEAM-3905] Update Flink Runner to Flink 1.5.0
[kedin] [SQL] Manually read rows in TestBigQuery
[robertwb] [BEAM-3981] Cleanup of coders futurization.
[robertwb] Use ByteCountingOutputStream for estimate_size.
[kedin] Add polling assertion support to TestBigQuery
[kedin] [SQL] Add Pubsub to BigQuery E2E integration test
[sidhom] Add reference to ArtifactSourcePool implementation
[sidhom] Clean up FlinkExecutableStageFunction and tests
[sidhom] [BEAM-4523] Implement batch flink executable stage context
[kedin] [SQL] Delete BeamSql
[kedin] [SQL] Rename QueryTransform to SqlTransform
[mergebot] Add SQL area to ongoing projects
[robertwb] Reject unknown arguments in WindowInto.
[mergebot] [BEAM-4488] How to install Python SDK from source [BEAM-4489]
Document
[mergebot] More changes
[mergebot] updates after review
[mergebot] Updating release guide to use Gradle commands.
[mergebot] Addressing comments. Improving commands.
[mergebot] Addressing comments. Improving commands.
[mergebot] Update release guide for publishing source zip from GitHub
[mergebot] Addressing TODOs
[mergebot] Address comments.
[mergebot] Improving.
[mergebot] Add more updates
[mergebot] More updates
[mergebot] Addressed Alan's comments
[mergebot] Add instructions about how to stage python binaries
[mergebot] copy renamed zi[ file to sdks/python/staging subdir
[mergebot] Update gradle publish with --no-parallel --no-daemon
[kenn] Suppress immutability warning caused by LoadingCache in enum instance
[kenn] Make BeamSqlExpression for operators, use it for string operators
[ekirpichov] Add retrieval_token to GetManifestRequest
[ekirpichov] Refactor code that accesses staging_token
[ekirpichov] Regenerate go protobufs
[kenn] Replace project and filter with calc
[kenn] Disable CalcRemoveRule
[szewinho] Improve consistency of hadoop and hbase scripts, fix shellcheck
issues
[iemejia] Fix build (missed auto service for SQL) and model-fn-execution on
Flink
[iemejia] [BEAM-4318] Enforce ErrorProne analysis in Spark runner
[wcn] Encode position ids.
[robertwb] Explain why module namespace is modified in Cython codepath.
[apilloud] [SQL] Make getString more generic
[ankurgoenka] Beam File System based Artifact Staging Service
[ankurgoenka] BeamFileSystemArtifactStagingService Tests
[ankurgoenka] Enhancing test case and error handling.
[ankurgoenka] Enhancing testcases and incorporating review comments.
[ankurgoenka] Review comments Fix
[ankurgoenka] Rebasing
[apilloud] [SQL] Support unquoted table types
[herohde] Remove new Go precommit dependencies due to failures
[jiangkai] address conflicts and comments
[jiangkai] remove volcano plan function
[klk] [SQL] Separate assertions for each expression in ExpressionChecker
[klk] Remove StringOperatorsTest in favor of SQL syntax tests
[mergebot] Add Python Kafka to list of in-progress I/O transforms.
[Pablo] Upgrade Gradle to version 4.8
[ehudm] Remove with_attributes keyword from ReadFromPubSub.
[xiliu] [BEAM-3079] Update samza-runner with more features and improvements
[xiliu] Add missing apache headers
[Scott Wegner] Use new DSL methods for generated POM metadata
[lcwik] [BEAM-4540] Migrate junit/hamcrest to provided scope.
[Scott Wegner] [BEAM-925] Fix FindBugs violations in Dataflow Runner and
re-enable
[Scott Wegner] [BEAM-4313] Fix ErrorProne warnings and enable validation in
Dataflow
[ankurgoenka] Followup PR for #5591
[Scott Wegner] Add support for pre-commit trigger paths
[Scott Wegner] Set path triggers for existing pre-commit test jobs
[rober] Add graph.Fn encoding functions.
[robinyq] Defer calling formatTimestamp() to achieve better performance
[ccy] [BEAM-4549] Use per-pipeline unique ids for side inputs in
[altay] Explain experimental/deprecated from users perspective.
[jiangkai] call SqlFunctions in numeric type conversion
[github] Update Dockerfile for new setup.py changes.
[robbe.sneyders] Futurize utils subpackage
[iemejia] [BEAM-4551] Update spark runner to Spark version 2.3.1
[iemejia] Fix maven build error on sdks/java/io/google-cloud-platform module
[robinyq] Throws exception directly instead of calling checkState()
[github] Remove GPL findbugs dependency (#5609)
[lcwik] Clean-up BeamFnDataBufferingOutboundObserver since Dataflow has migrated
[jiangkai] unit test for BuildExpression literal casting
[aaltay] Futurize portability subpackage (#5385)
[altay] Futurize unpackaged files
[altay] resolved six.string_types equivalency
[altay] Futurize testing subpackage
[altay] Futurize tools subpackage
[altay] Remove old_div
[Scott Wegner] Revert "Merge pull request #5611: [BEAM-4445] Filter pre-commit
[robertwb] [BEAM-4546] Implement hot key fanout for combiners.
[robertwb] Use discaring mode for first level of combine.
[echauchot] [BEAM-4283] Export nexmark query execution times to BigQuery
[echauchot] [BEAM-4283] Make BigQueryIO Services classes public and
experimental and
[echauchot] [BEAM-4283] Fix PerfsToBigQueryTest and serialization issue in
[echauchot] Add Etienne Chauchot's ongoing work to the contribute page.
[fvoichick] Fixed link to nonexistent IsBounded.apply method
[fvoichick] Fixed documentation of default window size in example code
[fvoichick] Fixed inappropriate Javadoc comments
[aaltay] [BEAM-4333] Add integration tests for python mobile games (#5630)
[jiangkai] ignore explain unit test
[kedin] [SQL] Add INSERT tests to JdbcDriverTest
[kedin] [SQL] Add complex type test to JdbcDriverTest
[kedin] [SQL] Make field names case-sensitive
[robertwb] Suppress warning.
[robertwb] Implement BeamFileSystemArtifactSource
[robertwb] Add job submission capabilities to Flink runner.
[robertwb] Update to new JobInvoker/Invocation interface.
[robertwb] Remove references to Flink distributed file cache.
[robertwb] A bit more documentation.
[robertwb] Address comments on Flink code.
[kirpichov] Removed some dead code, fixed some warnings
[kirpichov] Adds tracing of watermarks in direct runner
[kirpichov] Fixes typo in class name
[kirpichov] Simplifies GBK expansion code a bit
[kirpichov] Fixes bug: Processes values arriving for a GBK key sequentially
[kirpichov] Introduces BundleProgressHandler.
[Scott Wegner] Fix ErrorProne violations in direct runner and enable
failOnWarnings
[robertwb] [BEAM-4565] Fix hot key fanout in the face of combiner lifting.
[robertwb] Remove trailing whitespace.
[kirpichov] [BEAM-4473,BEAM-4281] Makes ReferenceRunner use a Direct stream
observer
[ccy] [BEAM-4549] Revert #5623
[kirpichov] [BEAM-4291] Implements distributed artifact retrieval
[kirpichov] Deletes ArtifactSource
[thw] Fix Flink runner Maven build.
[ccy] [BEAM-4549] Fix side inputs for streaming pipelines on Dataflow
[mergebot] [BEAM-2852] Update Nexmark documentation with Kafka support
[mergebot] [BEAM-4479] Fixed document for Coder
[Scott Wegner] Fix ErrorProne violations in fn harness and enable failOnWarnings
[Scott Wegner] fixup! Fix ErrorProne violations in fn harness and enable
failOnWarnings
[Pablo] Improving state sampler Cython annotations.
[Pablo] Adding msecs tracking to side inputs iterator
[Pablo] Adding the sampling thread to side input microbench.
[Pablo] Adding flag to mask change
[Pablo] Fixing all lint raising-format-tuple warnings.
[github] Make build_rules.gradle version of shadow match build.gradle
[Scott Wegner] Temporarily exclude website sources from RAT
[Scott Wegner] fixup! Fix ErrorProne violations in fn harness and enable
failOnWarnings
[ehudm] Increase Jenkins build retention from 14 to 30 days.
[ankurgoenka] Fixing concurrency bug in BeamFileSystemArtifactServicesTest
[iemejia] Fix Maven build 7
[iemejia] [BEAM-4570] Use pagination in
[thw] Fix ValidatesRunner_Apex #5604
[iemejia] [BEAM-4399] Get Cassandra options out of IOTestPipelineOptions
[iemejia] [BEAM-4399] Refactor CassandraIOIT to be writeThenRead
[iemejia] [BEAM-4399] Update Cassandra driver to version 3.5.0
[kenn] Fix name of heuristic JAVA_CLASS_TO_TYPENAME
[kenn] [SQL] Allow explicit return type in ExpressionChecker
[kenn] DSL-level tests for standard operators
[kenn] Add test that all supported operators are tested
[kenn] [SQL] Make parse failure slightly more actionable
[Pablo] Upgrading python dependency on httplib2
[kenn] Fix case sensitivity in JdbcDriverTest
[ehudm] Jupyter notebook for monitoring precommit job times
[lcwik] [BEAM-4576] Add hamcrest dependencies to this scope that was moved to
[mergebot] Add link to @RequiresStableInput design doc
[matthias] Futurize examples subpackage
[apilloud] [SQL] Add parse code for SET
[apilloud] [SQL] Plumb PipelineOptions through BeamRelNode
[apilloud] [SQL] Plumb PipelineOptions through BeamSqlCli
[apilloud] [SQL] Remove unused BeamIOType
[ccy] [BEAM-4582] Fix streaming Create transform on Dataflow
[kirpichov] Propagates artifact retrieval token in Flink runner and to the Java
[ankurgoenka] load beam fileSystems in FnHarness
[axelmagn] Implement new staging token contract in java SDK
[robertwb] Add Impulse primitive to Python SDK
[robertwb] Expand Read to Impulse | ParDo(Split) | ParDo(Read) in Python SDK
[robertwb] Fix default docker image name.
[kirpichov] Add an AddHarnessIdInterceptor
[kirpichov] Remove the runners/reference InProcessManagedChannelFactory
[kirpichov] Allow ManagedChannelFactories to attach Interceptors
[kirpichov] Populate and Use Harness IDs in the Java Harness
[apilloud] [SQL] Set application name to BeamSql
[apilloud] [SQL] Correctly represent pipeline
[apilloud] [SQL] Cleanup table IO functions
[apilloud] [SQL] Simplify overly verbose names
[apilloud] [SQL] Add each Calcite node to Beam graph once
[apilloud] [SQL] Seperate parse from pipeline construction
[Scott Wegner] fixup! Fix ErrorProne violations in fn harness and enable
failOnWarnings
[kirpichov] Fixes checkstyle
[chamikara] Fixes broken links for downloading source releases.
[lcwik] [BEAM-4592] Make Dataflow understand kind:varint as a well known since
[chamikara] Fixes null pointer exception on empty pubsub message data (#5016)
[kirpichov] A couple more trivial changes extracted from #5662
[lcwik] Update Dataflow container images
[katarzyna.kucharczyk] Created static retry method which accepts retriable
method, amount of
[robertwb] Update impulse-based read.
[kenn] Make BeamRelNode take a PCollectionList<Row> always
[rober] Fix build break from PR 5676, which modified method signatures.
[migryz] Implemented working prototype for PostCommit jobs
[migryz] Update post commit jobs to utilize new helper methods
[ankurgoenka] Fix cache references in portable flink runner
[robertwb] [BEAM-4150] Extract IO coders from the RemoteGrpcPort.
[Pablo] Adding ignore parameters for gitattributes
[Scott Wegner] Remove submodule
[robertwb] Fix and test global combine with fanout.
[migryz] Fix typo in _ghprb suffix
[migryz] Update suffix to be PullRequest
[ccy] Revert #5689 to fix build
[ankurgoenka] Remove unused import
[github] Make suffix shorter
[kirpichov] Make ImmutableExecutableStage constructors public
[kirpichov] [BEAM-4285] Implement Flink batch side input handler
[ankurgoenka] Fixing key lookup in
FlinkBatchSideInputHandlerFactory.SideInputHandler
[ekirpichov] Introduces PipelineValidator that checks the well-formedness of a
[cademarkegard] [BEAM-4325] Enforce ErrorProne analysis in the SQL project
[echauchot] [BEAM-4283] Fix naming of the BigQuery fields
[coheigea] Removing some null checks, where we already know that the variable in
[iemejia] [BEAM-3314] Set correctly host and port on RedisIO
[iemejia] [BEAM-3314] Fix error-prone warnings and add extra test for Read
[lcwik] Revert "Revert #5689 to fix build"
[github] Add migration notice to apache/beam website README.me
[robertwb] Always consider Read to be a primitive for dataflow pipelines.
[migryz] Point gearpump to master
[robertwb] [BEAM-4605] Remove subtransform of GBK.
[kenn] Migrate build_rules.gradle to buildSrc plugin
[amaliujia] support unbounded limit.
[aaltay] Fix backlog bytes reported by CountingSource. (#5719)
[mairbek] Fixed utf8 encoding in Cloud Spanner mutation encoder
[robertwb] Don't require a staged SDK for the Python portable worker.
[Pablo] Enabling gradle build to receive extra buildscript repositories
[kenn] Remove build_rules.gradle
[daniel.o.programmer] [BEAM-2937] Comment Combine Grouped Values URN.
[daniel.o.programmer] [BEAM-2973] Moving CombineValues URN to different enum.
[robertwb] Add back old code path for dataflow.
[klk] Fix errors in BeamModulePlugin perf test section
[mergebot] Adds a dependencies guide to Beam Website
[iemejia] Fix maven compile for the 8th time (yay!)
[iemejia] Fix errorprone warnings on extensions/google-cloud-platform-core
module
[iemejia] Enable errorprone globally
[klk] Fix Gearpump validatesRunner gradle config
[robertwb] Stage empty manifest if a staging session is given.
[migryz] [BEAM-4559] Add latest post-commit tests status to GH PR
[sidhom] Add registrars for the portable runner
[sidhom] Add endpoint logging for PortableRunner
[github] dataflow_runner.py: use the pbegin's pipeline
[github] materialize_test.go: delint: non-idiomatic block
[klk] Fix docker gated code paths
[altay] Add instructions about how to perform release validations
[ehudm] Parallelize Java precommits
[Scott Wegner] Spread jenkins load by randomizing daily cron schedule
[amaliujia] logical operator tests
[kirpichov] Adds support for SDF in ULR and the Java SDK.
[klk] Allow specifying delimiter in TextIO
[klk] Migrate some date expressions to operators
[klk] Use label "stale" when closing stale PRs
[kenn] Add support for "lines" format text tables
[kenn] Beam SQL shell prompt is now 'BeamSQL>'
[kenn] Override SqlLine.properties to customize welcome and help messages
[Pablo] Improving documentation for Metrics results
[xiliu] Finalize Samza Runner with gradle and findbugs issues
[amaliujia] add comparison operator test
[ekirpichov] Address easy review comments
[xiliu] Fix a unit test timeout and minor issues in pom.xml
[kirpichov] Handles memoization of encoded key/window in StateAccessor
[kirpichov] Simplifies API of WireCoders and LengthPrefixUnknownCoders.
[sidhom] [BEAM-4615] Flink job server wrapper and shadow jar
[apilloud] [SQL] Don't wait on Unbounded PCollections
[kirpichov] Address comments
[xiliu] [BEAM-4640] Samza runner postcommit ValidatesRunner job
[aaltay] [BEAM-4333] Add integration tests for python mobile games (#5747)
[jiangkai] [BEAM-4602][BEAM-4598] Date type comparison
[github] Cythonizing a few hot calls (#5733)
[daniel.o.programmer] [BEAM-3708] Adding Combine component implementations to
Java SDK
[iemejia] Fix maven build part 9
[xiliu] Remove unused previous names
[daniel.o.programmer] Quick fix, removing commented out code.
[altay] Publish 2.5.0 release
[altay] Change download link for 2.4.0 version to use the archive link
[altay] improvements to fanout
[yifanzou] [BEAM-4302] Add Jenkins job to check Beam dependencies and generate
[ekirpichov] Fixes Flink ValidatesRunner and a compile error
[Scott Wegner] Split pre-commit tests into separate jobs based on trigger
condition.
[Scott Wegner] Filter pre-commit triggering based on touched files
[Scott Wegner] Rename setPostCommit to setAutoJob
[amyrvold] [BEAM-4645] Cleanup docker images on failure
[amaliujia] replace byte[] with String as Map key.
[Scott Wegner] Fix ErrorProne warnings in sdks-java-core project
[Scott Wegner] Enable ErrorProne analysis for all Java projects.
[Scott Wegner] Update Findbugs annotations dependency to version with
[Scott Wegner] Enable failOnWarnings for all projects.
[Pablo] Removing debug string from UserScore.java
[Scott Wegner] Add checkstyle validation to ban usage of @SuppressFBWarnings.
[amyrvold] [BEAM-3261] Fix pipeline failures by waiting for logging server to be
[github] Revert "improvements to fanout"
[klk] Apply rename of JobBuilder to Samza VR job
[kenn] Add bundle-ready SQL shell using application plugin
[relax] Use ByteBuddy to generate a coder class for a specific Schema.
[relax] Subclass proper generic type, removing need for extra typecast.
[relax] Address code-review comments.
[Scott Wegner] Rename refactored Precommit source files to remove GradleBuild
suffix.
[herohde] Run gofmt
[kenn] Reduce stdout spam from BeamModulePlugin
[Scott Wegner] Update Pre-commit job names tracked in precommit_job_times.ipynb
[lcwik] [BEAM-4661] Define well known timer URN.
[herohde] [BEAM-4635] Avoid cross-compiling worker binary if linux-amd64
[klk] Increase website job timeout to 100 by default
[Scott Wegner] Add Apache license headers
[ankurgoenka] Adding flinkMarterUrl as an option
[robertwb] Give the root transform in Python a non-empty name.
[herohde] [BEAM-4635] Do not remove worker binary on Go Dataflow staging
[amaliujia] Improve BigQuery write integration tests and support TIMESTAMP SQL
type
[ryan.blake.williams] [BEAM-2810] use fastavro-blocks in Avro IO
[klk] Fix accidental license header javadoc comments
[klk] Fix HTML error in ApproximateQuantiles
[klk] Turn on spotless java everywhere
[aaltay] [BEAM-4606] Pin pytz version (#5751)
[klk] Do not email individuals about failures in Jenkins
[klk] Pipeline options in JDBC URI; default userAgent=BeamSQL
[klk] Spotless Java everywhere!
[klk] Simplify checkstyle now that spotless is in play
[klk] Temporarily disable JavadocParagraph and LineLength checkstyle
[Scott Wegner] Remove blanket website from rat and add appropriate exclusions.
[github] improvements to fanout (#5800)
[herohde] Do not launch containers with transient semi_persistent_dir. Fails on
[herohde] Go-on-Flink: treat artifact staging EOF error as ok
[herohde] Go-on-Flink: make transform UniqueNames _globally_ unique
[herohde] Go-on-Flink: remove internal java runner class hack
[herohde] Go-on-Flink: fix swapped arguments in artifact staging
[herohde] Go-on-Flink: use clearer error if the artifact retrieval token or
[herohde] Go-on-Flink: fix Go to actually send worker_id gRPC header
[lukasz.gajowy] Remove mvn leftovers from jenkins IOIT job definitions
[klk] Rearrange checkArgument to help findbugs
[chamikara] Reduces the size of pretty string of BigQuery jobs
[mariagh] Add Python Nexmark suite
[herohde] CR: Don't enforce non-empty control worker_id yet
[robertwb] [BEAM-4285] Extend side input handlers to handle multiple access
[robertwb] Rename several MultimapSideInput* classes to more generic SideInput*.
[lcwik] [BEAM-4659] Add well known timer coder to Java SDK.
[kirpichov] Makes fuser materialize PCollections used as side inputs
[ankurgoenka] Uploading job server jar when running on remote flink environment
[ankurgoenka] Passing files to stage on flink explicitly while creating the
[ankurgoenka] Spotless
[ankurgoenka] Job service additionally need google cloud dependency to use GCS
[kirpichov] Makes Python PortableRunner usable via PipelineOptions
[amaliujia] Remove unused system.out.println
[ankurgoenka] TODO to add more file systems
[kirpichov] Brings back hack for embedded FnApiRunner
[robertwb] [BEAM-3883] Stage files in the portability runner.
[robertwb] Fix tests due to api change.
[kirpichov] Changes portableWordCount gradle task to be runnable at master
[kirpichov] Fixes spotless errors at master
[echauchot] [BEAM-2850] Add Nexmark PostCommit runs for spark, flink and direct
[lukasz.gajowy] Rename common_job_properties
[lukasz.gajowy] Rename seed jobs. Make every groovy file processable by jobdsl
plugin
[lukasz.gajowy] Rename inventory job
[lukasz.gajowy] Rename dependency check job
[lukasz.gajowy] Rename and reorganize performance tests
[lukasz.gajowy] Rename and reorganize post commits
[lukasz.gajowy] Rename and reorganize pre commits
[lukasz.gajowy] Rename and reorganize release-related jobs
------------------------------------------
GitHub pull request #5831 of commit 871ef8ac899de06a1c5a08fb8cc307d23e034db3,
has merge conflicts.
Setting status of 871ef8ac899de06a1c5a08fb8cc307d23e034db3 to PENDING with url
https://builds.apache.org/job/beam_SeedJob/2132/ and message: 'Build started
for original commit.'
Using context: Jenkins: Seed Job
[EnvInject] - Loading node environment variables.
Building remotely on beam14 (beam) in workspace
<https://builds.apache.org/job/beam_SeedJob/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git
> +refs/heads/*:refs/remotes/origin/*
> +refs/pull/5831/*:refs/remotes/origin/pr/5831/*
> git rev-parse 871ef8ac899de06a1c5a08fb8cc307d23e034db3^{commit} # timeout=10
Checking out Revision 871ef8ac899de06a1c5a08fb8cc307d23e034db3 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 871ef8ac899de06a1c5a08fb8cc307d23e034db3
Commit message: "Rename and reorganize release-related jobs"
> git rev-list --no-walk 548f2117d48db73fd0e9ce492e7b37e055fc1bdc # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Processing DSL script job_beam_PerformanceTests_Analysis.groovy
ERROR: startup failed:
job_beam_PerformanceTests_Analysis.groovy: 19: unable to resolve class
CommonProperites
@ line 19, column 1.
import CommonProperites as commonProperties
^
1 error
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user
[email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user
[email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user
[email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
