This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch support-spark-preprocessing
in repository https://gitbox.apache.org/repos/asf/pinot.git.
discard 3bdd50c Support data preprocessing in Spark framework
add 44f31ac Clean up the old SegmentZKMetadataPruner (#7281)
add 385b3cf Update reflection lib from 0.9.11 to 0.9.9 (#7277)
add 6fb51d2 Fix status return from compat checker (#7279)
add d40e2d3 update Slack Pinot community invite link (#7284)
add b0acde0 Minor improvement and auto-reformat for
MergeRollupTaskGenerator (#7288)
add 46a4cf7 Fix maven settings file collision (#7287)
add 0ea617f Introduce LIKE Operator (#7214)
add dc90161 quick clean to reduce size of later PRs (#7292)
add dbaf658 Unify segment ZK metadata (#7255)
add fca88a2 fixing npe issue during cleanup pinot-admin (#7291)
add 7b79388 Fix MergeRollupTask uploading segments not updating their
metadata (#7289)
add 3b1c1f0 Adding pinot dropwizard metrics plugin (#7263)
add 50884b7 Add github action workflow for ad-hoc compatibility test
(#7296)
add 7a4eaa9 Show uncompressed znRecord from zk api (#7304)
add 43ffa03 Add TimeUnit to metrics in MinionQueryPhase (#7307)
add 12e5bcd add method to get column indices created in segment folder
(#7297)
add 761c0e7 Enable maven checkstyle plugins by default for all new pinot
components and fix pinot-spi styling (#7308)
add 107255a Acquire and release index buffers in Segment level operator
(#7295)
add f034e28 Null handling for time column (#7269)
add d0b8d88 MergeRollupTask integration tests (#7283)
add c152494 add underscore to obj vars (#7316)
add 5ebabad Add debug endpoint to get minion task status. (#7300)
add a539958 Fix pinot-common code styling (#7311)
add ae83527 Fixing code style for pinot-plugins (#7314)
add aa0792c Support data preprocessing in Spark framework
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3bdd50c)
\
N -- N -- N refs/heads/support-spark-preprocessing (aa0792c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/pinot_compatibility_tests.yml | 52 ++
.../scripts/.pinot_compatibility_verifier.sh | 29 +-
README.md | 2 +-
compatibility-verifier/checkoutAndBuild.sh | 28 +-
config/checkstyle.xml | 29 +-
config/codestyle-intellij.xml | 1 +
config/suppressions.xml | 13 +
pinot-broker/pom.xml | 3 +
.../broker/pruner/PartitionZKMetadataPruner.java | 138 ----
.../pinot/broker/pruner/SegmentPrunerContext.java | 48 --
.../broker/pruner/SegmentZKMetadataPruner.java | 38 -
.../pruner/SegmentZKMetadataPrunerProvider.java | 56 --
.../pruner/SegmentZKMetadataPrunerService.java | 67 --
.../broker/broker/HelixBrokerStarterTest.java | 6 +-
.../broker/pruner/SegmentZKMetadataPrunerTest.java | 64 --
.../routing/segmentpruner/SegmentPrunerTest.java | 97 ++-
.../timeboundary/TimeBoundaryManagerTest.java | 28 +-
pinot-clients/pinot-java-client/pom.xml | 3 +
pinot-clients/pinot-jdbc-client/pom.xml | 3 +
.../main/java/org/apache/pinot/common/Utils.java | 7 +-
.../assignment/InstanceAssignmentConfigUtils.java | 33 +-
.../common/assignment/InstancePartitions.java | 6 +-
.../common/assignment/InstancePartitionsUtils.java | 26 +-
.../pinot/common/exception/QueryException.java | 33 +-
.../common/function/DateTimePatternHandler.java | 3 +
.../pinot/common/function/DateTimeUtils.java | 9 +-
.../function/FunctionDefinitionRegistry.java | 2 +
.../pinot/common/function/FunctionInvoker.java | 10 +-
.../pinot/common/function/FunctionRegistry.java | 10 +-
.../apache/pinot/common/function/TimeZoneKey.java | 43 +-
.../scalar/DataTypeConversionFunctions.java | 6 +-
.../common/function/scalar/DateTimeFunctions.java | 14 +-
.../common/function/scalar/HashFunctions.java | 1 +
.../common/function/scalar/JsonFunctions.java | 8 +-
.../apache/pinot/common/lineage/LineageEntry.java | 4 +-
.../common/lineage/SegmentLineageAccessHelper.java | 13 +-
.../messages/RoutingTableRebuildMessage.java | 1 +
.../pinot/common/metadata/ZKMetadataProvider.java | 215 ++---
.../metadata/instance/InstanceZKMetadata.java | 6 +-
.../segment/LLCRealtimeSegmentZKMetadata.java | 151 ----
.../metadata/segment/OfflineSegmentZKMetadata.java | 135 ----
.../segment/RealtimeSegmentZKMetadata.java | 144 ----
.../metadata/segment/SegmentPartitionMetadata.java | 3 +-
.../common/metadata/segment/SegmentZKMetadata.java | 485 +++++++-----
.../pinot/common/metrics/AbstractMetrics.java | 43 +-
.../apache/pinot/common/metrics/BrokerGauge.java | 18 +-
.../apache/pinot/common/metrics/BrokerMeter.java | 18 +-
.../apache/pinot/common/metrics/BrokerMetrics.java | 3 +-
.../pinot/common/metrics/BrokerQueryPhase.java | 15 +-
.../apache/pinot/common/metrics/BrokerTimer.java | 19 +-
.../pinot/common/metrics/ControllerGauge.java | 18 +-
.../pinot/common/metrics/ControllerMeter.java | 18 +-
.../pinot/common/metrics/ControllerTimer.java | 12 +-
.../apache/pinot/common/metrics/MinionGauge.java | 3 +-
.../pinot/common/metrics/MinionQueryPhase.java | 3 +-
.../apache/pinot/common/metrics/MinionTimer.java | 3 +
.../pinot/common/metrics/PinotMetricUtils.java | 37 +-
.../apache/pinot/common/metrics/ServerGauge.java | 18 +-
.../apache/pinot/common/metrics/ServerMeter.java | 18 +-
.../apache/pinot/common/metrics/ServerMetrics.java | 3 +-
.../pinot/common/metrics/ServerQueryPhase.java | 6 +-
.../apache/pinot/common/metrics/ServerTimer.java | 12 +-
.../pinot/common/metrics/ValidationMetrics.java | 27 +-
.../common/minion/MergeRollupTaskMetadata.java | 3 +-
.../apache/pinot/common/minion/MinionClient.java | 15 +-
.../common/minion/MinionTaskMetadataUtils.java | 40 +-
.../RealtimeToOfflineSegmentsTaskMetadata.java | 3 +-
.../protocols/SegmentCompletionProtocol.java | 71 +-
.../request/context/RequestContextUtils.java | 5 +
.../response/broker/BrokerResponseNative.java | 19 +-
.../common/response/broker/SelectionResults.java | 3 +-
.../common/restlet/resources/ResourceUtils.java | 4 +-
.../restlet/resources/SegmentConsumerInfo.java | 3 +-
.../common/restlet/resources/SegmentErrorInfo.java | 4 +-
.../restlet/resources/SegmentServerDebugInfo.java | 6 +-
.../common/restlet/resources/SegmentSizeInfo.java | 27 +-
.../resources/StartReplaceSegmentsRequest.java | 4 +-
.../restlet/resources/SystemResourceInfo.java | 6 +-
.../restlet/resources/TableMetadataInfo.java | 52 +-
.../common/restlet/resources/TableSegments.java | 10 +-
.../common/restlet/resources/TableSizeInfo.java | 28 +-
.../pinot/common/restlet/resources/TablesList.java | 2 +-
.../segment/generation/SegmentGenerationUtils.java | 13 +-
.../pinot/common/tier/TierSegmentSelector.java | 1 -
.../common/tier/TimeBasedTierSegmentSelector.java | 21 +-
.../common/utils/ClientSSLContextGenerator.java | 6 +-
.../org/apache/pinot/common/utils/DataSchema.java | 10 +-
.../org/apache/pinot/common/utils/DataTable.java | 6 +-
.../common/utils/FileUploadDownloadClient.java | 131 ++--
.../apache/pinot/common/utils/HLCSegmentName.java | 8 +-
.../org/apache/pinot/common/utils/HashUtil.java | 22 +-
.../apache/pinot/common/utils/LLCSegmentName.java | 6 +-
.../org/apache/pinot/common/utils/LLCUtils.java | 3 +
.../LikeToRegexpLikePatternConverterUtils.java | 52 ++
.../pinot/common/utils/NamedThreadFactory.java | 17 +-
.../apache/pinot/common/utils/PinotAppConfigs.java | 54 +-
.../apache/pinot/common/utils/PinotDataType.java | 9 +-
.../pinot/common/utils/PrimitiveArrayUtils.java | 8 +-
.../org/apache/pinot/common/utils/SchemaUtils.java | 12 +-
.../apache/pinot/common/utils/SegmentUtils.java | 45 +-
.../apache/pinot/common/utils/ServiceStatus.java | 76 +-
.../org/apache/pinot/common/utils/StringUtil.java | 9 +-
.../pinot/common/utils/TarGzCompressionUtils.java | 22 +-
.../org/apache/pinot/common/utils/ZkStarter.java | 3 +
.../common/utils/config/TableConfigUtils.java | 28 +-
.../pinot/common/utils/config/TierConfigUtils.java | 16 +-
.../common/utils/fetcher/BaseSegmentFetcher.java | 5 +-
.../common/utils/fetcher/HttpSegmentFetcher.java | 17 +-
.../common/utils/fetcher/HttpsSegmentFetcher.java | 2 +-
.../utils/fetcher/SegmentFetcherFactory.java | 1 +
.../pinot/common/utils/grpc/GrpcQueryClient.java | 3 +-
.../common/utils/grpc/GrpcRequestBuilder.java | 7 +-
.../pinot/common/utils/helix/HelixHelper.java | 67 +-
.../common/utils/helix/LeadControllerUtils.java | 15 +-
.../PinotHelixPropertyStoreZnRecordProvider.java | 23 +-
.../common/utils/request/FilterQueryTree.java | 32 +-
.../pinot/common/utils/request/RequestUtils.java | 4 +-
.../common/utils/webhdfs/WebHdfsV1Client.java | 13 +-
.../utils/BrokerRequestComparisonUtils.java | 58 +-
.../parsers/PinotQuery2BrokerRequestConverter.java | 19 +-
.../pql/parsers/Pql2CompilationException.java | 3 +-
.../org/apache/pinot/pql/parsers/Pql2Compiler.java | 40 +-
.../parsers/pql2/ast/BetweenPredicateAstNode.java | 7 +-
.../pql2/ast/ComparisonPredicateAstNode.java | 8 +-
.../pinot/pql/parsers/pql2/ast/FilterKind.java | 5 +-
.../pql2/ast/FloatingPointLiteralAstNode.java | 10 +-
.../pql/parsers/pql2/ast/FunctionCallAstNode.java | 6 +-
.../pinot/pql/parsers/pql2/ast/OrderByAstNode.java | 15 +-
.../pql/parsers/pql2/ast/PredicateListAstNode.java | 3 +-
.../pinot/pql/parsers/pql2/ast/SelectAstNode.java | 4 +-
.../pql/parsers/pql2/ast/TableNameAstNode.java | 3 +-
.../pql2/ast/TextMatchPredicateAstNode.java | 3 +-
.../pinot/pql/parsers/pql2/ast/TopAstNode.java | 2 +-
.../org/apache/pinot/pql/parsers/utils/Pair.java | 16 +-
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 74 +-
.../pinot/common/data/DateTimeFormatSpecTest.java | 138 ++--
.../apache/pinot/common/data/FieldSpecTest.java | 52 +-
.../org/apache/pinot/common/data/SchemaTest.java | 48 +-
.../function/AggregationFunctionTypeTest.java | 35 +-
.../pinot/common/function/JsonFunctionsTest.java | 67 +-
.../pinot/common/http/MultiGetRequestTest.java | 39 +-
.../pinot/common/lineage/SegmentLineageTest.java | 13 +-
.../metadata/MetadataEqualsHashCodeTest.java | 23 +-
.../pinot/common/metadata/MetadataUtils.java | 3 +
.../RealtimeToOfflineSegmentsTaskMetadataTest.java | 5 +-
.../common/metadata/SegmentZKMetadataTest.java | 103 ++-
.../segment/ColumnPartitionMetadataTest.java | 3 +-
.../pinot/common/metrics/PinotMetricUtilsTest.java | 31 +-
.../pinot/common/minion/MinionClientTest.java | 11 +-
.../protocols/SegmentCompletionProtocolTest.java | 54 +-
.../transform/TransformExpressionTreeTest.java | 4 +-
.../generation/SegmentGenerationUtilsTest.java | 33 +-
.../pinot/common/tier/TierConfigUtilsTest.java | 41 +-
.../pinot/common/tier/TierSegmentSelectorTest.java | 21 +-
.../apache/pinot/common/utils/DataSchemaTest.java | 3 +-
.../pinot/common/utils/EqualityUtilsTest.java | 9 +-
.../common/utils/FileUploadDownloadClientTest.java | 26 +-
.../LikeToRegexpLikePatternConverterUtilsTest.java | 77 ++
.../pinot/common/utils/PinotDataTypeTest.java | 40 +-
.../pinot/common/utils/SegmentNameBuilderTest.java | 14 +-
.../pinot/common/utils/ServiceStatusTest.java | 37 +-
.../apache/pinot/common/utils/URIUtilsTest.java | 16 +-
.../common/utils/config/InstanceUtilsTest.java | 3 +-
.../common/utils/config/TableConfigSerDeTest.java | 54 +-
.../common/utils/config/TableConfigUtilsTest.java | 25 +-
.../common/utils/config/TagNameUtilsTest.java | 7 +-
.../utils/fetcher/SegmentFetcherFactoryTest.java | 3 +-
.../apache/pinot/pql/parsers/Pql2CompilerTest.java | 128 ++-
.../request/BrokerRequestSerializationTest.java | 8 +-
.../pinot/request/BrokerResponseNativeTest.java | 7 +-
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 867 ++++++++-------------
.../test/java/org/apache/pinot/util/TestUtils.java | 6 +-
pinot-connectors/pinot-spark-connector/pom.xml | 3 +
pinot-controller/pom.xml | 3 +
.../api/resources/PinotSegmentRestletResource.java | 15 +-
.../api/resources/PinotTaskRestletResource.java | 9 +
.../api/resources/ServerTableSizeReader.java | 2 +-
.../api/resources/ZookeeperResource.java | 13 +-
.../pinot/controller/api/upload/ZKOperator.java | 50 +-
.../controller/helix/SegmentStatusChecker.java | 6 +-
.../helix/core/PinotHelixResourceManager.java | 57 +-
.../segment/OfflineSegmentAssignment.java | 21 +-
.../helix/core/minion/ClusterInfoAccessor.java | 39 +-
.../core/minion/PinotHelixTaskResourceManager.java | 278 ++++++-
.../realtime/PinotLLCRealtimeSegmentManager.java | 47 +-
.../core/realtime/PinotRealtimeSegmentManager.java | 43 +-
.../core/realtime/SegmentCompletionManager.java | 37 +-
.../segment/DefaultFlushThresholdUpdater.java | 8 +-
.../realtime/segment/FlushThresholdUpdater.java | 8 +-
.../SegmentSizeBasedFlushThresholdUpdater.java | 6 +-
.../helix/core/retention/RetentionManager.java | 29 +-
.../retention/strategy/TimeRetentionStrategy.java | 4 +-
.../helix/core/util/ZKMetadataUtils.java | 3 +-
.../realtime/provisioning/MemoryEstimator.java | 56 +-
.../util/ServerSegmentMetadataReader.java | 34 +-
.../controller/util/TableRetentionValidator.java | 46 +-
.../pinot/controller/util/TableSizeReader.java | 8 +-
.../validation/OfflineSegmentIntervalChecker.java | 31 +-
.../RealtimeSegmentValidationManager.java | 19 +-
.../controller/api/ServerTableSizeReaderTest.java | 18 +-
.../pinot/controller/api/TableSizeReaderTest.java | 7 +-
.../controller/api/upload/ZKOperatorTest.java | 22 +-
.../controller/helix/PinotResourceManagerTest.java | 5 +-
.../controller/helix/SegmentStatusCheckerTest.java | 40 +-
.../helix/core/PinotHelixResourceManagerTest.java | 37 +-
.../OfflineReplicaGroupSegmentAssignmentTest.java | 5 +-
.../PinotLLCRealtimeSegmentManagerTest.java | 58 +-
.../helix/core/realtime/SegmentCompletionTest.java | 14 +-
.../segment/FlushThresholdUpdaterTest.java | 36 +-
.../helix/core/retention/RetentionManagerTest.java | 61 +-
.../strategy/TimeRetentionStrategyTest.java | 29 +-
.../controller/utils/SegmentMetadataMockUtils.java | 14 +-
.../validation/ValidationManagerTest.java | 45 +-
pinot-core/pom.xml | 3 +
.../realtime/HLRealtimeSegmentDataManager.java | 21 +-
.../realtime/LLRealtimeSegmentDataManager.java | 37 +-
.../manager/realtime/RealtimeTableDataManager.java | 37 +-
.../AcquireReleaseColumnsSegmentOperator.java | 68 ++
...a => AcquireReleaseColumnsSegmentPlanNode.java} | 28 +-
.../core/plan/maker/InstancePlanMakerImplV2.java | 47 +-
.../org/apache/pinot/core/util/QueryOptions.java | 4 +
.../realtime/LLRealtimeSegmentDataManagerTest.java | 30 +-
.../queries/FSTBasedRegexpLikeQueriesTest.java | 25 +-
.../pinot/queries/TextSearchQueriesTest.java | 2 +-
.../converter/RealtimeSegmentConverterTest.java | 14 +-
pinot-distribution/pinot-assembly.xml | 4 +
pinot-integration-tests/pom.xml | 3 +
...vertToRawIndexMinionClusterIntegrationTest.java | 7 +-
.../tests/LLCRealtimeClusterIntegrationTest.java | 16 +-
.../MergeRollupMinionClusterIntegrationTest.java | 570 ++++++++++++++
.../tests/OfflineClusterIntegrationTest.java | 32 +-
...rDownloadLLCRealtimeClusterIntegrationTest.java | 45 +-
...fflineSegmentsMinionClusterIntegrationTest.java | 44 +-
...PartitionLLCRealtimeClusterIntegrationTest.java | 23 +-
pinot-minion/pom.xml | 3 +
.../minion/taskfactory/TaskFactoryRegistry.java | 8 +-
pinot-perf/pom.xml | 3 +
.../batch/common/SegmentGenerationJobUtils.java | 2 +
.../batch/hadoop/HadoopSegmentCreationMapper.java | 3 +-
.../ingestion/batch/standalone/JobUtils.java | 2 +
.../pinot/hadoop/PinotHadoopJobLauncher.java | 5 +-
.../pinot/hadoop/io/CombineAvroKeyInputFormat.java | 3 +-
.../apache/pinot/hadoop/io/PinotOutputFormat.java | 8 +-
.../apache/pinot/hadoop/io/PinotRecordWriter.java | 7 +-
.../pinot/hadoop/job/HadoopSegmentCreationJob.java | 7 +-
.../hadoop/job/mappers/SegmentCreationMapper.java | 6 +-
.../HadoopDataPreprocessingHelperFactory.java | 3 +
.../utils/PinotHadoopJobPreparationHelper.java | 3 +
.../hadoop/data/IngestionSchemaValidatorTest.java | 74 +-
.../pinot/hadoop/io/PinotOutputFormatTest.java | 9 +-
.../pinot/ingestion/common/JobConfigConstants.java | 3 +
.../preprocess/DataPreprocessingHelperFactory.java | 6 +-
.../preprocess/SampleTimeColumnExtractable.java | 3 +-
.../mappers/SegmentPreprocessingMapper.java | 9 +-
.../ingestion/utils/DataPreprocessingUtils.java | 7 +-
.../ingestion/utils/InternalConfigConstants.java | 3 +
.../ingestion/utils/JobPreparationHelper.java | 3 +
.../apache/pinot/spark/PinotSparkJobLauncher.java | 5 +-
.../spark/jobs/SparkSegmentCreationFunction.java | 48 +-
.../pinot/spark/jobs/SparkSegmentCreationJob.java | 16 +-
.../pinot/spark/jobs/SparkSegmentTarPushJob.java | 9 +-
.../pinot/spark/jobs/SparkSegmentUriPushJob.java | 3 +-
.../SparkDataPreprocessingHelperFactory.java | 3 +
.../utils/PinotSparkJobPreparationHelper.java | 6 +-
.../pinot/spark}/SegmentCreationSparkTest.java | 7 +-
.../plugin/provider/AzureEnvironmentProvider.java | 36 +-
.../provider/AzureEnvironmentProviderTest.java | 55 +-
.../pinot/plugin/filesystem/ADLSGen2PinotFS.java | 117 ++-
.../pinot/plugin/filesystem/AzurePinotFS.java | 4 +-
.../pinot/plugin/filesystem/AzurePinotFSUtil.java | 6 +-
.../filesystem/test/ADLSGen2PinotFSTest.java | 62 +-
.../plugin/filesystem/test/AzurePinotFSTest.java | 3 +-
.../filesystem/test/AzurePinotFSUtilTest.java | 18 +-
.../pinot-adls/src/test/resources/log4j2.xml | 2 +-
.../apache/pinot/plugin/filesystem/GcsPinotFS.java | 43 +-
.../org/apache/pinot/plugin/filesystem/GcsUri.java | 11 +-
.../pinot/plugin/filesystem/TestGcsPinotFS.java | 315 ++++----
.../apache/pinot/plugin/filesystem/TestGcsUri.java | 73 +-
.../pinot/plugin/filesystem/HadoopPinotFS.java | 16 +-
.../apache/pinot/plugin/filesystem/S3PinotFS.java | 38 +-
.../pinot/plugin/filesystem/S3PinotFSTest.java | 70 +-
.../pinot/plugin/filesystem/S3TestUtils.java | 2 +
.../avro/AvroIngestionSchemaValidator.java | 32 +-
.../plugin/inputformat/avro/AvroSchemaUtil.java | 3 +
.../pinot/plugin/inputformat/avro/AvroUtils.java | 62 +-
.../avro/AvroRecordExtractorComplexTypesTest.java | 83 +-
.../inputformat/avro/AvroRecordExtractorTest.java | 17 +-
.../avro/AvroRecordToPinotRowGeneratorTest.java | 6 +-
.../plugin/inputformat/avro/AvroUtilsTest.java | 102 +--
.../inputformat/avro/KafkaAvroMessageDecoder.java | 51 +-
...aConfluentSchemaRegistryAvroMessageDecoder.java | 17 +-
.../inputformat/csv/CSVRecordExtractorConfig.java | 3 +-
.../inputformat/csv/CSVRecordExtractorTest.java | 5 +-
.../inputformat/csv/CSVRecordReaderTest.java | 11 +-
.../inputformat/json/JSONMessageDecoder.java | 3 +-
.../inputformat/json/JSONRecordExtractorTest.java | 5 +-
.../inputformat/json/JSONRecordReaderTest.java | 6 +-
.../plugin/inputformat/orc/ORCRecordReader.java | 19 +-
.../inputformat/orc/ORCRecordExtractorTest.java | 80 +-
.../inputformat/orc/ORCRecordReaderTest.java | 8 +-
.../parquet/ParquetNativeRecordExtractor.java | 13 +-
.../parquet/ParquetNativeRecordReader.java | 8 +-
.../plugin/inputformat/parquet/ParquetUtils.java | 10 +-
.../parquet/ParquetRecordReaderTest.java | 6 +-
.../inputformat/protobuf/ProtoBufFieldInfo.java | 2 +-
.../protobuf/ProtoBufRecordExtractor.java | 12 +-
.../inputformat/protobuf/ProtoBufRecordReader.java | 3 +-
.../protobuf/ProtoBufRecordExtractorTest.java | 43 +-
.../protobuf/ProtoBufRecordReaderTest.java | 10 +-
.../pinot-protobuf/src/test/resources/log4j2.xml | 2 +-
.../inputformat/thrift/ThriftRecordExtractor.java | 2 +-
.../inputformat/thrift/ThriftRecordReader.java | 3 +-
.../thrift/ThriftRecordExtractorTest.java | 57 +-
.../inputformat/thrift/ThriftRecordReaderTest.java | 9 +-
.../pinot-thrift/src/test/resources/log4j2.xml | 2 +-
.../{pinot-yammer => pinot-dropwizard}/pom.xml | 11 +-
.../metrics/dropwizard/DropWizardHistogram.java | 25 +-
.../metrics/dropwizard/DropwizardCounter.java} | 10 +-
.../metrics/dropwizard/DropwizardGauge.java} | 19 +-
.../metrics/dropwizard/DropwizardJmxReporter.java} | 12 +-
.../metrics/dropwizard/DropwizardMeter.java} | 10 +-
.../metrics/dropwizard/DropwizardMetered.java} | 22 +-
.../metrics/dropwizard/DropwizardMetric.java} | 8 +-
.../metrics/dropwizard/DropwizardMetricName.java} | 21 +-
.../dropwizard/DropwizardMetricsFactory.java} | 14 +-
.../dropwizard/DropwizardMetricsRegistry.java} | 51 +-
.../DropwizardMetricsRegistryListener.java} | 14 +-
.../metrics/dropwizard/DropwizardTimer.java} | 22 +-
.../metrics/yammer/YammerMetricsRegistry.java | 2 +-
pinot-plugins/pinot-metrics/pom.xml | 1 +
.../BaseMultipleSegmentsConversionExecutor.java | 43 +-
.../tasks/BaseSingleSegmentConversionExecutor.java | 35 +-
.../plugin/minion/tasks/BaseTaskExecutor.java | 15 +-
.../pinot/plugin/minion/tasks/MergeTaskUtils.java | 21 +-
.../minion/tasks/SegmentConversionResult.java | 3 +-
.../minion/tasks/SegmentConversionUtils.java | 40 +-
.../ConvertToRawIndexTaskExecutor.java | 15 +-
.../ConvertToRawIndexTaskExecutorFactory.java | 2 +-
.../ConvertToRawIndexTaskGenerator.java | 24 +-
.../MergeRollupTaskExecutor.java | 21 +-
.../MergeRollupTaskExecutorFactory.java | 2 +-
.../MergeRollupTaskGenerator.java | 185 ++---
.../MergeRollupTaskUtils.java | 5 +-
.../minion/tasks/purge/PurgeTaskExecutor.java | 18 +-
.../RealtimeToOfflineSegmentsTaskExecutor.java | 33 +-
...altimeToOfflineSegmentsTaskExecutorFactory.java | 2 +-
.../RealtimeToOfflineSegmentsTaskGenerator.java | 106 ++-
.../SegmentGenerationAndPushResult.java | 5 +-
.../SegmentGenerationAndPushTaskExecutor.java | 47 +-
...egmentGenerationAndPushTaskExecutorFactory.java | 2 +-
.../SegmentGenerationAndPushTaskGenerator.java | 63 +-
.../SegmentGenerationAndPushTaskUtils.java | 4 +-
.../plugin/minion/tasks/MergeTaskUtilsTest.java | 25 +-
.../plugin/minion/tasks/TaskRegistryTest.java | 16 +-
.../MergeRollupTaskExecutorTest.java | 8 +-
.../MergeRollupTaskGeneratorTest.java | 358 +++------
.../MergeRollupTaskUtilsTest.java | 2 +-
.../minion/tasks/purge/PurgeTaskExecutorTest.java | 4 +-
.../RealtimeToOfflineSegmentsTaskExecutorTest.java | 127 +--
...RealtimeToOfflineSegmentsTaskGeneratorTest.java | 152 ++--
.../SegmentGenerationAndPushTaskGeneratorTest.java | 11 +-
.../filebased/FileBasedSegmentWriter.java | 37 +-
.../filebased/FileBasedSegmentWriterTest.java | 88 +--
.../plugin/stream/kafka09/ConsumerAndIterator.java | 5 +-
.../plugin/stream/kafka09/KafkaBrokerWrapper.java | 2 +-
.../stream/kafka09/KafkaConnectionHandler.java | 14 +-
.../stream/kafka09/KafkaConsumerManager.java | 2 +
.../stream/kafka09/KafkaHighLevelStreamConfig.java | 20 +-
.../stream/kafka09/KafkaStreamLevelConsumer.java | 56 +-
.../kafka09/KafkaStreamMetadataProvider.java | 14 +-
.../stream/kafka09/SimpleConsumerMessageBatch.java | 14 +-
.../stream/kafka09/server/KafkaDataProducer.java | 8 +-
.../kafka09/server/KafkaDataServerStartable.java | 2 +-
.../kafka09/KafkaLowLevelStreamConfigTest.java | 4 +-
.../kafka09/KafkaPartitionLevelConsumerTest.java | 68 +-
.../plugin/stream/kafka20/KafkaMessageBatch.java | 14 +-
.../stream/kafka20/KafkaStreamLevelConsumer.java | 72 +-
.../kafka20/KafkaStreamLevelConsumerManager.java | 2 +
.../kafka20/KafkaStreamLevelStreamConfig.java | 39 +-
.../stream/kafka20/server/KafkaDataProducer.java | 14 +-
.../kafka20/server/KafkaDataServerStartable.java | 40 +-
.../stream/kafka/KafkaStreamConfigProperties.java | 3 +
.../stream/kafka/KafkaJSONMessageDecoderTest.java | 5 +-
.../pinot/plugin/stream/kinesis/KinesisConfig.java | 4 +-
.../kinesis/KinesisPartitionGroupOffset.java | 8 +-
.../plugin/stream/kinesis/KinesisConsumerTest.java | 62 +-
.../kinesis/KinesisStreamMetadataProviderTest.java | 66 +-
.../stream/pulsar/MessageIdStreamOffset.java | 2 +-
.../plugin/stream/pulsar/PulsarMessageBatch.java | 14 +-
.../stream/pulsar/PulsarStreamLevelConsumer.java | 30 +-
.../pulsar/PulsarStreamLevelConsumerManager.java | 3 +
.../pulsar/PulsarStreamMetadataProvider.java | 2 +-
.../stream/pulsar/PulsarStandaloneCluster.java | 2 +-
pinot-segment-local/pom.xml | 3 +
.../immutable/ImmutableSegmentImpl.java | 10 +
.../indexsegment/mutable/MutableSegmentImpl.java | 42 +-
.../local/realtime/impl/RealtimeSegmentConfig.java | 20 +-
.../recordtransformer/CompositeTransformer.java | 2 +-
.../recordtransformer/NullValueTransformer.java | 31 +-
.../local/segment/store/FilePerIndexDirectory.java | 43 +-
.../segment/local/segment/store/IndexEntry.java | 12 +-
.../segment/local/segment/store/IndexKey.java | 18 +-
.../segment/store/SegmentLocalFSDirectory.java | 12 +-
.../segment/store/SingleFileIndexDirectory.java | 57 +-
.../segment/local/utils/TableConfigUtils.java | 5 +
.../mutable/MutableSegmentImplTestUtils.java | 4 +-
.../recordtransformer/RecordTransformerTest.java | 96 ++-
.../index/loader/SegmentPreProcessorTest.java | 330 ++++----
.../segment/store/FilePerIndexDirectoryTest.java | 56 +-
.../store/SingleFileIndexDirectoryTest.java | 33 +-
.../segment/local/utils/TableConfigUtilsTest.java | 10 +
pinot-segment-spi/pom.xml | 3 +
.../org/apache/pinot/segment/spi/IndexSegment.java | 20 +-
.../segment/spi/store/ColumnIndexDirectory.java | 21 +-
.../pinot/segment/spi/store/SegmentDirectory.java | 25 +-
pinot-server/pom.xml | 3 +
.../server/api/resources/TableSizeResource.java | 15 +-
.../pinot/server/api/resources/TablesResource.java | 19 +-
.../starter/helix/SegmentFetcherAndLoader.java | 8 +-
.../SegmentOnlineOfflineStateModelFactory.java | 9 +-
.../pinot/server/api/TableSizeResourceTest.java | 30 +-
.../pinot/spi/annotations/InterfaceStability.java | 2 +-
.../annotations/metrics/PinotMetricsFactory.java | 1 +
.../org/apache/pinot/spi/config/ConfigUtils.java | 7 +-
.../org/apache/pinot/spi/config/TableConfigs.java | 3 +-
.../apache/pinot/spi/config/instance/Instance.java | 15 +-
.../pinot/spi/config/table/BloomFilterConfig.java | 3 +-
.../pinot/spi/config/table/CompletionConfig.java | 4 +-
.../apache/pinot/spi/config/table/FieldConfig.java | 30 +-
.../SegmentsValidationAndRetentionConfig.java | 13 +-
.../spi/config/table/StarTreeIndexConfig.java | 9 +-
.../apache/pinot/spi/config/table/TableConfig.java | 9 +-
.../apache/pinot/spi/config/table/TableStatus.java | 9 +-
.../pinot/spi/config/table/TableTaskConfig.java | 3 +-
.../apache/pinot/spi/config/table/TierConfig.java | 9 +-
.../table/assignment/InstanceAssignmentConfig.java | 9 +-
.../InstanceReplicaGroupPartitionConfig.java | 13 +-
.../table/assignment/InstanceTagPoolConfig.java | 11 +-
.../org/apache/pinot/spi/config/tenant/Tenant.java | 5 +-
.../pinot/spi/crypt/PinotCrypterFactory.java | 2 +-
.../apache/pinot/spi/data/DateTimeFieldSpec.java | 11 +-
.../pinot/spi/data/DateTimeFormatPatternSpec.java | 8 +-
.../apache/pinot/spi/data/DateTimeFormatSpec.java | 19 +-
.../pinot/spi/data/DateTimeFormatUnitSpec.java | 6 +-
.../pinot/spi/data/DateTimeGranularitySpec.java | 11 +-
.../apache/pinot/spi/data/DimensionFieldSpec.java | 8 +-
.../java/org/apache/pinot/spi/data/FieldSpec.java | 10 +-
.../org/apache/pinot/spi/data/MetricFieldSpec.java | 3 +-
.../java/org/apache/pinot/spi/data/Schema.java | 56 +-
.../pinot/spi/data/SchemaValidatorFactory.java | 6 +-
.../org/apache/pinot/spi/data/TimeFieldSpec.java | 6 +-
.../apache/pinot/spi/data/TimeGranularitySpec.java | 15 +-
.../apache/pinot/spi/data/readers/GenericRow.java | 11 +-
.../spi/data/readers/RecordReaderFactory.java | 43 +-
.../pinot/spi/env/CommonsConfigurationUtils.java | 3 +-
.../java/org/apache/pinot/spi/env/Environment.java | 1 +
.../apache/pinot/spi/env/PinotConfiguration.java | 115 ++-
.../PinotEnvironmentProvider.java | 9 +-
.../PinotEnvironmentProviderFactory.java | 35 +-
.../spi/exception/EarlyTerminationException.java | 1 -
.../pinot/spi/ingestion/batch/BatchConfig.java | 13 +-
.../spi/ingestion/batch/BatchConfigProperties.java | 3 +
.../spi/ingestion/batch/IngestionJobLauncher.java | 21 +-
.../pinot/spi/ingestion/batch/spec/Constants.java | 3 +
.../batch/spec/SegmentGenerationJobSpec.java | 1 -
.../pinot/spi/ingestion/batch/spec/TlsSpec.java | 24 +-
.../org/apache/pinot/spi/metrics/PinotMeter.java | 1 -
.../org/apache/pinot/spi/metrics/PinotMetered.java | 1 +
.../apache/pinot/spi/plugin/PluginClassLoader.java | 20 +-
.../org/apache/pinot/spi/plugin/PluginManager.java | 20 +-
.../org/apache/pinot/spi/stream/LongMsgOffset.java | 4 +-
.../apache/pinot/spi/stream/OffsetCriteria.java | 7 +-
.../pinot/spi/stream/PartitionGroupConsumer.java | 3 +-
.../stream/PartitionGroupConsumptionStatus.java | 3 +-
.../spi/stream/PartitionGroupMetadataFetcher.java | 6 +-
.../pinot/spi/stream/PartitionLevelConsumer.java | 6 +-
.../spi/stream/PartitionLevelStreamConfig.java | 12 +-
.../org/apache/pinot/spi/stream/StreamConfig.java | 81 +-
.../pinot/spi/stream/StreamConfigProperties.java | 9 +-
.../pinot/spi/stream/StreamConsumerFactory.java | 5 +-
.../spi/stream/StreamConsumerFactoryProvider.java | 1 +
.../pinot/spi/stream/StreamDataProvider.java | 5 +-
.../pinot/spi/stream/StreamDecoderProvider.java | 3 +-
.../pinot/spi/stream/StreamMessageMetadata.java | 1 -
.../pinot/spi/stream/StreamMetadataProvider.java | 7 +-
.../pinot/spi/stream/StreamPartitionMsgOffset.java | 1 +
.../org/apache/pinot/spi/utils/BooleanUtils.java | 2 +
.../apache/pinot/spi/utils/CommonConstants.java | 119 ++-
.../org/apache/pinot/spi/utils/DataSizeUtils.java | 13 +-
.../org/apache/pinot/spi/utils/EqualityUtils.java | 20 +-
.../pinot/spi/utils/GroovyTemplateUtils.java | 3 +
.../pinot/spi/utils/IngestionConfigUtils.java | 34 +-
.../java/org/apache/pinot/spi/utils/JsonUtils.java | 45 +-
.../java/org/apache/pinot/spi/utils/NetUtils.java | 3 +
.../main/java/org/apache/pinot/spi/utils/Pair.java | 16 +-
.../java/org/apache/pinot/spi/utils/Pairs.java | 19 +-
.../pinot/spi/utils/PinotReflectionUtils.java | 10 +-
.../java/org/apache/pinot/spi/utils/ReadMode.java | 3 +-
.../org/apache/pinot/spi/utils/ResourceFinder.java | 2 +
.../org/apache/pinot/spi/utils/TimeConverter.java | 8 +-
.../java/org/apache/pinot/spi/utils/TimeUtils.java | 13 +-
.../org/apache/pinot/spi/utils/TimestampUtils.java | 2 +
.../spi/utils/builder/TableConfigBuilder.java | 16 +-
.../pinot/spi/utils/retry/BaseRetryPolicy.java | 2 +-
.../apache/pinot/spi/config/ConfigUtilsTest.java | 40 +-
.../pinot/spi/config/table/IndexingConfigTest.java | 3 +-
.../pinot/spi/data/DateTimeFieldSpecUtilsTest.java | 44 +-
.../data/readers/AbstractRecordExtractorTest.java | 3 +-
.../spi/data/readers/AbstractRecordReaderTest.java | 15 +-
.../pinot/spi/data/readers/GenericRowTest.java | 1 +
.../spi/data/readers/RecordReaderFactoryTest.java | 4 +-
.../pinot/spi/env/PinotConfigurationTest.java | 17 +-
.../PinotEnvironmentProviderFactoryTest.java | 23 +-
.../pinot/spi/filesystem/LocalPinotFSTest.java | 21 +-
.../pinot/spi/filesystem/PinotFSFactoryTest.java | 6 +-
.../apache/pinot/spi/filesystem/PinotFSTest.java | 69 +-
.../pinot/spi/ingestion/batch/BatchConfigTest.java | 5 +-
.../ingestion/batch/IngestionJobLauncherTest.java | 27 +-
.../apache/pinot/spi/plugin/PluginManagerTest.java | 82 +-
.../pinot/spi/utils/GroovyTemplateUtilsTest.java | 16 +-
.../pinot/spi/utils/IngestionConfigUtilsTest.java | 24 +-
.../org/apache/pinot/spi/utils/JsonUtilsTest.java | 91 ++-
.../apache/pinot/spi/utils/TimeConverterTest.java | 15 +-
.../spi/utils/builder/TableNameBuilderTest.java | 5 +-
.../pinot/spi/utils/retry/RetryPolicyTest.java | 13 +-
pinot-spi/src/test/resources/TestRecordReader.java | 1 +
pinot-spi/src/test/resources/log4j2.xml | 2 +-
pinot-tools/pom.xml | 4 +
.../OfflineSegmentIntervalCheckerCommand.java | 14 +-
.../admin/command/StartServiceManagerCommand.java | 4 +-
pom.xml | 45 +-
531 files changed, 7286 insertions(+), 7660 deletions(-)
create mode 100644 .github/workflows/pinot_compatibility_tests.yml
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/pruner/PartitionZKMetadataPruner.java
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/pruner/SegmentPrunerContext.java
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/pruner/SegmentZKMetadataPruner.java
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/pruner/SegmentZKMetadataPrunerProvider.java
delete mode 100644
pinot-broker/src/main/java/org/apache/pinot/broker/pruner/SegmentZKMetadataPrunerService.java
delete mode 100644
pinot-broker/src/test/java/org/apache/pinot/broker/pruner/SegmentZKMetadataPrunerTest.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/metadata/segment/LLCRealtimeSegmentZKMetadata.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/metadata/segment/OfflineSegmentZKMetadata.java
delete mode 100644
pinot-common/src/main/java/org/apache/pinot/common/metadata/segment/RealtimeSegmentZKMetadata.java
create mode 100644
pinot-common/src/main/java/org/apache/pinot/common/utils/LikeToRegexpLikePatternConverterUtils.java
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/utils/LikeToRegexpLikePatternConverterUtilsTest.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/operator/AcquireReleaseColumnsSegmentOperator.java
copy
pinot-core/src/main/java/org/apache/pinot/core/plan/{DocIdSetPlanNode.java =>
AcquireReleaseColumnsSegmentPlanNode.java} (55%)
create mode 100644
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/MergeRollupMinionClusterIntegrationTest.java
rename
pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/src/test/java/{
=> org/apache/pinot/spark}/SegmentCreationSparkTest.java (96%)
copy pinot-plugins/pinot-metrics/{pinot-yammer => pinot-dropwizard}/pom.xml
(89%)
copy
pinot-common/src/main/java/org/apache/pinot/common/metrics/MinionTimer.java =>
pinot-plugins/pinot-metrics/pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropWizardHistogram.java
(66%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerCounter.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardCounter.java}
(81%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerGauge.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardGauge.java}
(74%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerJmxReporter.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardJmxReporter.java}
(73%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerMeter.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardMeter.java}
(83%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerMetered.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardMetered.java}
(75%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerMetric.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardMetric.java}
(84%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerMetricName.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardMetricName.java}
(73%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerMetricsFactory.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardMetricsFactory.java}
(84%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerMetricsRegistry.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardMetricsRegistry.java}
(58%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerMetricsRegistryListener.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardMetricsRegistryListener.java}
(68%)
copy
pinot-plugins/pinot-metrics/{pinot-yammer/src/main/java/org/apache/pinot/plugin/metrics/yammer/YammerTimer.java
=>
pinot-dropwizard/src/main/java/org/apache/pinot/plugin/metrics/dropwizard/DropwizardTimer.java}
(78%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{convert_to_raw_index
=> converttorawindex}/ConvertToRawIndexTaskExecutor.java (81%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{convert_to_raw_index
=> converttorawindex}/ConvertToRawIndexTaskExecutorFactory.java (95%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{convert_to_raw_index
=> converttorawindex}/ConvertToRawIndexTaskGenerator.java (81%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{merge_rollup
=> mergerollup}/MergeRollupTaskExecutor.java (86%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{merge_rollup
=> mergerollup}/MergeRollupTaskExecutorFactory.java (96%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{merge_rollup
=> mergerollup}/MergeRollupTaskGenerator.java (69%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{merge_rollup
=> mergerollup}/MergeRollupTaskUtils.java (95%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{realtime_to_offline_segments
=> realtimetoofflinesegments}/RealtimeToOfflineSegmentsTaskExecutor.java (88%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{realtime_to_offline_segments
=>
realtimetoofflinesegments}/RealtimeToOfflineSegmentsTaskExecutorFactory.java
(95%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{realtime_to_offline_segments
=> realtimetoofflinesegments}/RealtimeToOfflineSegmentsTaskGenerator.java (75%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{segment_generation_and_push
=> segmentgenerationandpush}/SegmentGenerationAndPushResult.java (94%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{segment_generation_and_push
=> segmentgenerationandpush}/SegmentGenerationAndPushTaskExecutor.java (89%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{segment_generation_and_push
=> segmentgenerationandpush}/SegmentGenerationAndPushTaskExecutorFactory.java
(95%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{segment_generation_and_push
=> segmentgenerationandpush}/SegmentGenerationAndPushTaskGenerator.java (84%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/{segment_generation_and_push
=> segmentgenerationandpush}/SegmentGenerationAndPushTaskUtils.java (95%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/test/java/org/apache/pinot/plugin/minion/tasks/{merge_rollup
=> mergerollup}/MergeRollupTaskExecutorTest.java (95%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/test/java/org/apache/pinot/plugin/minion/tasks/{merge_rollup
=> mergerollup}/MergeRollupTaskGeneratorTest.java (62%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/test/java/org/apache/pinot/plugin/minion/tasks/{merge_rollup
=> mergerollup}/MergeRollupTaskUtilsTest.java (97%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/test/java/org/apache/pinot/plugin/minion/tasks/{realtime_to_offline_segments
=> realtimetoofflinesegments}/RealtimeToOfflineSegmentsTaskExecutorTest.java
(78%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/test/java/org/apache/pinot/plugin/minion/tasks/{realtime_to_offline_segments
=> realtimetoofflinesegments}/RealtimeToOfflineSegmentsTaskGeneratorTest.java
(74%)
rename
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/test/java/org/apache/pinot/plugin/minion/tasks/{segment_generation_and_push
=> segmentgenerationandpush}/SegmentGenerationAndPushTaskGeneratorTest.java
(86%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
