First, in case you were wondering about how things have improved, here’s a
summary of failing tests over the last while:
e-mail date number if distinct tests that failed:
e-mail-2018-06-11.txt: 989
e-mail-2018-06-18.txt: 689
e-mail-2018-06-25.txt: 555
e-mail-2018-07-02.txt: 723
e-mail-2018-07-09.txt: 793
e-mail-2018-07-16.txt: 809
e-mail-2018-07-23.txt: 953
e-mail-2018-07-30.txt: 945
e-mail-2018-08-06.txt: 830
e-mail-2018-08-14.txt: 853
e-mail-2018-08-20.txt: 547
e-mail-2018-08-27.txt: 571
e-mail-2018-09-03.txt: 512
e-mail-2018-09-10.txt: 605
e-mail-2018-09-18.txt: 624
e-mail-2018-10-08.txt: 816
e-mail-2018-12-24.txt: 1050
e-mail-2019-01-08.txt: 655
e-mail-2019-01-15.txt: 421
e-mail-2019-02-12.txt: 347
e-mail-2019-02-18.txt: 341
e-mail-2019-03-04.txt: 279
e-mail-2019-03-11.txt: 301
e-mail-2019-03-18.txt: 275
e-mail-2019-03-25.txt: 279
e-mail-2019-04-01.txt: 288
e-mail-2019-04-08.txt: 288
In case Mark wants a bit to quantify ;).
Here’s the results of this week:
**Annotations will be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 0
********Failures in Hoss' reports for the last 4 rollups.
There were 288 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 1.2 1297 22 BasicAuthIntegrationTest.testBasicAuth
0123 4.0 1283 26 BasicDistributedZkTest.test
0123 0.7 1433 22 DocValuesNotIndexedTest.testGroupingDVOnly
0123 27.8 124 33
HdfsAutoAddReplicasIntegrationTest.testSimple
0123 21.9 97 16
HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
0123 0.7 1387 15 HttpPartitionTest.test
0123 2.1 1236 13 HttpPartitionWithTlogReplicasTest.test
0123 0.5 1390 6 LeaderFailoverAfterPartitionTest.test
0123 0.5 1387 10 LeaderVoteWaitTimeoutTest.basicTest
0123 0.5 1291 7 OverseerTest.testOverseerFailure
0123 0.2 1425 4 ShardSplitTest.testSplitShardWithRule
0123 0.5 1425 7 ShardSplitTest.testSplitShardWithRuleLink
0123 1.6 1330 24 SolrRrdBackendFactoryTest.testBasic
0123 18.5 116 18 StressHdfsTest.test
0123 26.7 110 23
TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit
0123 8.8 1135 61 TestSQLHandler.doTest
0123 1.4 1386 12 UnloadDistributedZkTest.test
Full report attached:
Best,
Erick
DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains
DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
TestLatLonShapeQueries.testRandomBig
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate
Processing file (History bit 3): HOSS-2019-04-01.csv
Processing file (History bit 2): HOSS-2019-03-25.csv
Processing file (History bit 1): HOSS-2019-03-18.csv
Processing file (History bit 0): HOSS-2019-03-11.csv
**Annotated tests that didn't fail in the last 4 weeks.
**Tests removed from the next two lists because they were specified in
'doNotEnable' in the properties file
MoveReplicaHDFSTest.testNormalFailedMove
**Annotations will be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 0
********Failures in Hoss' reports for the last 4 rollups.
There were 288 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 1.2 1297 22 BasicAuthIntegrationTest.testBasicAuth
0123 4.0 1283 26 BasicDistributedZkTest.test
0123 0.7 1433 22 DocValuesNotIndexedTest.testGroupingDVOnly
0123 27.8 124 33
HdfsAutoAddReplicasIntegrationTest.testSimple
0123 21.9 97 16
HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
0123 0.7 1387 15 HttpPartitionTest.test
0123 2.1 1236 13 HttpPartitionWithTlogReplicasTest.test
0123 0.5 1390 6 LeaderFailoverAfterPartitionTest.test
0123 0.5 1387 10 LeaderVoteWaitTimeoutTest.basicTest
0123 0.5 1291 7 OverseerTest.testOverseerFailure
0123 0.2 1425 4 ShardSplitTest.testSplitShardWithRule
0123 0.5 1425 7 ShardSplitTest.testSplitShardWithRuleLink
0123 1.6 1330 24 SolrRrdBackendFactoryTest.testBasic
0123 18.5 116 18 StressHdfsTest.test
0123 26.7 110 23
TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit
0123 8.8 1135 61 TestSQLHandler.doTest
0123 1.4 1386 12 UnloadDistributedZkTest.test
************ Will BadApple all tests above this line except ones listed at the
top**************
012 0.4 1031 5 CategoryRoutedAliasUpdateProcessorTest.test
012 0.4 1030 6
CategoryRoutedAliasUpdateProcessorTest.testMaxCardinality
012 3.8 1033 35
CategoryRoutedAliasUpdateProcessorTest.testSliceRouting
012 0.5 1096 5 OverseerRolesTest.testOverseerRole
012 0.5 1104 9 RollingRestartTest.test
012 0.8 1077 7
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
012 0.5 1075 6
TestCollectionStateWatchers.testWatchesWorkForStateFormat1
012 0.3 885 5
TestDelegationWithHadoopAuth.testDelegationTokenRenew
012 0.2 1092 5 TestSolrConfigHandlerCloud.test
012 2.9 108 5
TimeRoutedAliasUpdateProcessorTest.testPreemptiveCreation
012 2.9 108 3
TimeRoutedAliasUpdateProcessorTest.testSliceRouting
01 3 0.2 1079 3
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
01 3 0.7 1011 6
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
01 3 0.5 1087 4
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
01 3 1.4 1064 9 TestCloudRecovery2.test
01 0.5 796 3
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
01 0.2 789 2
CustomCollectionTest.testRouteFieldForImplicitRouter
01 0.2 797 2
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
01 0.3 783 3 MathExpressionTest.testGammaDistribution
01 0.2 792 2 PeerSyncReplicationTest.test
01 0.5 817 5 ReindexCollectionTest.testBasicReindexing
01 1.4 817 11 ReindexCollectionTest.testFailure
01 0.7 817 6
ReindexCollectionTest.testSameTargetReindexing
01 2.8 796 22 SystemCollectionCompatTest.testBackCompat
01 0.5 777 4
TestCollectionStateWatchers.testSimpleCollectionWatch
01 0.5 777 4
TestCollectionStateWatchers.testWatcherIsRemovedAfterTimeout
01 0.2 780 2 TestIndexWriterDelete.testUpdatesOnDiskFull
0 23 0.2 988 3
ExitableDirectoryReaderTest.testCacheAssumptions
0 23 0.2 866 4 JWTAuthPluginIntegrationTest.testMetrics
0 23 1.0 998 9
NodeMarkersRegistrationTest.testNodeMarkersRegistration
0 23 0.2 985 4
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
0 2 0.2 642 2
CategoryRoutedAliasUpdateProcessorTest.testInvalidMustMatch
0 2 0.2 642 2
CategoryRoutedAliasUpdateProcessorTest.testMustMatch
0 2 0.2 753 2
DocValuesNotIndexedTest.testGroupingDocAbsent
0 2 0.5 705 3 SyncSliceTest.test
0 2 0.7 713 4
TestCloudSearcherWarming.testRepFactor1LeaderStartup
0 3 0.5 683 4
CollectionsAPIDistributedZkTest.testCollectionsAPI
0 3 6.3 69 3 ShardSplitTest.test
0 3 0.7 692 8 SimpleMLTQParserTest.doTest
0 3 0.5 687 3 TestFileListEntityProcessor.testNTOT
0 3 0.2 607 2 TestInPlaceUpdatesDistrib.test
0 3 0.2 683 2
UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues
0 3 0.5 689 3 UtilsToolTest.testRelativePath
0 0.4 452 2
CategoryRoutedAliasUpdateProcessorTest.testNonEnglish
0 0.2 413 1
CollectionsAPISolrJTest.testReadOnlyCollection
0 0.3 397 1
ConcurrentUpdateHttp2SolrClientTest.testConcurrentCollectionUpdate
0 0.5 408 2 DistribCursorPagingTest.test
0 0.2 407 1 DistribJoinFromCollectionTest.testNoScore
0 0.2 417 1 DocValuesNotIndexedTest.testDistribFaceting
0 4.5 22 1 HdfsBasicDistributedZk2Test.test
0 4.5 22 1 HdfsSyncSliceTest.test
0 0.3 397 1
Http2SolrClientTest.testCollectionParameters
0 0.5 406 2
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
0 0.2 408 1 LeaderFailureAfterFreshStartTest.test
0 0.2 404 1 LegacyFieldFacetCloudTest.missingTest
0 0.5 406 2
MetricTriggerIntegrationTest.testMetricTrigger
0 0.7 406 3 MetricsHistoryHandlerTest.testBasic
0 0.2 421 1 ReindexCollectionTest.testReshapeReindexing
0 0.2 401 1 StreamDecoratorTest.testCommitStream
0 0.2 407 1 TestCollectionAPI.test
0 0.2 407 1 TestDynamicLoading.testDynamicLoading
0 0.2 401 1 TestIndexTooManyDocs.testIndexTooManyDocs
0 1.0 403 4
TestIndexWriterThreadsToSegments.testSegmentCountOnFlushRandom
0 0.5 2430 12 TestJsonFacets.testBigger
0 0.5 2430 12 TestJsonFacets.testOverrequest
0 0.5 2430 12 TestJsonFacets.testStatsDistrib
0 0.5 2430 12 TestJsonFacets.testTolerant
0 0.2 407 1 TestLockTree.testLocks
0 0.2 407 1 TestRecovery.stressLogReplay
0 0.2 405 1 TestSolrCloudWithKerberosAlt.testBasics
0 0.7 407 3
TestSolrDeletionPolicy1.testNumCommitsConfigured
0 0.8 400 3
VelocityResponseWriterTest.testCustomParamTemplate
0 0.8 400 3 VelocityResponseWriterTest.testCustomTools
0 0.3 398 1 VelocityResponseWriterTest.testEncoding
0 0.8 400 3
VelocityResponseWriterTest.testFileResourceLoader
0 0.3 398 1 VelocityResponseWriterTest.testInitProps
0 0.8 400 3 VelocityResponseWriterTest.testJSONWrapper
0 0.8 400 3
VelocityResponseWriterTest.testLayoutFeature
0 0.3 398 1
VelocityResponseWriterTest.testLocaleFeature
0 0.3 398 1 VelocityResponseWriterTest.testMacros
0 0.3 398 1
VelocityResponseWriterTest.testParamResourceLoaderDisabled
0 0.3 398 1
VelocityResponseWriterTest.testSolrResourceLoaderTemplate
123 0.3 990 3
ChaosMonkeySafeLeaderWithPullReplicasTest.test
123 1.3 976 8
MissingSegmentRecoveryTest.testLeaderRecovery
123 0.5 953 7 ShardRoutingTest.test
123 9.1 108 15 ShardSplitTest.testSplitWithChaosMonkey
123 0.3 872 21 SolrExporterIntegrationTest.jvmMetrics
123 1.0 837 6
TestReplicationHandlerDiskOverFlow.testDiskOverFlow
123 0.3 977 5
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
12 0.5 677 4
TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister
12 0.3 677 2 TestExportWriter.testStringWithCase
12 0.8 681 9
TestRandomChains.testRandomChainsWithLargeStrings
12 0.3 680 2
TestSimTriggerIntegration.testNodeMarkersRegistration
1 3 0.3 665 2
ActionThrottleTest.testAZeroNanoTimeReturnInWait
1 3 0.3 666 2
ExitableDirectoryReaderTest.testQueryResults
1 3 0.8 651 4 TestLBHttp2SolrClient.testTwoServers
1 3 0.3 651 2 TestRecovery.testExistOldBufferLog
1 3 0.3 677 2 TestSimLargeCluster.testAddNode
1 0.3 381 1 AssignBackwardCompatibilityTest.test
1 0.3 378 1
CdcrVersionReplicationTest.testCdcrDocVersions
1 0.5 382 2 ComputePlanActionTest.testNodeAdded
1 0.3 380 1
CustomCollectionTest.testCreateShardRepFactor
1 21.7 23 5 HdfsChaosMonkeyNothingIsSafeTest.test
1 4.5 22 1
HdfsTlogReplayBufferedWhileIndexingTest.test
1 4.3 23 1 HdfsUnloadDistributedZkTest.test
1 4.2 24 1 HdfsWriteToMultipleCollectionsTest.test
1 0.3 374 1 LegacyFieldFacetCloudTest.perc20Test
1 0.3 383 1 MathExpressionTest.testZipFDistribution
1 0.3 378 1 MinimalSchemaTest.testAllConfiguredHandlers
1 0.3 380 1 OverseerTaskQueueTest.testPeekElements
1 1.0 396 4 ReindexCollectionTest.testLossySchema
1 0.3 390 1 ShardSplitTest.testSplitAfterFailedSplit
1 0.3 313 1
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
1 0.3 376 1 SolrCoreTest.testImplicitPlugins
1 0.3 374 1
SolrExampleStreamingBinaryTest.testCommitWithinOnDelete
1 0.3 377 1
SolrExampleStreamingHttp2Test.testCommitWithinOnDelete
1 0.3 377 1
StatsReloadRaceTest.testParallelReloadAndStats
1 100.0 1 1 TestAvaticaHandler.doTest
1 6.8 293 20 TestBlockPostingsFormat.testFstOffHeap
1 0.3 383 1
TestCloudRecovery.leaderRecoverFromLogOnStartupTest
1 0.3 375 1 TestCloudSchemaless.test
1 0.5 377 2
TestCollectionStateWatchers.testDeletionsTriggerWatches
1 0.3 378 1 TestCoreDiscovery.testTooManyTransientCores
1 0.3 379 1 TestIndexWriterDelete.testDeletesOnDiskFull
1 0.3 382 1 TestLBHttp2SolrClient.testSimple
1 0.3 378 1 TestLazyCores.testLazyLoad
1 0.3 375 1 TestNRTThreads.testNRTThreads
1 0.3 383 1 TestPolicyCloud.testCreateCollection
1 0.5 383 2
TestPolicyCloud.testCreateCollectionAddReplica
1 0.3 383 1
TestPolicyCloud.testCreateCollectionAddShardUsingPolicy
1 0.3 383 1
TestPolicyCloud.testDataProviderPerReplicaDetails
1 0.3 382 1 TestPrepRecovery.testLeaderUnloaded
1 0.3 380 1
TestPullReplicaErrorHandling.testCantConnectToLeader
1 0.3 380 1
TestPullReplicaErrorHandling.testCantConnectToPullReplica
1 0.5 380 2
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
1 0.3 398 1
TestReplicationHandler.doTestIndexAndConfigAliasReplication
1 0.8 380 3 TestScoreJoinQPNoScore.testJoin
1 0.3 379 1 TestV2Request.testCloudSolrClient
23 0.3 508 2 DocValuesNotIndexedTest.testGroupingSorting
23 5.0 42 3 HdfsBasicDistributedZkTest.test
23 0.3 586 2 TestCryptoKeys.test
23 0.6 450 4 TestSimExtremeIndexing.testScaleUp
2 0.3 300 1 ActionThrottleTest.testBasics
2 0.4 267 1 BlobRepositoryMockingTest.testCachedAlready
2 0.4 267 1 BlobRepositoryMockingTest.testCloudOnly
2 0.4 267 1
BlobRepositoryMockingTest.testGetBlobIncrRefString
2 0.4 267 1
BlobRepositoryMockingTest.testGetBlobIncrRefStringDecoder
2 3.7 27 1
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
2 0.3 297 1 CloudExitableDirectoryReaderTest.test
2 0.3 299 1
ComputePlanActionTest.testSelectedCollections
2 0.3 296 1 DistributedFacetPivotSmallTest.test
2 0.3 297 1 InfixSuggestersTest.testReloadDuringBuild
2 0.3 297 1 LegacyNoFacetCloudTest.uniqueTest
2 4.5 22 1 MoveReplicaHDFSTest.test
2 0.4 268 1 OverseerTest.testShardLeaderChange
2 0.4 267 1
SchemaWatcherTest.testDiscardReaderReference
2 0.4 267 1 SchemaWatcherTest.testProcess
2 0.3 297 1 SearchRateTriggerTest.testWaitForElapsed
2 0.3 299 1
SolrExampleStreamingBinaryHttp2Test.testCommitWithinOnDelete
2 0.3 298 1
SysPropSSLCredentialProviderTest.testGetCredentials
2 2.9 307 9
TestBackwardsCompatibility.testAllVersionsTested
2 0.7 300 2
TestCollectionStateWatchers.testPredicateFailureTimesOut
2 0.3 296 1
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
2 0.3 302 1
TestConcurrentFacetedIndexing.testConcurrency
2 0.3 302 1
TestConcurrentMergeScheduler.testFlushExceptions
2 1.6 304 5 TestRandomChains.testRandomChains
2 0.3 310 1
TestReplicationHandler.doTestIndexAndConfigReplication
2 0.8 131 1
TestSimLargeCluster.testCreateLargeSimCollections
2 0.3 298 1 TestSimLargeCluster.testNodeLost
2 0.3 295 1
TestSolrCLIRunExample.testTechproductsExample
2 0.4 223 1
TestSolrCloudWithSecureImpersonation.testForwarding
2 0.4 256 1 TestSynonymQuery.testBoosts
2 0.4 254 1 TestWithCollection.testAddReplicaWithPolicy
3 0.4 283 1 AutoScalingHandlerTest.testReadApi
3 0.4 281 1 BasicFunctionalityTest.testDateMath
3 5.0 20 1 CdcrOpsAndBoundariesTest.testOps
3 0.4 243 1
CloudHttp2SolrClientTest.stateVersionParamTest
3 0.3 324 1
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
3 0.4 276 1
CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
3 0.4 284 1
DeleteReplicaTest.deleteReplicaFromClusterState
3 0.4 284 1 DistribJoinFromCollectionTest.testScore
3 4.0 25 1
LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
3 9.9 71 7 LeaderTragicEventTest.test
3 31.3 16 5 OpenCloseCoreStressTest.test10Minutes
3 0.4 227 1
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
3 0.3 290 1
TestAssertingStoredFieldsFormat.testRamBytesUsed
3 0.3 290 1
TestAssertingTermVectorsFormat.testRamBytesUsed
3 0.3 286 1
TestCloudCollectionsListeners.testWatchesWorkForBothStateFormats
3 1.7 290 5 TestDistributedGrouping.test
3 0.3 292 1 TestIndexFileDeleter.testExcInDecRef
3 1.0 288 3 TestLogWatcher.testLog4jWatcher
3 1.1 261 3 TestPKIAuthenticationPlugin.test
3 0.4 284 1
TestReplicationHandler.doTestIndexFetchOnMasterRestart
3 0.4 280 1
TestRequestForwarding.testMultiCollectionQuery
3 0.4 280 1
TestSegmentSorting.testSegmentTerminateEarly
3 0.7 282 2 TestSimComputePlanAction.testNodeAdded
3 1.0 297 3 TestSimLargeCluster.testSearchRate
3 0.4 279 1 TestSimNodeLostTrigger.testRestoreState
3 0.5 210 1 TestSystemCollAutoCreate.testAutoCreate
3 2.0 293 6 TestTolerantSearch.testGetTopIdsPhaseError
***********************Annotations report
Number of AwaitsFix: 46 Number of BadApples: 13
*****************AwaitsFix Annotations:
************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)
TestICUNormalizer2CharFilter.testRandomStrings
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)
TestICUTokenizerCJK.TestICUTokenizerCJK suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)
TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)
************Solr AwaitsFix
CdcrBidirectionalTest.testBiDir
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)
CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)
CollectionsAPISolrJTest.testCreateAndDeleteShard
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)
ComputePlanActionTest.testNodeLost
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"
IndexSizeTriggerTest.testMaxOps
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
IndexSizeTriggerTest.testMergeIntegration
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
IndexSizeTriggerTest.testMixedBounds
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
IndexSizeTriggerTest.testSplitIntegration
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
IndexSizeTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
LeaderTragicEventTest.LeaderTragicEventTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)
MoveReplicaHDFSTest.testFailedMove
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) //
added 03-Oct-2018
ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
ReplaceNodeNoTargetTest.test
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
SSLMigrationTest.SSLMigrationTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
SaslZkACLProviderTest.testSaslZkACLProvider
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)
ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
ScheduledTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
added 20-Sep-2018
SearchRateTriggerIntegrationTest.testDeleteNode
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)
SearchRateTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
Tagger2Test.testStopWords
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)
TestCollapseQParserPlugin.testStringCollapse
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974";)
TestHdfsCloudBackupRestore.TestHdfsCloudBackupRestore suite
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12866";)
TestHierarchicalDocBuilder.testThreeLevelHierarchy
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) //
this test fails easily under beasting
TestImpersonationWithHadoopAuth.testForwarding
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)
TestJsonFacetRefinement.testProcessEmptyRefinement
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestLTRReRankingPipeline.testDifferentTopN
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)
TestLocalFSCloudBackupRestore.TestLocalFSCloudBackupRestore suite
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12866";)
TestMinMaxOnMultiValuedField.testDoubleFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testFloatFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testIntFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testLongFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMiniSolrCloudClusterSSL.after
assumeFalse("@AwaitsFix: SOLR-12988 - ssl issues on Java 11/12",
Constants.JRE_IS_MINIMUM_JAVA11);
TestPullReplica.TestPullReplica suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
TestSSLRandomization.testRandomizedSslAndClientAuth
assumeFalse("@AwaitsFix: SOLR-12988 - ssl issues on Java 11/12",
Constants.JRE_IS_MINIMUM_JAVA11);
TestSimComputePlanAction.testNodeLost
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) //
if you beast this, eventually you will see
TestSimExtremeIndexing.TestSimExtremeIndexing suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)
TestSimLargeCluster.testBasic
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
this test hits a timeout easily
TestStressRecovery.TestStressRecovery suite
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 6-Sep-2018
TestTlogReplica.TestTlogReplica suite
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12313";)
*****************BadApple Annotations:
************Lucene BadApple
************Solr BadApple
BlockCacheTest.BlockCacheTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 12-Jun-2018
FullSolrCloudDistribCmdsTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
HdfsNNFailoverTest.HdfsNNFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 12-Jun-2018
HdfsRecoveryZkTest.HdfsRecoveryZkTest suite
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
MoveReplicaHDFSTest.testNormalFailedMove
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
14-Oct-2018
MultiThreadedOCPTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// added 20-Jul-2018
SolrZkClientTest.testSimpleUpdateACLs
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
6-Sep-2018
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
TestDistributedStatsComponentCardinality.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
14-Oct-2018
TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
@LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-13059";)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
