I've attached the latest. I was chatting offline and "it was noted"
that these reports are pretty big, which encourages people to not
read, well, all 977 lines. Here's what I'll try to do:

The "interesting" part of the report is the tests  I'll change, i.e.
annotate or un-annotate. The rest if background in case people are
interested.

I can put the _actions_ I'll take on Thursday in the body of the email
and attach the full file for background.

----------------------------

  **Annotations will be removed from the following tests because they
haven't failed in the last 4 weeks.

   CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   ChaosMonkeySafeLeaderTest.test
   CollectionsAPIDistributedZkTest.testCollectionsAPI
   ComputePlanActionTest.testNodeLost
   ConcurrentCreateRoutedAliasTest
   DeleteReplicaTest.deleteReplicaOnIndexing
   DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   IndexSizeTriggerTest
   LeaderFailoverAfterPartitionTest.test
   LeaderVoteWaitTimeoutTest.basicTest
   NodeLostTriggerTest.testListenerAcceptance
   ReplaceNodeNoTargetTest
   ReplaceNodeNoTargetTest.test
   TestCollapseQParserPlugin.testStringCollapse
   TestHdfsUpdateLog.testFSThreadSafety
   TestInPlaceUpdatesDistrib.test
   TestMinMaxOnMultiValuedField.testDoubleFieldCache
   TestMinMaxOnMultiValuedField.testFloatFieldCache
   TestMinMaxOnMultiValuedField.testIntFieldCache
   TestMinMaxOnMultiValuedField.testLongFieldCache
   TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   TestSQLHandler.doTest
   UIMABaseAnalyzerTest.testRandomStrings
   UIMABaseAnalyzerTest.testRandomStringsWithConfigurationParameters
   UIMATypeAwareAnalyzerTest.testRandomStrings
   UnloadDistributedZkTest.test

************ Will BadApple these tests **************
   Report   Pct     runs    fails           test
     0123   5.2     2022    101      CdcrBidirectionalTest.testBiDir
     0123   0.9     1877      9
DeleteReplicaTest.deleteReplicaFromClusterState
     0123  13.4     2088    435      IndexSizeTriggerTest.testMergeIntegration
     0123  25.0     2330    288      IndexSizeTriggerTest.testMixedBounds
     0123  36.8     2088    744      IndexSizeTriggerTest.testSplitIntegration
     0123  17.4     2239    399      IndexSizeTriggerTest.testTrigger
     0123   0.2     1860      5      RecoveryZkTest(suite)
     0123   0.2     1861      6      RecoveryZkTest.test
     0123   0.6     1877     34      SolrRrdBackendFactoryTest.testBasic
     0123   0.4     1866      8      TestCloudPivotFacet.test
     0123   1.5     2020    103      TestComputePlanAction.testNodeAdded
     0123   2.2     1932     52      TestExecutePlanAction.testExecute
     0123   2.8      138      7
TestGenericDistributedQueue.testDistributedQueue
     0123  26.0      567    129      TestLargeCluster.testAddNode
     0123   0.2     1910     15      TestRandomChains.testRandomChains
     0123   1.0     1908     33
TestRandomChains.testRandomChainsWithLargeStrings
     0123   5.8     1600     79      TestRecovery.testExistOldBufferLog


Also note that I expect a little thrashing because I'm un-annotating
tests. That's why I'm commenting them out rather than removing them,
if failures start to thrash we'll know.

Erick
DO NOT ENABLE LIST:
    'IndexSizeTriggerTest.testMergeIntegration'
    'IndexSizeTriggerTest.testMixedBounds'
    'IndexSizeTriggerTest.testSplitIntegration'
    'IndexSizeTriggerTest.testTrigger'
    'TestControlledRealTimeReopenThread.testCRTReopen'
    'TestICUNormalizer2CharFilter.testRandomStrings'
    'TestICUTokenizerCJK'
    'TestImpersonationWithHadoopAuth.testForwarding'
    'TestLTRReRankingPipeline.testDifferentTopN'
    'TestRandomChains'

Processing file (History bit 3): HOSS-06-25.csv
Processing file (History bit 2): HOSS-06-18.csv
Processing file (History bit 1): HOSS-06-11.csv
Processing file (History bit 0): HOSS-06-05.csv


**Annotated tests/suites that didn't fail in the last 4 weeks.

  **Tests and suites removed from the next two lists because they were 
specified in 'doNotEnable' in the properties file
     TestControlledRealTimeReopenThread.testCRTReopen
     TestICUNormalizer2CharFilter.testRandomStrings
     TestICUTokenizerCJK
     TestImpersonationWithHadoopAuth.testForwarding
     TestLTRReRankingPipeline.testDifferentTopN

  **Annotations will be removed from the following tests because they haven't 
failed in the last month.

  **Methods: 26
   CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   ChaosMonkeySafeLeaderTest.test
   CollectionsAPIDistributedZkTest.testCollectionsAPI
   ComputePlanActionTest.testNodeLost
   ConcurrentCreateRoutedAliasTest
   DeleteReplicaTest.deleteReplicaOnIndexing
   DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   IndexSizeTriggerTest
   LeaderFailoverAfterPartitionTest.test
   LeaderVoteWaitTimeoutTest.basicTest
   NodeLostTriggerTest.testListenerAcceptance
   ReplaceNodeNoTargetTest
   ReplaceNodeNoTargetTest.test
   TestCollapseQParserPlugin.testStringCollapse
   TestHdfsUpdateLog.testFSThreadSafety
   TestInPlaceUpdatesDistrib.test
   TestMinMaxOnMultiValuedField.testDoubleFieldCache
   TestMinMaxOnMultiValuedField.testFloatFieldCache
   TestMinMaxOnMultiValuedField.testIntFieldCache
   TestMinMaxOnMultiValuedField.testLongFieldCache
   TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   TestSQLHandler.doTest
   UIMABaseAnalyzerTest.testRandomStrings
   UIMABaseAnalyzerTest.testRandomStringsWithConfigurationParameters
   UIMATypeAwareAnalyzerTest.testRandomStrings
   UnloadDistributedZkTest.test

  **Suites: 0


********Failures in Hoss' reports for the last 4 collected reports.

There were 555 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   5.2     2022    101      CdcrBidirectionalTest.testBiDir
     0123   0.9     1877      9      
DeleteReplicaTest.deleteReplicaFromClusterState
     0123  13.4     2088    435      IndexSizeTriggerTest.testMergeIntegration
     0123  25.0     2330    288      IndexSizeTriggerTest.testMixedBounds
     0123  36.8     2088    744      IndexSizeTriggerTest.testSplitIntegration
     0123  17.4     2239    399      IndexSizeTriggerTest.testTrigger
     0123   0.2     1860      5      RecoveryZkTest(suite)
     0123   0.2     1861      6      RecoveryZkTest.test
     0123   0.6     1877     34      SolrRrdBackendFactoryTest.testBasic
     0123   0.4     1866      8      TestCloudPivotFacet.test
     0123   1.5     2020    103      TestComputePlanAction.testNodeAdded
     0123   2.2     1932     52      TestExecutePlanAction.testExecute
     0123   2.8      138      7      
TestGenericDistributedQueue.testDistributedQueue
     0123  26.0      567    129      TestLargeCluster.testAddNode
     0123   0.2     1910     15      TestRandomChains.testRandomChains
     0123   1.0     1908     33      
TestRandomChains.testRandomChainsWithLargeStrings
     0123   5.8     1600     79      TestRecovery.testExistOldBufferLog
************ Will BadApple all tests above this line **************



     012  100.0       14     14      
CdcrReplicationDistributedZkTest.testBatchAddsWithDelete
     012  100.0       13     13      
CdcrReplicationDistributedZkTest.testBatchBoundaries
     012  100.0       14     14      
CdcrReplicationDistributedZkTest.testBufferOnNonLeader
     012  100.0       13     13      CdcrReplicationDistributedZkTest.testOps
     012  100.0       13     13      
CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange
     012  100.0       14     14      
CdcrReplicationDistributedZkTest.testReplicationAfterRestart
     012  100.0       14     14      
CdcrReplicationDistributedZkTest.testReplicationStartStop
     012  100.0       13     13      
CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget
     012  100.0       14     14      
CdcrReplicationDistributedZkTest.testUpdateLogSynchronisation
     012    0.2     1454      3      
CollectionsAPIDistributedZkTest.testCreateNodeSet
     012    0.2     1363      5      
MoveReplicaHDFSFailoverTest.testOldReplicaIsDeletedInRaceCondition
     012    0.5     1141      6      SaslZkACLProviderTest(suite)
     012    0.3     1144      5      SaslZkACLProviderTest.testSaslZkACLProvider
     01 3  16.8     1068     95      
TestReplicationHandler.doTestStressReplication
     01 3   9.1     1443     64      TestStressCloudBlindAtomicUpdates(suite)
     01 3   5.6     1664     82      TestTimeSource.testEpochTime
     01     0.2     1045      8      AddBlockUpdateTest.testBasics
     01     0.4     1048     11      AddBlockUpdateTest.testExceptionThrown
     01     0.6      979     27      
AddBlockUpdateTest.testExceptionThrownChildDocWAnonymousChildren
     01     0.2     1045      8      AddBlockUpdateTest.testSolrJXML
     01     0.6      979     27      AddBlockUpdateTest.testSolrNestedFieldsList
     01     0.6      981     29      
AddBlockUpdateTest.testSolrNestedFieldsSingleVal
     01     0.2     1026      2      
ChaosMonkeyNothingIsSafeWithPullReplicasTest(suite)
     01     0.2     1030      2      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
     01     0.2     1032      3      
CollectionsAPISolrJTest.testAddAndDeleteReplica
     01     0.2     1031      2      DistributedSuggestComponentTest.test
     01     0.2     1034      2      EchoParamsTest(suite)
     01     0.2      921      2      
HDFSCollectionsAPITest.testDataDirIsNotReused
     01    66.7        6      4      HdfsRestartWhileUpdatingTest(suite)
     01    33.3        7      3      HdfsRestartWhileUpdatingTest.test
     01     0.4      540      3      MathExpressionTest.testDistributions
     01     0.6     1021      7      MetricsHistoryHandlerTest(suite)
     01     0.4     1036      5      PeerSyncTest.test
     01     0.6      538      8      ReplicationFactorTest.test
     01    74.1       29     22      SharedFSAutoReplicaFailoverTest(suite)
     01     0.2     1048      2      TestIndexWriterDelete(suite)
     01     0.2     1048      2      TestIndexWriterDelete.testDeletesOnDiskFull
     01     0.2     1031      2      TestNamedUpdateProcessors.test
     01     0.4     1052      4      TestRecovery(suite)
     01     0.2     1092      2      TestRecovery.testDropBuffered
     01     0.2     1093      2      
TestRecovery.testLogReplayWithReorderedDBQInsertingChildnodes
     01     0.2     1032      2      TestReplicationHandlerBackup.doTestBackup
     01     0.2      522      2      
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
     01     0.2     1044      2      
TestSolrEntityProcessorEndToEnd.testFullImportWrongSolrUrl
     0 23   0.2     1373      4      LeaderFailureAfterFreshStartTest.test
     0 23   4.7      593     36      MoveReplicaHDFSTest.testFailedMove
     0 23   0.2     1353      4      SolrCollectorTest(suite)
     0 23   0.2     1355      3      TestCloudJSONFacetSKG.testBespoke
     0 23   0.9     1378      7      
TestCloudRecovery.leaderRecoverFromLogOnStartupTest
     0 23   0.2     1298      3      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     0 2    0.2      939      3      DistributedFacetPivotSmallTest.test
     0 2    0.8      550      6      MoveReplicaHDFSTest.testNormalMove
     0 2    0.2      944      5      NoFacetTest(suite)
     0 2    0.4      938      4      OrderedExecutorTest(suite)
     0 2    0.2      941      2      OrderedExecutorTest.testLockWhenQueueIsFull
     0 2    0.2      944      5      PivotFacetTest(suite)
     0 2    0.2      982      2      TestExecutePlanAction.testIntegration
     0 2    0.2      999      2      TestRecovery.testCleanShutdown
     0 2    0.2      999      2      
TestRecovery.testLogReplayWithReorderedDBQUpdateWithDifferentChildCount
     0 2    0.2      940      2      TestSolrConfigHandlerConcurrent.test
     0 2    0.4      955      3      
TestStressCloudBlindAtomicUpdates.test_dv_stored_idx
     0 2    0.9      955      6      
TestStressCloudBlindAtomicUpdates.test_stored_idx
     0  3   0.8      884      6      AutoscalingHistoryHandlerTest(suite)
     0  3   0.2      940      2      BasicDistributedZk2Test.test
     0  3   0.2      929      2      ComputePlanActionTest.testNodeAdded
     0  3   0.4      826      4      HdfsLockFactoryTest(suite)
     0  3   1.0      946      9      StreamDecoratorTest(suite)
     0  3   0.2      929      2      TestBulkSchemaConcurrent.test
     0  3   0.2      931      2      
TestDistributedStatsComponentCardinality.test
     0  3   0.2      967      2      
TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreads
     0  3   0.7      710      4      TestRequestStatusCollectionAPI(suite)
     0  3   0.2      951      3      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
     0  3   0.6      945      4      
TestStressCloudBlindAtomicUpdates.test_dv_idx
     0      0.2      522      1      ActionThrottleTest(suite)
     0      0.4      530      2      ActionThrottleTest.testBasics
     0      0.2      520      1      AliasIntegrationTest(suite)
     0      0.6      519      3      AsyncCallRequestStatusResponseTest(suite)
     0      0.6      473      3      AutoAddReplicasIntegrationTest(suite)
     0      0.2      522      1      CarrotClusteringEngineTest(suite)
     0      0.2      522      1      CastingFloatValueTest(suite)
     0      0.4      519      2      CdcrVersionReplicationTest(suite)
     0      0.2      519      1      
CdcrVersionReplicationTest.testCdcrDocVersions
     0      0.2      522      1      CeilingFunctionTest(suite)
     0      0.4      250      1      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
     0      0.2      516      1      CloneFieldUpdateProcessorFactoryTest(suite)
     0      0.2      522      1      ClusteringComponentTest(suite)
     0     27.5      641    176      
CollectionAdminRequestRequiredParamsTest.testCreateCollection
     0      0.6      521      3      CollectionReloadTest(suite)
     0      0.2      523      1      ConcurrentUpdateSolrClientTest(suite)
     0      0.2      516      1      ConfigureRecoveryStrategyTest(suite)
     0      0.2      522      1      DateMathFunctionTest(suite)
     0      0.4      523      2      DistributedClusteringComponentTest(suite)
     0      0.2      523      1      DistributedClusteringComponentTest.test
     0      0.4      516      2      
DistributedQueryComponentOptimizationTest(suite)
     0      0.2      513      1      DistributedSuggestComponentTest(suite)
     0      0.2      524      1      DistributedTermsComponentTest.test
     0      0.2      521      1      
DistributedVersionInfoTest.testReplicaVersionHandling
     0      0.2      477      1      DocValuesNotIndexedTest.testGroupingDVOnly
     0      0.2      477      1      
DocValuesNotIndexedTest.testGroupingDocAbsent
     0      0.4      522      2      DoubleFieldsTest(suite)
     0      0.2      522      1      EqualFunctionTest(suite)
     0      0.4      516      2      
ExitableDirectoryReaderTest.testCacheAssumptions
     0      0.2      516      1      
ExitableDirectoryReaderTest.testQueryResults
     0      0.2      522      1      ExpressionFactoryTest(suite)
     0      0.2      516      1      ExtractingRequestHandlerTest(suite)
     0      1.1      270      3      ForceLeaderTest.testReplicasInLIRNoLeader
     0      0.2      522      1      GTEFunctionTest(suite)
     0      0.2      440      1      
HadoopSSLCredentialProviderTest.testConstructorRequiresCredPath
     0      0.2      440      1      
HadoopSSLCredentialProviderTest.testGetCredentials
     0      0.5      423      2      
HdfsAutoAddReplicasIntegrationTest.testSimple
     0     20.0        5      1      
HdfsCollectionsAPIDistributedZkTest.moveReplicaTest
     0     70.0       20     14      
HdfsTlogReplayBufferedWhileIndexingTest(suite)
     0      0.2      523      1      HttpSolrClientBuilderTest(suite)
     0      0.4      522      2      IntFieldsTest(suite)
     0      0.2      523      1      LBHttpSolrClientBuilderTest(suite)
     0      0.2      524      1      
LBHttpSolrClientTest.testLBHttpSolrClientHttpClientResponseParserStringArray
     0      0.4      474      2      
LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
     0      0.2      474      1      
LIRRollingUpdatesTest.testNewLeaderOldReplica
     0      0.4      474      2      
LIRRollingUpdatesTest.testNewReplicaOldLeader
     0      0.2      522      1      
LangDetectLanguageIdentifierUpdateProcessorFactoryTest(suite)
     0      0.2      475      1      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
     0      0.2      522      1      LegacyExpressionTest(suite)
     0      0.6      522      3      LegacyFieldFacetCloudTest(suite)
     0      0.6      522      3      LegacyNoFacetCloudTest(suite)
     0      0.6      522      3      LegacyRangeFacetCloudTest(suite)
     0      0.2      522      1      LegacyRangeFacetTest(suite)
     0      0.4      522      2      LongFieldsTest(suite)
     0      0.4      486      2      MathExpressionTest.testGammaDistribution
     0      0.2      486      1      
MathExpressionTest.testMultiVariateNormalDistribution
     0      0.2      469      1      
MoveReplicaHDFSFailoverTest.testOldReplicaIsDeleted
     0      0.2      522      1      
NodeMarkersRegistrationTest.testNodeMarkersRegistration
     0      8.0       25      2      OpenCloseCoreStressTest.test10Minutes
     0      0.2      522      1      
OpenNLPLangDetectUpdateProcessorFactoryTest(suite)
     0      0.2      522      1      OverallAnalyticsTest(suite)
     0      0.2      524      1      OverseerStatusTest(suite)
     0      0.5      434      2      OverseerTest(suite)
     0      0.2      434      1      OverseerTest.testBadQueueItem
     0      0.2      434      1      OverseerTest.testDoubleAssignment
     0      0.2      434      1      OverseerTest.testDownNodeFailover
     0      0.2      434      1      
OverseerTest.testExceptionWhenFlushClusterState
     0      0.2      434      1      
OverseerTest.testExternalClusterStateChangeBehavior
     0      0.2      434      1      OverseerTest.testOverseerFailure
     0      0.2      434      1      OverseerTest.testOverseerStatsReset
     0      0.2      434      1      OverseerTest.testRemovalOfLastReplica
     0      0.2      434      1      OverseerTest.testReplay
     0      0.2      434      1      OverseerTest.testShardAssignment
     0      0.2      434      1      OverseerTest.testShardLeaderChange
     0      0.2      434      1      OverseerTest.testStateChange
     0      0.2      522      1      QueryFacetTest(suite)
     0      0.2      522      1      RemoveFunctionTest(suite)
     0      0.2      440      1      
SSLConfigurationsTest.testGetClientKeyStorePasswordFromHadoopCredentialProvider
     0      0.2      440      1      
SSLConfigurationsTest.testGetClientTruststorePasswordFromHadoopCredentialProvider
     0      0.2      440      1      
SSLConfigurationsTest.testGetKeyStorePasswordFromHadoopCredentialProvider
     0      0.2      440      1      
SSLConfigurationsTest.testGetTruststorePasswordFromHadoopCredentialProvider
     0      0.2      440      1      
SSLConfigurationsTest.testHadoopCredentialProviderPrioritySysPropAndEnvVars
     0      0.2      440      1      
SSLConfigurationsTest.testSslConfigKeystorePwFromClientKeystoreHadoopCredentialProvider
     0      0.2      440      1      
SSLConfigurationsTest.testSslConfigKeystorePwFromKeystoreHadoopCredentialProvider
     0      0.8      255      2      ScheduledTriggerTest.testTrigger
     0      0.2      525      1      
SearchRateTriggerIntegrationTest.testAboveSearchRate
     0      5.9       34      2      SharedFSAutoReplicaFailoverTest.test
     0      0.2      523      1      SolrExampleStreamingBinaryTest(suite)
     0      0.6      519      3      SolrJmxReporterCloudTest(suite)
     0      0.2      523      1      SolrPingTest(suite)
     0      0.2      526      1      StreamDecoratorTest.testLeftOuterJoinStream
     0      0.4      268      1      
StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
     0      0.6      523      3      StreamExpressionTest(suite)
     0      0.2      519      1      SuggesterWFSTTest(suite)
     0      0.2      516      1      TaggingAttributeTest(suite)
     0      0.2      522      1      TestAdapterModel(suite)
     0      0.2      523      1      
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
     0      0.2      523      1      
TestCloudCollectionsListeners.testWatchesWorkForBothStateFormats
     0      0.8      518      4      TestCloudConsistency(suite)
     0      0.4      519      2      TestCloudManagedSchema(suite)
     0      0.2      519      1      TestCloudManagedSchema.test
     0      0.6      523      3      TestCloudNestedDocsSort(suite)
     0      0.4      523      2      TestCloudPivotFacet(suite)
     0      0.2      537      1      TestCloudRecovery.corruptedLogTest
     0      1.9      529     10      TestCodecSupport.testMixedCompressionMode
     0      0.2      529      1      
TestConcurrentFacetedIndexing.testConcurrency
     0      0.2      519      1      TestConfig(suite)
     0      0.2      517      1      TestConfigSetsAPIExclusivity(suite)
     0      0.2      522      1      TestContentStreamDataSource(suite)
     0      0.2      522      1      TestCoreContainer.testClassLoaderHierarchy
     0      0.2      522      1      
TestCoreContainer.testCoreInitFailuresFromEmptyContainer
     0      0.2      522      1      
TestCoreContainer.testCoreInitFailuresOnReload
     0      0.2      522      1      TestCoreContainer.testCustomHandlers
     0      0.2      522      1      TestCoreContainer.testDeleteBadCores
     0      0.2      522      1      
TestCoreContainer.testLogWatcherEnabledByDefault
     0      0.2      522      1      TestCoreContainer.testNoCores
     0      0.2      522      1      TestCoreContainer.testReloadSequential
     0      0.2      522      1      TestCoreContainer.testReloadThreaded
     0      0.2      522      1      TestCoreContainer.testShareSchema
     0      0.2      522      1      TestCoreContainer.testSharedLib
     0      0.2      522      1      TestDataConfig(suite)
     0      0.2      522      1      TestDateFormatTransformer(suite)
     0      0.2      522      1      TestDefaultWrapperModel(suite)
     0      0.2      522      1      TestDocBuilder2(suite)
     0      0.2      476      1      TestDynamicLoading.testDynamicLoading
     0      0.4      522      2      TestEdisMaxSolrFeature(suite)
     0      0.2      522      1      TestEntityProcessorBase(suite)
     0      0.2      522      1      TestEphemeralCache(suite)
     0      0.2      522      1      TestErrorHandling(suite)
     0      0.4      517      2      TestExactSharedStatsCache(suite)
     0      0.2      517      1      TestExactSharedStatsCache.test
     0      0.6      516      3      TestExclusionRuleCollectionAccess(suite)
     0      0.4      522      2      TestExternalFeatures(suite)
     0      0.4      522      2      TestExternalValueFeatures(suite)
     0      0.2      521      1      TestFastLRUCache(suite)
     0      0.4      522      2      
TestFeatureExtractionFromMultipleSegments(suite)
     0      0.4      522      2      TestFeatureLogging(suite)
     0      0.4      522      2      TestFieldLengthFeature(suite)
     0      0.2      522      1      TestFieldReader(suite)
     0      0.4      522      2      TestFieldValueFeature(suite)
     0      0.2      522      1      TestFileListWithLineEntityProcessor(suite)
     0      0.9      532      5      TestFileSwitchDirectory.testListAllIsSorted
     0      0.4      522      2      TestFilterSolrFeature(suite)
     0      0.2      522      1      TestFoldingMultitermExtrasQuery(suite)
     0     10.3       39      4      TestHdfsCloudBackupRestore.test
     0      0.2      522      1      TestHierarchicalDocBuilder(suite)
     0      0.2      522      1      TestICUCollationField(suite)
     0      0.2      522      1      TestICUCollationFieldDocValues(suite)
     0      0.2      522      1      TestICUCollationFieldOptions(suite)
     0      0.2      536      1      
TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreads
     0      0.2      536      1      
TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreadsOnlyOnce
     0      0.2      526      1      TestJmxIntegration.testJmxOnCoreReload
     0      0.2      526      1      TestJmxIntegration.testJmxRegistration
     0      0.2      524      1      TestLBHttpSolrClient.testReliability
     0      0.2      524      1      TestLBHttpSolrClient.testSimple
     0      0.2      524      1      TestLBHttpSolrClient.testTwoServers
     0      0.4      523      2      TestLTROnSolrCloud(suite)
     0      0.2      523      1      TestLTROnSolrCloud.testSimpleQuery
     0      0.4      522      2      TestLTRQParserExplain(suite)
     0      0.4      522      2      TestLTRQParserPlugin(suite)
     0      0.4      522      2      TestLTRWithFacet(suite)
     0      0.4      522      2      TestLTRWithSort(suite)
     0      0.2      522      1      TestLinearModel(suite)
     0      3.0      535     16      TestLocalFSCloudBackupRestore.test
     0      0.2      521      1      TestLockTree.testLocks
     0      0.2      518      1      TestMacros(suite)
     0      0.2      522      1      TestManagedFeatureStore(suite)
     0      0.9      532      5      TestMmapDirectory.testPendingDeletions
     0      0.2      522      1      TestModelManager(suite)
     0      0.2      522      1      TestModelManagerPersistence(suite)
     0      0.9      532      5      TestMultiMMap.testPendingDeletions
     0      0.4      522      2      TestMultipleAdditiveTreesModel(suite)
     0      1.1      533      6      TestNIOFSDirectory.testPendingDeletions
     0      0.2      516      1      TestNRTOpen(suite)
     0      0.2      522      1      TestNestedChildren(suite)
     0      0.4      522      2      TestNeuralNetworkModel(suite)
     0      0.4      522      2      TestNoMatchSolrFeature(suite)
     0      0.2      522      1      TestNonWritablePersistFile(suite)
     0      0.2      522      1      
TestOpenNLPExtractNamedEntitiesUpdateProcessorFactory(suite)
     0      0.4      522      2      TestOriginalScoreFeature(suite)
     0      0.2      523      1      
TestParallelWeightCreation.testLTRScoringQueryParallelWeightCreationResultOrder
     0      0.2      519      1      TestPhraseSuggestions(suite)
     0      0.2      521      1      TestPostingsSolrHighlighter(suite)
     0      0.2      518      1      TestPullReplica(suite)
     0      0.4      526      2      
TestPullReplicaErrorHandling.testCantConnectToLeader
     0      0.2      526      1      
TestPullReplicaErrorHandling.testCantConnectToPullReplica
     0      0.2      526      1      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     0      0.4      522      2      TestRankingFeature(suite)
     0      0.2      524      1      TestRebalanceLeaders.test
     0      0.2      567      1      TestRecovery.testBuffering
     0      0.4      568      2      TestRecovery.testLogReplay
     0      0.4      568      2      TestRecovery.testLogReplayWithReorderedDBQ
     0      0.2      567      1      
TestRecovery.testLogReplayWithReorderedDBQByIdAndChildDocs
     0      0.2      568      1      TestRecovery.testRecoveryMultipleLogs
     0      0.2      568      1      TestRecovery.testVersionsOnRestart
     0    100.0        1      1      TestRectangle.testContains
     0      0.2      520      1      TestReload(suite)
     0      1.1       95      1      
TestReplicationHandler.doTestIndexFetchOnMasterRestart
     0      0.3      304      1      TestRequestStatusCollectionAPI.test
     0      0.2      515      1      TestSchemalessBufferedUpdates(suite)
     0      0.4      522      2      TestSelectiveWeightCreation(suite)
     0      1.1      533      6      TestSimpleFSDirectory.testPendingDeletions
     0      0.2      522      1      TestSimplePropertiesWriter(suite)
     0      0.2      525      1      TestSimpleTextTermVectorsFormat(suite)
     0      0.2      525      1      
TestSimpleTextTermVectorsFormat.testRamBytesUsed
     0      0.2      517      1      TestSolr4Spatial(suite)
     0      1.0      200      2      TestSolrCloudWithKerberosAlt.testBasics
     0      0.2      518      1      TestSolrConfigHandler.testProperty
     0      0.2      518      1      TestSolrConfigHandler.testReqHandlerAPIs
     0      0.2      518      1      TestSolrConfigHandler.testReqParams
     0      0.2      518      1      TestSolrConfigHandler.testUserProp
     0      0.2      527      1      
TestSolrEntityProcessorEndToEnd.testCursorMarkNoSort
     0      0.2      527      1      
TestSolrEntityProcessorEndToEnd.testFullImport
     0      0.2      527      1      
TestSolrEntityProcessorEndToEnd.testFullImportBadConfig
     0      0.2      527      1      
TestSolrEntityProcessorEndToEnd.testFullImportFieldsParam
     0      0.2      527      1      
TestSolrEntityProcessorEndToEnd.testFullImportFqParam
     0      0.4      527      2      
TestSolrEntityProcessorEndToEnd.testFullImportInnerEntity
     0      0.2      523      1      TestSolrEntityProcessorUnit.testCursorQuery
     0      0.2      523      1      
TestSolrEntityProcessorUnit.testMultiValuedFields
     0      0.2      523      1      TestSolrEntityProcessorUnit.testNoQuery
     0      0.2      523      1      
TestSolrEntityProcessorUnit.testNumDocsGreaterThanRows
     0      0.2      523      1      TestSolrEntityProcessorUnit.testPagingQuery
     0      0.2      523      1      TestSolrEntityProcessorUnit.testQuery
     0      0.2      522      1      TestSqlEntityProcessor(suite)
     0      0.2      522      1      TestSqlEntityProcessorDelta(suite)
     0      1.0      487      5      
TestStressCloudBlindAtomicUpdates.test_dv_stored
     0      0.4      448      2      TestStressRecovery(suite)
     0      0.9      448      4      TestStressRecovery.testStressRecovery
     0      0.2      516      1      TestTikaEntityProcessor(suite)
     0      0.2      519      1      TestUseDocValuesAsStored2(suite)
     0      0.4      522      2      TestUserTermScoreWithQ(suite)
     0      0.4      522      2      TestUserTermScorerQuery(suite)
     0      0.4      522      2      TestUserTermScorereQDF(suite)
     0      0.6      523      3      TestV2Request(suite)
     0      0.4      522      2      TestValueFeature(suite)
     0      0.2      522      1      TestVariableResolverEndToEnd(suite)
     0      0.2      522      1      TestWriterImpl(suite)
     0      0.2      522      1      TestXLSXResponseWriter(suite)
     0      0.2      522      1      TestXPathEntityProcessor(suite)
     0      0.2      522      1      TestXPathRecordReader(suite)
     0      0.8      522      4      TestZKPropertiesWriter(suite)
     0      0.2      522      1      
TikaLanguageIdentifierUpdateProcessorFactoryTest(suite)
     0      0.2      523      1      ZkControllerTest.testGetHostName
     0      0.2      434      1      
ZkControllerTest.testPublishAndWaitForDownStates
     0      0.2      523      1      ZkControllerTest.testReadConfigName
     0      0.2      521      1      ZkSolrClientTest(suite)
      123   0.2     1369      3      CloudSolrClientTest.preferReplicaTypesTest
      123   0.6     1334      6      FullSolrCloudDistribCmdsTest(suite)
      123   1.6     1338     12      FullSolrCloudDistribCmdsTest.test
      123   0.2     1344      3      
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
      123   1.6     1348     10      
SegmentsInfoRequestHandlerTest.testSegmentInfosVersion
      123   0.4     1354      5      ShardRoutingTest.test
      12   16.1       71      6      HdfsSyncSliceTest.test
      12    0.2      932      2      ReplaceNodeTest.test
      12    6.5       69      4      StressHdfsTest(suite)
      12    0.2      922      2      SystemLogListenerTest.test
      12    0.4      941      5      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
      12    5.3       37      4      TestDocTermOrdsUninvertLimit(suite)
      12    0.8      947     15      TestExtractionDateUtil.testParseDate
      12    0.2      939      2      
TestReplicationHandler.doTestIndexAndConfigReplication
      12    0.4      922      3      TestSolrCLIRunExample(suite)
      12    0.4      932      3      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
      1 3   0.2      942      2      CloudSolrClientTest.testOverwriteOption
      1 3   0.2      841      4      MoveReplicaHDFSTest.test
      1 3   0.2      921      2      SolrExporterTest.testExecute
      1 3   0.2     1054      2      TestComputePlanAction.testNodeLost
      1 3   0.4      806      3      TestPKIAuthenticationPlugin.test
      1 3   0.2      922      3      
TestSkipOverseerOperations.testSkipDownOperations
      1   100.0        1      1      AdlsLockFactoryTest.testBasic
      1     0.2      506      1      AliasIntegrationTest.test
      1     0.2      519      1      AnalyzingInfixSuggesterTest.testRandomNRT
      1     0.6      511      3      
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
      1     0.2      507      1      CoreAdminCreateDiscoverTest(suite)
      1     0.2      505      1      DistribCursorPagingTest.test
      1     0.2      510      1      DistributedFacetExistsSmallTest.test
      1     0.2      511      1      
DistributedQueryComponentCustomSortTest.test
      1     0.2      512      1      DocValuesNotIndexedTest.testDistribFaceting
      1     0.4      516      2      GraphExpressionTest(suite)
      1     0.2      516      1      
GraphExpressionTest.testGatherNodesFriendsStream
      1     0.2      510      1      HttpPartitionOnCommitTest.test
      1     0.2      510      1      InfixSuggestersTest.testReloadDuringBuild
      1     0.2      508      1      LargeFieldTest(suite)
      1     0.2      506      1      MetricsHistoryIntegrationTest(suite)
      1     0.4      469      2      
MoveReplicaHDFSFailoverTest.testDataDirAndUlogAreMaintained
      1     0.2      504      1      RecoveryAfterSoftCommitTest.test
      1     0.4      514      2      ShardRoutingTest(suite)
      1     0.2      519      1      
StreamDecoratorTest.testParallelExecutorStream
      1   100.0        1      1      TestAdlsDirectory.testEOF
      1   100.0        1      1      TestAdlsDirectory.testRandomAccessWrites
      1   100.0        1      1      TestAdlsDirectory.testRename
      1   100.0        1      1      
TestAdlsDirectory.testWritingAndReadingAFile
      1     0.2      518      1      TestAssertingStoredFieldsFormat(suite)
      1     0.2      518      1      
TestAssertingStoredFieldsFormat.testRamBytesUsed
      1     0.2      518      1      TestAssertingTermVectorsFormat(suite)
      1     0.2      518      1      
TestAssertingTermVectorsFormat.testRamBytesUsed
      1     0.8      506      4      TestClusterStateProvider(suite)
      1     0.2      518      1      TestComputePlanAction(suite)
      1     0.2      522      1      
TestComputePlanAction.testNodeWithMultipleReplicasLost
      1     0.2      513      1      
TestContentStreamDataSource.testCommitWithin
      1     0.2      521      1      TestExecutePlanAction(suite)
      1     1.7      519      9      TestIndexWriterThreadsToSegments(suite)
      1     0.4      519      2      
TestIndexWriterThreadsToSegments.testSegmentCountOnFlushRandom
      1     0.4      515      2      
TestJsonRecordReader.testClearPreviousRecordFields
      1     0.4      515      2      TestJsonRecordReader.testNestedDocs
      1     0.4      515      2      TestJsonRecordReader.testRecursiveWildcard2
      1     0.2      457      1      TestRecoveryHdfs.testBuffering
      1     0.2      457      1      TestRecoveryHdfs.testCleanShutdown
      1     0.2      457      1      TestRecoveryHdfs.testCorruptLog
      1     0.2      457      1      TestRecoveryHdfs.testLogReplay
      1     0.2      457      1      TestRecoveryHdfs.testRecoveryMultipleLogs
      1     0.2      457      1      TestRecoveryHdfs.testTruncatedLog
      1     0.2      457      1      TestRecoveryHdfs.testVersionsOnRestart
      1     0.2      507      1      
TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy
      1     0.2      504      1      TestSolrIndexConfig(suite)
      1     0.2      503      1      TestSubQueryTransformerDistrib(suite)
      1     0.2      510      1      TestTlogReplica(suite)
      1     0.2      504      1      
ZkShardTermsTest.testParticipationOfReplicas
       23   0.2      850      3      CloudSolrClientTest.preferLocalShardsTest
       23   0.2      850      2      CloudSolrClientTest.testParallelUpdateQTime
       23   0.2      850      3      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
       23   0.2      826      2      CollectionTooManyReplicasTest.testAddShard
       23   0.2      834      2      
CollectionsAPIDistributedZkTest.testCollectionReload
       23   0.2      834      2      
CollectionsAPIDistributedZkTest.testMissingRequiredParameters
       23   0.2      671      6      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterProperties
       23  40.0       12      5      HdfsChaosMonkeyNothingIsSafeTest.test
       23  16.1      912    127      ResourceLoaderTest.testAwareCompatibility
       23  66.7        7      6      RestartWhileUpdatingTest(suite)
       23   0.7      828      4      SolrExporterTest(suite)
       23   0.4      461      2      
StreamExpressionTest.testBasicTextLogitStream
       23   0.2      827      3      TestCloudRecovery(suite)
       23   0.2      839      2      
TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
       23   0.2      851      2      TestIndexFileDeleter.testExcInDecRef
       23   0.2      856      2      
TestIndexWriterWithThreads.testIOExceptionDuringAbortWithThreadsOnlyOnce
       23   0.2      827      2      TestLocalFSCloudBackupRestore(suite)
       23   0.2      831      2      TestReplicaProperties.test
       23   0.2      832      2      TestTlogReplica.testOnlyLeaderIndexes
       23   4.7      871     37      TransactionLogTest.testBigLastAddSize
       2    1.0      421      4      BasicZkTest(suite)
       2    0.2      421      1      BasicZkTest.testBasic
       2    4.5       22      1      CdcrRequestHandlerTest.testLifeCycleActions
       2    0.2      423      1      
CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
       2    0.2      423      1      
CollectionsAPIDistributedZkTest.testSpecificConfigsets
       2    0.2      426      1      
CustomCollectionTest.testCreateShardRepFactor
       2    2.5       40      1      
HdfsCollectionsAPIDistributedZkTest.addReplicaTest
       2    2.5       40      1      
HdfsCollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
       2    2.5       40      1      
HdfsCollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
       2    0.2      428      1      MathExpressionTest.testZipFDistribution
       2    0.2      421      1      
OverseerTaskQueueTest.testDistributedQueueBlocking
       2    0.2      422      1      ReplaceNodeTest(suite)
       2    0.2      420      1      ShardSplitTest.testSplitShardWithRule
       2  100.0        1      1      
SignificantTermsQParserPluginTest.testQParserBackwardsCompatibility
       2    0.2      422      1      
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeRapidAdds
       2    0.2      427      1      
SolrExampleEmbeddedTest.testContentStreamRequest
       2    0.2      427      1      
SolrExampleEmbeddedTest.testMultiContentStreamRequest
       2    0.2      418      1      SolrSlf4jReporterTest.testReporter
       2    3.6       28      1      
TestBinaryDocValuesUpdates.testTonsOfUpdates
       2    0.2      421      1      TestCryptoKeys.test
       2    3.4       29      1      TestDuelingCodecsAtNight.testBigEquals
       2    0.2      425      1      
TestIndexWriterWithThreads.testUpdateSingleDocWithThreads
       2    3.6       28      1      TestMixedDocValuesUpdates.testTonsOfUpdates
       2    0.2      418      1      TestNodeAddedTrigger.testTrigger
       2    0.2      422      1      
TestPolicyCloud.testCreateCollectionAddShardUsingPolicy
       2    1.9      421      8      TestRandomFlRTGCloud(suite)
       2    0.2      420      1      TestRandomRequestDistribution.test
       2    0.5      432      2      TestRecovery.testBufferedMultipleCalls
       2    0.9      424      4      TestScoreJoinQPNoScore.testJoin
       2    0.2      425      1      TestSimpleTextFieldInfoFormat(suite)
       2    0.2      425      1      
TestSimpleTextFieldInfoFormat.testMergeStability
       2   10.0       60      6      
TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise
       2    0.5      418      2      TestSystemCollAutoCreate(suite)
       2    0.2      422      1      TestSystemCollAutoCreate.testAutoCreate
       2    0.2      418      1      
TestTolerantUpdateProcessorRandomCloud.testRandomUpdates
       2    0.5      416      2      TimeRoutedAliasUpdateProcessorTest.test
       2    0.2      416      1      
UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping
        3   0.5      380      2      AutoscalingHistoryHandlerTest.testHistory
        3   0.5      406      2      BlockJoinFacetDistribTest(suite)
        3   5.9       34      2      ChaosMonkeyNothingIsSafeTest(suite)
        3   0.5      377      2      CheckHdfsIndexTest.doTest
        3   0.3      377      1      CheckHdfsIndexTest.testChecksumsOnly
        3   0.3      377      1      CheckHdfsIndexTest.testChecksumsOnlyVerbose
        3   0.3      377      1      CheckHdfsIndexTest.testDeletedDocs
        3   0.2      405      1      CleanupOldIndexTest(suite)
        3   0.2      408      1      CleanupOldIndexTest.test
        3   0.2      423      1      
CloudSolrClientTest.checkCollectionParameters
        3   0.2      423      1      CloudSolrClientTest.customHttpClientTest
        3   0.2      423      1      CloudSolrClientTest.stateVersionParamTest
        3   0.2      423      1      CloudSolrClientTest.testAliasHandling
        3   0.2      423      1      
CloudSolrClientTest.testInitializationWithSolrUrls
        3   0.2      423      1      
CloudSolrClientTest.testNonRetryableRequests
        3   0.2      423      1      CloudSolrClientTest.testRouting
        3   0.2      423      1      CloudSolrClientTest.testWrongZkChrootTest
        3   0.2      407      1      
CollectionTooManyReplicasTest.testAddTooManyReplicas
        3   0.2      416      1      
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
        3   1.0      407      4      ConfigSetsAPITest(suite)
        3   0.2      424      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithSNB
        3   0.2      413      1      
CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
        3   0.2      413      1      
CreateRoutedAliasTest.testTimezoneAbsoluteDate
        3   0.2      413      1      CreateRoutedAliasTest.testV1
        3   0.2      413      1      CreateRoutedAliasTest.testV2
        3   1.0      411      4      CustomHighlightComponentTest(suite)
        3   0.2      413      1      DistribJoinFromCollectionTest.testScore
        3   0.2      410      1      DistributedQueueTest.testPeekElements
        3   0.2      410      1      ExecutePlanActionTest.testExecute
        3   0.2      410      1      ExecutePlanActionTest.testIntegration
        3   1.0      419      4      GraphTest(suite)
        3   0.3      370      1      HDFSCollectionsAPITest(suite)
        3   0.5      373      2      HdfsDirectoryFactoryTest(suite)
        3   0.3      369      1      HdfsDirectoryTest.testRandomAccessWrites
        3   0.3      369      1      
HdfsDirectoryTest.testWritingAndReadingAFile
        3   0.3      371      1      HdfsRecoverLeaseTest(suite)
        3   0.3      368      1      HdfsThreadLeakTest(suite)
        3   7.7       13      1      HdfsUnloadDistributedZkTest.test
        3   0.2      423      1      JdbcTest(suite)
        3   0.5      404      2      LeaderElectionTest(suite)
        3   0.2      404      1      LeaderElectionTest.testStressElection
        3   0.2      406      1      LegacyFieldFacetExtrasCloudTest(suite)
        3   0.3      367      1      MetricsHistoryHandlerTest.testBasic
        3   0.5      373      2      MoveReplicaHDFSFailoverTest(suite)
        3   0.2      410      1      NodeLostTriggerTest.testTrigger
        3   0.2      407      1      OutputWriterTest(suite)
        3   0.2      405      1      QueryEqualityTest(suite)
        3   0.5      404      2      RemoteQueryErrorTest(suite)
        3   1.0      408      4      ScheduledTriggerTest(suite)
        3   3.3      428     14      
SearchHandlerTest.testRequireZkConnectedDistrib
        3   0.5      406      2      ShardSplitTest(suite)
        3   0.2      410      1      
ShardSplitTest.testSplitStaticIndexReplication
        3   0.2      410      1      SolrCoreTest.testRequestHandlerRegistry
        3   0.5      406      2      SolrShardReporterTest(suite)
        3   0.2      406      1      SolrShardReporterTest.test
        3   0.2      410      1      
StatsReloadRaceTest.testParallelReloadAndStats
        3   0.5      429      2      StreamDecoratorTest.testExecutorStream
        3   0.2      429      1      
StreamDecoratorTest.testParallelUpdateStream
        3   1.4      421      6      TestBKD.testWastedLeadingBytes
        3   0.2      416      1      
TestBackwardsCompatibility.testUnsupportedOldIndexes
        3   2.9      413     12      TestCloudJSONFacetSKG(suite)
        3   0.7      415      3      TestCloudJSONFacetSKG.testRandom
        3   0.2      406      1      TestConfigSetsAPI.testDelete
        3   0.5      413      2      TestDeleteCollectionOnDownNodes(suite)
        3   0.2      411      1      TestDistributedGrouping.test
        3   0.2      407      1      TestExclusionRuleCollectionAccess.doTest
        3   0.2      408      1      TestGeo3DPoint.testGeo3DRelations
        3   0.3      370      1      TestHdfsBackupRestoreCore(suite)
        3   0.2      410      1      
TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry
        3   0.2      419      1      
TestLucene70DocValuesFormat.testSortedVariableLengthBigVsStoredFields
        3   0.2      407      1      
TestPolicyCloud.testCreateCollectionAddShardWithReplicaTypeUsingPolicy
        3   0.5      410      2      TestReplicaProperties(suite)
        3   0.5      423      2      TestSearcherManager(suite)
        3   0.5      407      2      
TestSkipOverseerOperations.testSkipLeaderOperations
        3   0.2      412      1      TestStandardQParsers.testRegisteredName
        3   0.2      410      1      TestStressLiveNodes.testStress
        3   0.2      406      1      TestTlogReplica.testAddDocs
        3   0.2      406      1      TestTlogReplica.testAddRemoveTlogReplica
        3   0.2      406      1      TestTlogReplica.testBasicLeaderElection
        3 100.0        2      2      TestTlogReplica.testCreateDelete
        3   0.2      406      1      TestTlogReplica.testDeleteById
        3   0.2      406      1      TestTlogReplica.testKillLeader
        3   0.2      406      1      TestTlogReplica.testKillTlogReplica
        3   0.2      406      1      
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
        3   0.2      406      1      TestTlogReplica.testRealTimeGet
        3   0.2      406      1      TestTlogReplica.testRecovery
        3   0.2      435      1      TestTriggerIntegration(suite)
        3   0.5      412      2      TestZkChroot(suite)
        3   0.2      412      1      TestZkChroot.testInitPathExists
        3   0.2      411      1      TriggerIntegrationTest.testEventQueue
        3   0.2      403      1      V2ApiIntegrationTest(suite)



***********************Annotations report
   Number of AwaitsFix: 18 Number of BadApples: 93

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)

UIMABaseAnalyzerTest.testRandomStrings
   @Test @AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/LUCENE-3869";)

UIMABaseAnalyzerTest.testRandomStringsWithConfigurationParameters
   @Test @AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/LUCENE-3869";)

UIMATypeAwareAnalyzerTest.testRandomStrings
   @Test @AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/LUCENE-3869";)


    ************Solr AwaitsFix
ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestCollapseQParserPlugin.testStringCollapse
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974";)

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
AddReplicaTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

AssignBackwardCompatibilityTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

AutoAddReplicasPlanActionTest.testSimple
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

AutoScalingHandlerTest.testReadApi
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

BasicAuthIntegrationTest.testBasicAuth
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

BasicDistributedZkTest.BasicDistributedZkTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

BasicDistributedZkTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
12-Jun-2018

BlockCacheTest.BlockCacheTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

BlockDirectoryTest.BlockDirectoryTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

CdcrReplicationDistributedZkTest.CdcrReplicationDistributedZkTest suite
   @BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028, 
https://issues.apache.org/jira/browse/SOLR-10107";)

ChaosMonkeyNothingIsSafeTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

ChaosMonkeySafeLeaderTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

CheckHdfsIndexTest.CheckHdfsIndexTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

CollectionsAPIDistributedZkTest.testCollectionsAPI
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ComputePlanActionTest.testNodeLost
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

DeleteReplicaTest.deleteReplicaOnIndexing
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

ForceLeaderTest.testReplicasInLowerTerms
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

HdfsBasicDistributedZk2Test.HdfsBasicDistributedZk2Test suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 26-Mar-2018

HdfsBasicDistributedZkTest.HdfsBasicDistributedZkTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

HdfsChaosMonkeyNothingIsSafeTest.HdfsChaosMonkeyNothingIsSafeTest suite
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028, 
https://issues.apache.org/jira/browse/SOLR-10191";)

HdfsCollectionsAPIDistributedZkTest.HdfsCollectionsAPIDistributedZkTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

HdfsNNFailoverTest.HdfsNNFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

HdfsRecoveryZkTest.HdfsRecoveryZkTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

HdfsSyncSliceTest.HdfsSyncSliceTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

HdfsUnloadDistributedZkTest.HdfsUnloadDistributedZkTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 21-May-2018

HdfsWriteToMultipleCollectionsTest.HdfsWriteToMultipleCollectionsTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

HttpPartitionTest.HttpPartitionTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

HttpPartitionTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

IndexSizeTriggerTest.IndexSizeTriggerTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12392";)

LeaderFailoverAfterPartitionTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

LeaderVoteWaitTimeoutTest.basicTest
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

MaxSizeAutoCommitTest.MaxSizeAutoCommitTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

MaxSizeAutoCommitTest.deleteTest
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

MaxSizeAutoCommitTest.endToEndTest
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

MultiThreadedOCPTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

NodeLostTriggerTest.testListenerAcceptance
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
16-Apr-2018

OverseerRolesTest.testOverseerRole
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
04-May-2018

PeerSyncReplicationTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

RestartWhileUpdatingTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

RollingRestartTest.test
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

SSLMigrationTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SearchRateTriggerIntegrationTest.testBelowSearchRate
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

SearchRateTriggerTest.testTrigger
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

ShardSplitTest.testSplitAfterFailedSplit
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ShardSplitTest.testSplitWithChaosMonkey
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestAuthenticationFramework.testBasics
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionStateWatchers.testCanWaitForNonexistantCollection
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionStateWatchers.testDeletionsTriggerWatches
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

TestCollectionStateWatchers.testPredicateFailureTimesOut
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionStateWatchers.testSimpleCollectionWatch
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionStateWatchers.testWatcherIsRemovedAfterTimeout
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionStateWatchers.testWatchesWorkForStateFormat1
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestDistributedSearch.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestGenericDistributedQueue.TestGenericDistributedQueue suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-02-26

TestHdfsCloudBackupRestore.TestHdfsCloudBackupRestore suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 04-May-2018

TestHdfsUpdateLog.testFSThreadSafety
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

TestInPlaceUpdatesDistrib.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

TestLargeCluster.TestLargeCluster suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11911";)

TestLargeCluster.testBasic
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

TestLargeCluster.testNodeLost
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

TestLargeCluster.testSearchRate
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

TestLeaderInitiatedRecoveryThread.testPublishDownState
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

TestManagedResourceStorage.TestManagedResourceStorage suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-6443";)

TestPullReplica.testCreateDelete
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

TestRecoveryHdfs.TestRecoveryHdfs suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestReplicationHandler.TestReplicationHandler suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestSQLHandler.doTest
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

TestSolrCloudWithHadoopAuthPlugin.TestSolrCloudWithHadoopAuthPlugin suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 12-Jun-2018

TestStressCloudBlindAtomicUpdates.test_dv
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestStressInPlaceUpdates.stressTest
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

TestTriggerIntegration.testCooldown
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestTriggerIntegration.testEventFromRestoredState
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) 
//2018-03-10

TestTriggerIntegration.testEventQueue
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
16-Apr-2018

TestTriggerIntegration.testListeners
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestTriggerIntegration.testNodeAddedTrigger
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

TestTriggerIntegration.testNodeAddedTriggerRestoreState
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
09-Apr-2018

TestTriggerIntegration.testNodeLostTrigger
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
26-Mar-2018

TestTriggerIntegration.testNodeLostTriggerRestoreState
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestTriggerIntegration.testNodeMarkersRegistration
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestTriggerIntegration.testSearchRate
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestTriggerIntegration.testTriggerThrottling
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 2018-06-18

UnloadDistributedZkTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
21-May-2018

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to