Apache HBase Flaky Dashboard

Apache HBase Flaky Tests Dashboard

Last updated: 12/19/2024 12:30:13
Count of flaky tests (cumulated from all jobs): 93

List of Jobs

https://ci-hbase.apache.org//job/HBase%20Nightly/job/branch-2
https://ci-hbase.apache.org//job/HBase-Flaky-Tests/job/branch-2

Results

https://ci-hbase.apache.org//job/HBase%20Nightly/job/branch-2
Go to

Go to top

Legend : green: success, red: failed, yellow: timeout, blue: hanging

Test Name	Flakyness	Failed/Timeout/Hanging	Run Ids
replication.regionserver.TestMetaRegionReplicaReplicationEndpoint	100.0% (1 / 1)	1 / 0 / 0	Failed : 1196 Timed Out : Hanging : Succeeded :
regionserver.wal.TestFSHLog	100.0% (1 / 1)	1 / 0 / 0	Failed : 1196 Timed Out : Hanging : Succeeded :
io.hfile.bucket.TestRecoveryPersistentBucketCache	66.7% (2 / 3)	2 / 0 / 0	Failed : 1187 1196 Timed Out : Hanging : Succeeded : 1186
quotas.TestClusterScopeQuotaThrottle	33.3% (1 / 3)	1 / 0 / 0	Failed : 1197 Timed Out : Hanging : Succeeded : 1196 1198
regionserver.TestClearRegionBlockCache	33.3% (1 / 3)	1 / 0 / 0	Failed : 1186 Timed Out : Hanging : Succeeded : 1187 1196
quotas.TestQuotaUserOverride	33.3% (1 / 3)	1 / 0 / 0	Failed : 1187 Timed Out : Hanging : Succeeded : 1186 1196
master.region.TestMasterRegionWALCleaner	33.3% (1 / 3)	1 / 0 / 0	Failed : 1199 Timed Out : Hanging : Succeeded : 1196 1198
master.TestMaster	33.3% (1 / 3)	1 / 0 / 0	Failed : 1187 Timed Out : Hanging : Succeeded : 1186 1196
master.cleaner.TestHFileCleaner	33.3% (1 / 3)	1 / 0 / 0	Failed : 1187 Timed Out : Hanging : Succeeded : 1186 1196
quotas.TestDefaultQuota	33.3% (2 / 6)	2 / 0 / 0	Failed : 1190 1196 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189
master.region.TestMasterRegionCompaction	25.0% (1 / 4)	1 / 0 / 0	Failed : 1188 Timed Out : Hanging : Succeeded : 1186 1187 1196
rsgroup.TestTableDescriptorWithRSGroup	20.0% (1 / 5)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1197 1198 1199 1200
replication.TestReplicationKillSlaveRS	20.0% (1 / 5)	1 / 0 / 0	Failed : 1189 Timed Out : Hanging : Succeeded : 1186 1187 1188 1196
io.hfile.TestBlockEvictionOnRegionMovement	20.0% (1 / 5)	1 / 0 / 0	Failed : 1189 Timed Out : Hanging : Succeeded : 1186 1187 1188 1196
wal.TestCompressedWALValueCompression	20.0% (1 / 5)	1 / 0 / 0	Failed : 1189 Timed Out : Hanging : Succeeded : 1186 1187 1188 1196
TestAcidGuaranteesWithAdaptivePolicy	14.3% (1 / 7)	1 / 0 / 0	Failed : 1191 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1196
regionserver.TestRegionServerReportForDuty	14.3% (1 / 7)	1 / 0 / 0	Failed : 1191 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1196
replication.TestReplicationKillSlaveRSWithSeparateOldWALs	14.3% (1 / 7)	1 / 0 / 0	Failed : 1191 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1196
security.TestNettyTLSIPCFileWatcher	14.3% (1 / 7)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1196 1197 1198 1199 1200 1201
io.hfile.TestCombinedBlockCache	12.5% (1 / 8)	1 / 0 / 0	Failed : 1192 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1196
master.procedure.TestHBCKSCP	12.5% (1 / 8)	1 / 0 / 0	Failed : 1192 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1196
regionserver.wal.TestLogRolling	9.1% (1 / 11)	1 / 0 / 0	Failed : 1196 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195
snapshot.TestMobSecureExportSnapshot	8.3% (1 / 12)	1 / 0 / 0	Failed : 1200 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199
snapshot.TestSecureExportSnapshot	8.3% (1 / 12)	1 / 0 / 0	Failed : 1200 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199
master.assignment.TestAMServerFailedOpen	7.7% (1 / 13)	1 / 0 / 0	Failed : 1197 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1198
rsgroup.TestRSGroupsBasics	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
mapreduce.TestTableSnapshotInputFormat	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
rsgroup.TestRSGroupsBalance	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
mapred.TestTableSnapshotInputFormat	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
mapreduce.TestHFileOutputFormat2	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
rsgroup.TestRSGroupsAdmin2	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
mapreduce.TestSyncTable	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
procedure.TestZKProcedure	7.7% (1 / 13)	1 / 0 / 0	Failed : 1197 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1198
mapreduce.TestHashTable	7.7% (1 / 13)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1186 1187 1188 1190 1192 1193 1194 1195 1197 1198 1199 1200
replication.TestEditsBehindDroppedTableTiming	6.7% (1 / 15)	1 / 0 / 0	Failed : 1200 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199
regionserver.wal.TestHBaseWalOnEC	6.7% (1 / 15)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1204
regionserver.TestRemoveRegionMetrics	6.2% (1 / 16)	1 / 0 / 0	Failed : 1201 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200
regionserver.TestRegionServerAbort	6.2% (1 / 16)	1 / 0 / 0	Failed : 1201 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200
regionserver.TestBulkLoadReplicationHFileRefs	5.9% (1 / 17)	1 / 0 / 0	Failed : 1202 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
regionserver.TestRegionReplicasAreDistributed	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAsyncClusterAdminApi	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
regionserver.TestRegionReplicasWithModifyTable	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
mob.TestMobCompactionOptRegionBatchMode	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
snapshot.TestMobFlushSnapshotFromClient	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestFromClientSide5	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAsyncRegionAdminApi2	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
regionserver.TestRegionReplicasWithRestartScenarios	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAsyncNonMetaRegionLocator	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
tool.TestSecureLoadIncrementalHFiles	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAdmin2	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
snapshot.TestFlushSnapshotFromClient	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
TestRegionMetrics	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
mob.TestMobCompactionOptMode	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
master.janitor.TestMetaFixer	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestRestoreSnapshotFromClientAfterSplittingRegions	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestFromClientSide3	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
util.TestFromClientSide3WoUnsafe	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAdmin3	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
master.balancer.TestRegionLocationFinder	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
util.TestRegionMover1	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
tool.TestLoadIncrementalHFilesSFT	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
mob.TestMobCompactionRegularRegionBatchMode	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.replication.TestReplicationAdminWithTwoDifferentZKClusters	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestResultScannerTracing	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestReplicaWithCluster	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
master.normalizer.TestSimpleRegionNormalizerOnCluster	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
regionserver.TestRegionReplicaFailover	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
regionserver.TestRegionMergeTransactionOnCluster	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
mob.TestMobCompactionWithDefaults	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
tool.TestLoadIncrementalHFiles	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
master.assignment.TestMergeTableRegionsProcedure	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAdmin	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestFromClientSideWithCoprocessor5	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestMobRestoreSnapshotFromClientAfterSplittingRegions	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestCloneSnapshotFromClientAfterSplittingRegion	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAsyncTableBatch	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
quotas.TestSpaceQuotaDropTable	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
snapshot.TestConcurrentFlushSnapshotFromClient	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAsyncTableAdminApi3	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestTableSnapshotScannerWithSFT	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
coprocessor.TestMasterObserver	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestMobCloneSnapshotFromClientAfterSplittingRegion	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestAsyncTableAdminApi	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
replication.regionserver.TestReplicator	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestEnableTable	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.replication.TestReplicationAdminWithClusters	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
util.TestRegionMover2	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
master.TestMasterDryRunBalancer	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
master.http.TestMetaBrowser	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
master.procedure.TestFlushTableProcedure	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
client.TestTableSnapshotScanner	5.9% (1 / 17)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201
io.TestFileChangeWatcher	5.6% (1 / 18)	1 / 0 / 0	Failed : 1203 Timed Out : Hanging : Succeeded : 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202

https://ci-hbase.apache.org//job/HBase-Flaky-Tests/job/branch-2
Go to

Go to top

Legend : green: success, red: failed, yellow: timeout, blue: hanging

Test Name	Flakyness	Failed/Timeout/Hanging	Run Ids
regionserver.TestRegionMergeTransactionOnCluster	100.0% (30 / 30)	30 / 0 / 0	Failed : 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
regionserver.TestBulkLoadReplicationHFileRefs	100.0% (32 / 32)	32 / 0 / 0	Failed : 23430 23431 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
regionserver.TestRegionReplicasAreDistributed	100.0% (30 / 30)	30 / 0 / 0	Failed : 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
client.TestAsyncClusterAdminApi	100.0% (25 / 25)	2 / 0 / 23	Failed : 23435 23440 Timed Out : Hanging : 23432 23437 23441 23447 23448 23450 23451 23453 23456 23457 23459 23460 23462 23463 23465 23466 23468 23469 23471 23472 23474 23475 23477 Succeeded :
mob.TestMobCompactionWithDefaults	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
regionserver.TestRegionReplicasWithModifyTable	100.0% (30 / 30)	30 / 0 / 0	Failed : 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
mob.TestMobCompactionOptRegionBatchMode	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
client.TestFromClientSide5	100.0% (5 / 5)	0 / 0 / 5	Failed : Timed Out : Hanging : 23434 23438 23445 23449 23464 Succeeded :
master.assignment.TestMergeTableRegionsProcedure	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
client.TestAsyncReplicationAdminApi	100.0% (2 / 2)	2 / 0 / 0	Failed : 23430 23431 Timed Out : Hanging : Succeeded :
client.TestFromClientSideWithCoprocessor5	100.0% (2 / 2)	2 / 0 / 0	Failed : 23435 23440 Timed Out : Hanging : Succeeded :
client.TestAsyncRegionAdminApi2	100.0% (25 / 25)	24 / 0 / 1	Failed : 23432 23437 23441 23444 23447 23448 23450 23451 23453 23456 23457 23459 23460 23462 23463 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : 23454 Succeeded :
replication.regionserver.TestMetaRegionReplicaReplicationEndpoint	100.0% (27 / 27)	27 / 0 / 0	Failed : 23430 23431 23432 23437 23441 23444 23447 23448 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
regionserver.TestRegionReplicasWithRestartScenarios	100.0% (30 / 30)	30 / 0 / 0	Failed : 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
client.TestMobRestoreSnapshotFromClientAfterSplittingRegions	100.0% (2 / 2)	2 / 0 / 0	Failed : 23435 23440 Timed Out : Hanging : Succeeded :
client.TestCloneSnapshotFromClientAfterSplittingRegion	100.0% (26 / 26)	3 / 0 / 23	Failed : 23435 23440 23471 Timed Out : Hanging : 23432 23437 23441 23444 23447 23448 23450 23451 23453 23456 23457 23459 23460 23462 23463 23465 23466 23468 23469 23472 23474 23475 23477 Succeeded :
client.TestAsyncNonMetaRegionLocator	100.0% (5 / 5)	0 / 0 / 5	Failed : Timed Out : Hanging : 23434 23438 23445 23449 23464 Succeeded :
client.TestAsyncTableBatch	100.0% (7 / 7)	5 / 0 / 2	Failed : 23434 23438 23445 23449 23464 Timed Out : Hanging : 23435 23440 Succeeded :
security.TestNettyTLSIPCFileWatcher	100.0% (2 / 2)	2 / 0 / 0	Failed : 23435 23440 Timed Out : Hanging : Succeeded :
TestRegionMetrics	100.0% (2 / 2)	2 / 0 / 0	Failed : 23435 23440 Timed Out : Hanging : Succeeded :
client.TestAsyncTableAdminApi3	100.0% (2 / 2)	2 / 0 / 0	Failed : 23435 23440 Timed Out : Hanging : Succeeded :
mob.TestMobCompactionOptMode	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
client.TestRestoreSnapshotFromClientAfterSplittingRegions	100.0% (32 / 32)	31 / 0 / 1	Failed : 23432 23434 23435 23437 23438 23440 23441 23444 23445 23447 23448 23449 23450 23451 23453 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : 23454 Succeeded :
master.janitor.TestMetaFixer	100.0% (13 / 13)	0 / 0 / 13	Failed : Timed Out : Hanging : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Succeeded :
util.TestFromClientSide3WoUnsafe	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
client.TestAdmin3	100.0% (7 / 7)	7 / 0 / 0	Failed : 23434 23435 23438 23440 23445 23449 23464 Timed Out : Hanging : Succeeded :
client.TestTableSnapshotScannerWithSFT	100.0% (24 / 24)	23 / 0 / 1	Failed : 23432 23437 23441 23447 23448 23450 23451 23453 23456 23457 23459 23460 23462 23463 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : 23444 Succeeded :
master.balancer.TestRegionLocationFinder	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
coprocessor.TestMasterObserver	100.0% (2 / 2)	2 / 0 / 0	Failed : 23435 23440 Timed Out : Hanging : Succeeded :
quotas.TestDefaultQuota	100.0% (2 / 2)	2 / 0 / 0	Failed : 23430 23431 Timed Out : Hanging : Succeeded :
regionserver.wal.TestFSHLog	100.0% (32 / 32)	32 / 0 / 0	Failed : 23430 23431 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
util.TestRegionMover1	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
tool.TestLoadIncrementalHFilesSFT	100.0% (13 / 13)	0 / 0 / 13	Failed : Timed Out : Hanging : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Succeeded :
client.TestMobCloneSnapshotFromClientAfterSplittingRegion	100.0% (7 / 7)	7 / 0 / 0	Failed : 23434 23435 23438 23440 23445 23449 23464 Timed Out : Hanging : Succeeded :
replication.regionserver.TestReplicator	100.0% (25 / 25)	25 / 0 / 0	Failed : 23432 23437 23441 23444 23447 23448 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
client.TestEnableTable	100.0% (29 / 29)	29 / 0 / 0	Failed : 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
mob.TestMobCompactionRegularRegionBatchMode	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
client.replication.TestReplicationAdminWithTwoDifferentZKClusters	100.0% (1 / 1)	0 / 0 / 1	Failed : Timed Out : Hanging : 23471 Succeeded :
client.TestReplicaWithCluster	100.0% (5 / 5)	5 / 0 / 0	Failed : 23434 23438 23445 23449 23464 Timed Out : Hanging : Succeeded :
client.TestResultScannerTracing	100.0% (2 / 2)	2 / 0 / 0	Failed : 23435 23440 Timed Out : Hanging : Succeeded :
util.TestRegionMover2	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
master.TestMasterDryRunBalancer	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
master.http.TestMetaBrowser	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
master.normalizer.TestSimpleRegionNormalizerOnCluster	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
client.TestTableSnapshotScanner	100.0% (2 / 2)	0 / 0 / 2	Failed : Timed Out : Hanging : 23435 23440 Succeeded :
master.procedure.TestFlushTableProcedure	100.0% (13 / 13)	13 / 0 / 0	Failed : 23433 23436 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476 Timed Out : Hanging : Succeeded :
regionserver.TestRegionReplicaFailover	100.0% (30 / 30)	30 / 0 / 0	Failed : 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475 23477 Timed Out : Hanging : Succeeded :
io.TestFileChangeWatcher	40.4% (19 / 47)	19 / 0 / 0	Failed : 23431 23432 23433 23436 23437 23439 23444 23445 23450 23452 23453 23456 23461 23462 23464 23466 23467 23470 23472 Timed Out : Hanging : Succeeded : 23430 23434 23435 23438 23440 23441 23442 23443 23446 23447 23448 23449 23451 23454 23455 23457 23458 23459 23460 23463 23465 23468 23469 23471 23474 23475 23476 23477
regionserver.TestRegionServerReportForDuty	18.8% (6 / 32)	6 / 0 / 0	Failed : 23441 23444 23448 23451 23463 23469 Timed Out : Hanging : Succeeded : 23430 23431 23432 23434 23437 23438 23445 23447 23449 23450 23453 23454 23456 23457 23459 23460 23462 23464 23465 23466 23468 23471 23472 23474 23475 23477
master.TestMaster	6.7% (1 / 15)	1 / 0 / 0	Failed : 23455 Timed Out : Hanging : Succeeded : 23430 23431 23433 23436 23439 23442 23443 23446 23452 23458 23461 23467 23470 23476
master.region.TestMasterRegionCompaction	6.7% (1 / 15)	1 / 0 / 0	Failed : 23436 Timed Out : Hanging : Succeeded : 23430 23431 23433 23439 23442 23443 23446 23452 23455 23458 23461 23467 23470 23476
replication.TestReplicationKillSlaveRS	3.7% (1 / 27)	1 / 0 / 0	Failed : 23444 Timed Out : Hanging : Succeeded : 23430 23431 23432 23437 23441 23447 23448 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23465 23466 23468 23469 23471 23472 23474 23475 23477
regionserver.wal.TestLogRolling	3.1% (1 / 32)	1 / 0 / 0	Failed : 23477 Timed Out : Hanging : Succeeded : 23430 23431 23432 23434 23437 23438 23441 23444 23445 23447 23448 23449 23450 23451 23453 23454 23456 23457 23459 23460 23462 23463 23464 23465 23466 23468 23469 23471 23472 23474 23475