Apache HBase Flaky Dashboard

Apache HBase Flaky Tests Dashboard

Last updated: 01/12/2025 12:32:42
Count of flaky tests (cumulated from all jobs): 91

List of Jobs

https://ci-hbase.apache.org//job/HBase%20Nightly/job/branch-2
https://ci-hbase.apache.org//job/HBase-Flaky-Tests/job/branch-2

Results

https://ci-hbase.apache.org//job/HBase%20Nightly/job/branch-2
Go to

Go to top

Legend : green: success, red: failed, yellow: timeout, blue: hanging

Test Name	Flakyness	Failed/Timeout/Hanging	Run Ids
snapshot.TestMobSecureExportSnapshot	100.0% (1 / 1)	1 / 0 / 0	Failed : 1200 Timed Out : Hanging : Succeeded :
replication.TestEditsBehindDroppedTableTiming	100.0% (1 / 1)	1 / 0 / 0	Failed : 1200 Timed Out : Hanging : Succeeded :
io.hfile.bucket.TestRecoveryPersistentBucketCache	100.0% (1 / 1)	1 / 0 / 0	Failed : 1217 Timed Out : Hanging : Succeeded :
snapshot.TestSecureExportSnapshot	100.0% (1 / 1)	1 / 0 / 0	Failed : 1200 Timed Out : Hanging : Succeeded :
mapreduce.TestHFileOutputFormat2	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
regionserver.TestMemStoreLAB	50.0% (1 / 2)	1 / 0 / 0	Failed : 1207 Timed Out : Hanging : Succeeded : 1206
mapred.TestTableSnapshotInputFormat	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
mapreduce.TestTableSnapshotInputFormat	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
mapreduce.TestSyncTable	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
rsgroup.TestTableDescriptorWithRSGroup	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
regionserver.TestRegionServerAbort	50.0% (1 / 2)	1 / 0 / 0	Failed : 1201 Timed Out : Hanging : Succeeded : 1200
regionserver.TestRemoveRegionMetrics	50.0% (1 / 2)	1 / 0 / 0	Failed : 1201 Timed Out : Hanging : Succeeded : 1200
rsgroup.TestRSGroupsBasics	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
mapreduce.TestHashTable	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
client.TestAdminShell	50.0% (1 / 2)	1 / 0 / 0	Failed : 1206 Timed Out : Hanging : Succeeded : 1200
rsgroup.TestRSGroupsBalance	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
master.cleaner.TestHFileCleaner	50.0% (1 / 2)	1 / 0 / 0	Failed : 1209 Timed Out : Hanging : Succeeded : 1208
rsgroup.TestRSGroupsAdmin2	50.0% (1 / 2)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200
master.assignment.TestMergeTableRegionsProcedure	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestFromClientSide5	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestTableSnapshotScannerWithSFT	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
master.janitor.TestMetaFixer	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestTableSnapshotScanner	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
util.TestRegionMover1	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
regionserver.TestRegionReplicasAreDistributed	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestReplicaWithCluster	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
util.TestFromClientSide3WoUnsafe	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
master.http.TestMetaBrowser	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAsyncClusterAdminApi	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestCloneSnapshotFromClientAfterSplittingRegion	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestFromClientSideWithCoprocessor5	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
mob.TestMobCompactionOptRegionBatchMode	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestMobRestoreSnapshotFromClientAfterSplittingRegions	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAdmin2	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAsyncTableAdminApi	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
tool.TestLoadIncrementalHFiles	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestMobCloneSnapshotFromClientAfterSplittingRegion	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
snapshot.TestFlushSnapshotFromClient	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.replication.TestReplicationAdminWithClusters	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAdmin	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAsyncTableBatch	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
master.normalizer.TestSimpleRegionNormalizerOnCluster	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAsyncNonMetaRegionLocator	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
master.procedure.TestFlushTableProcedure	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
mob.TestMobCompactionRegularRegionBatchMode	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
regionserver.TestRegionReplicaFailover	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
snapshot.TestConcurrentFlushSnapshotFromClient	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
mob.TestMobCompactionWithDefaults	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
tool.TestSecureLoadIncrementalHFiles	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestFromClientSide3	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
master.balancer.TestRegionLocationFinder	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
master.procedure.TestHBCKSCP	33.3% (1 / 3)	1 / 0 / 0	Failed : 1215 Timed Out : Hanging : Succeeded : 1213 1214
tool.TestLoadIncrementalHFilesSFT	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
regionserver.TestRegionMergeTransactionOnCluster	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAsyncTableAdminApi3	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
regionserver.TestRegionReplicasWithModifyTable	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
quotas.TestSpaceQuotaDropTable	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
regionserver.TestBulkLoadReplicationHFileRefs	33.3% (1 / 3)	1 / 0 / 0	Failed : 1202 Timed Out : Hanging : Succeeded : 1200 1201
snapshot.TestMobFlushSnapshotFromClient	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAdmin3	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestResultScannerTracing	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
coprocessor.TestMasterObserver	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
TestRegionMetrics	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
replication.regionserver.TestReplicator	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.replication.TestReplicationAdminWithTwoDifferentZKClusters	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
master.TestMasterDryRunBalancer	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestAsyncRegionAdminApi2	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
mob.TestMobCompactionOptMode	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
regionserver.TestRegionReplicasWithRestartScenarios	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
security.TestNettyTLSIPCFileWatcher	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestRestoreSnapshotFromClientAfterSplittingRegions	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
util.TestRegionMover2	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
client.TestEnableTable	33.3% (1 / 3)	1 / 0 / 0	Failed : 1204 Timed Out : Hanging : Succeeded : 1200 1201
io.hfile.TestPrefetchWithBucketCache	25.0% (1 / 4)	1 / 0 / 0	Failed : 1207 Timed Out : Hanging : Succeeded : 1204 1205 1206
regionserver.wal.TestHBaseWalOnEC	25.0% (1 / 4)	1 / 0 / 0	Failed : 1205 Timed Out : Hanging : Succeeded : 1200 1201 1204
io.TestFileChangeWatcher	25.0% (1 / 4)	1 / 0 / 0	Failed : 1203 Timed Out : Hanging : Succeeded : 1200 1201 1202
regionserver.TestRegionServerReportForDuty	20.0% (1 / 5)	1 / 0 / 0	Failed : 1219 Timed Out : Hanging : Succeeded : 1215 1216 1217 1218
master.procedure.TestSnapshotProcedureRSCrashes	12.5% (1 / 8)	1 / 0 / 0	Failed : 1213 Timed Out : Hanging : Succeeded : 1206 1207 1208 1209 1210 1211 1214
replication.TestReplicationKillSlaveRS	11.1% (1 / 9)	1 / 0 / 0	Failed : 1219 Timed Out : Hanging : Succeeded : 1210 1211 1213 1214 1215 1216 1217 1218
client.TestClientScannerTimeouts	10.0% (1 / 10)	1 / 0 / 0	Failed : 1211 Timed Out : Hanging : Succeeded : 1200 1201 1204 1205 1206 1207 1208 1209 1210
regionserver.TestClearRegionBlockCache	8.3% (1 / 12)	1 / 0 / 0	Failed : 1219 Timed Out : Hanging : Succeeded : 1207 1208 1209 1210 1211 1213 1214 1215 1216 1217 1218
io.hfile.bucket.TestVerifyBucketCacheFile	7.7% (1 / 13)	1 / 0 / 0	Failed : 1212 Timed Out : Hanging : Succeeded : 1200 1201 1202 1204 1205 1206 1207 1208 1209 1210 1211 1213
client.TestAsyncTableGetMultiThreaded	6.7% (1 / 15)	0 / 0 / 1	Failed : Timed Out : Hanging : 1217 Succeeded : 1200 1201 1204 1205 1206 1207 1208 1209 1210 1211 1213 1214 1215 1216
regionserver.TestHRegionWithInMemoryFlush	6.7% (1 / 15)	1 / 0 / 0	Failed : 1216 Timed Out : Hanging : Succeeded : 1200 1201 1204 1205 1206 1207 1208 1209 1210 1211 1213 1214 1215 1217
client.TestCIGetOperationTimeout	6.7% (1 / 15)	0 / 0 / 1	Failed : Timed Out : Hanging : 1217 Succeeded : 1200 1201 1204 1205 1206 1207 1208 1209 1210 1211 1213 1214 1215 1216

https://ci-hbase.apache.org//job/HBase-Flaky-Tests/job/branch-2
Go to

Go to top

Legend : green: success, red: failed, yellow: timeout, blue: hanging

Test Name	Flakyness	Failed/Timeout/Hanging	Run Ids
quotas.TestDefaultQuota	100.0% (42 / 42)	42 / 0 / 0	Failed : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993 Timed Out : Hanging : Succeeded :
regionserver.wal.TestFSHLog	100.0% (42 / 42)	42 / 0 / 0	Failed : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993 Timed Out : Hanging : Succeeded :
security.TestNettyTLSIPCFileWatcher	100.0% (42 / 42)	42 / 0 / 0	Failed : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993 Timed Out : Hanging : Succeeded :
client.TestAsyncReplicationAdminApi	69.0% (29 / 42)	29 / 0 / 0	Failed : 23944 23946 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23960 23961 23962 23963 23964 23966 23967 23968 23972 23973 23974 23984 23985 23986 23989 23990 23991 Timed Out : Hanging : Succeeded : 23945 23947 23958 23959 23965 23969 23970 23971 23981 23983 23987 23988 23993
io.TestFileChangeWatcher	48.8% (21 / 43)	21 / 0 / 0	Failed : 23944 23945 23947 23948 23949 23953 23954 23955 23960 23964 23965 23967 23968 23969 23971 23972 23973 23981 23984 23989 23990 Timed Out : Hanging : Succeeded : 23946 23950 23951 23952 23956 23957 23958 23959 23961 23962 23963 23966 23970 23974 23975 23983 23985 23986 23987 23988 23991 23993
quotas.TestClusterScopeQuotaThrottle	28.6% (12 / 42)	12 / 0 / 0	Failed : 23950 23952 23957 23959 23962 23966 23973 23974 23981 23985 23988 23990 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23951 23953 23954 23955 23956 23958 23960 23961 23963 23964 23965 23967 23968 23969 23970 23971 23972 23983 23984 23986 23987 23989 23991 23993
master.procedure.TestSnapshotProcedureRSCrashes	14.3% (6 / 42)	6 / 0 / 0	Failed : 23944 23955 23961 23970 23985 23991 Timed Out : Hanging : Succeeded : 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23956 23957 23958 23959 23960 23962 23963 23964 23965 23966 23967 23968 23969 23971 23972 23973 23974 23981 23983 23984 23986 23987 23988 23989 23990 23993
client.TestClientScannerTimeouts	7.1% (3 / 42)	3 / 0 / 0	Failed : 23950 23952 23968 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23951 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
io.hfile.bucket.TestRecoveryPersistentBucketCache	7.1% (3 / 42)	3 / 0 / 0	Failed : 23957 23981 23986 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23983 23984 23985 23987 23988 23989 23990 23991 23993
regionserver.wal.TestHBaseWalOnEC	7.1% (3 / 42)	3 / 0 / 0	Failed : 23961 23987 23991 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23988 23989 23990 23993
rsgroup.TestTableDescriptorWithRSGroup	4.9% (2 / 41)	2 / 0 / 0	Failed : 23965 23989 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23966 23967 23968 23969 23970 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23990 23991 23993
replication.regionserver.TestMetaRegionReplicaReplicationEndpoint	4.8% (2 / 42)	2 / 0 / 0	Failed : 23948 23964 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
client.TestAsyncClusterAdminApi	4.8% (2 / 42)	2 / 0 / 0	Failed : 23960 23971 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
snapshot.TestSecureExportSnapshot	4.8% (2 / 42)	1 / 0 / 1	Failed : 23983 Timed Out : Hanging : 23971 Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23972 23973 23974 23981 23984 23985 23986 23987 23988 23989 23990 23991 23993
snapshot.TestMobSecureExportSnapshot	2.4% (1 / 42)	0 / 0 / 1	Failed : Timed Out : Hanging : 23971 Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
master.procedure.TestHBCKSCP	2.4% (1 / 42)	1 / 0 / 0	Failed : 23971 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
rsgroup.TestRSGroupsBasics	2.4% (1 / 42)	0 / 0 / 1	Failed : Timed Out : Hanging : 23971 Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
master.region.TestMasterRegionWALCleaner	2.4% (1 / 42)	1 / 0 / 0	Failed : 23961 Timed Out : Hanging : Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
rsgroup.TestRSGroupsBalance	2.4% (1 / 42)	0 / 0 / 1	Failed : Timed Out : Hanging : 23971 Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
mob.TestMobCompactionOptRegionBatchMode	2.3% (1 / 43)	0 / 0 / 1	Failed : Timed Out : Hanging : 23975 Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993
mob.TestMobCompactionOptMode	2.3% (1 / 43)	0 / 0 / 1	Failed : Timed Out : Hanging : 23975 Succeeded : 23944 23945 23946 23947 23948 23949 23950 23951 23952 23953 23954 23955 23956 23957 23958 23959 23960 23961 23962 23963 23964 23965 23966 23967 23968 23969 23970 23971 23972 23973 23974 23981 23983 23984 23985 23986 23987 23988 23989 23990 23991 23993