INFO [main] <main> 2024-07-04 05:20:29,055 Reflections.java:219 - Reflections took 3243 ms to scan 9 urls, producing 2284 keys and 9328 values INFO [main] <main> 2024-07-04 05:20:31,357 Reflections.java:219 - Reflections took 2193 ms to scan 9 urls, producing 2284 keys and 9328 values Node id topology: node 1: dc = dc0, rack = rack0 node 2: dc = dc0, rack = rack0 node 3: dc = dc0, rack = rack0 node 4: dc = dc0, rack = rack0 Configured node count: 4, nodeIdTopology size: 4 DEBUG [main] node1 2024-07-04 05:20:32,080 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-07-04 05:20:32,087 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-07-04 05:20:32,087 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node1 2024-07-04 05:20:32,089 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-07-04 05:20:32,097 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node1 2024-07-04 05:20:32,098 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-07-04 05:20:32,099 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node1 2024-07-04 05:20:32,100 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node1 2024-07-04 05:20:32,101 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-07-04 05:20:32,103 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-07-04 05:20:32,105 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-07-04 05:20:32,105 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node1 2024-07-04 05:20:32,116 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node1 2024-07-04 05:20:32,116 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-07-04 05:20:32,116 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-07-04 05:20:32,118 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node1 2024-07-04 05:20:32,118 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-07-04 05:20:32,120 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-07-04 05:20:32,120 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node2 2024-07-04 05:20:32,753 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node2 2024-07-04 05:20:32,762 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node2 2024-07-04 05:20:32,763 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node2 2024-07-04 05:20:32,773 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node2 2024-07-04 05:20:32,774 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node2 2024-07-04 05:20:32,775 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node2 2024-07-04 05:20:32,776 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node2 2024-07-04 05:20:32,778 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node2 2024-07-04 05:20:32,779 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node2 2024-07-04 05:20:32,781 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node2 2024-07-04 05:20:32,786 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node2 2024-07-04 05:20:32,786 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node2 2024-07-04 05:20:32,787 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node2 2024-07-04 05:20:32,797 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node2 2024-07-04 05:20:32,797 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node2 2024-07-04 05:20:32,815 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node2 2024-07-04 05:20:32,816 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node2 2024-07-04 05:20:32,817 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node2 2024-07-04 05:20:32,818 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node3 2024-07-04 05:20:33,461 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node3 2024-07-04 05:20:33,470 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node3 2024-07-04 05:20:33,470 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node3 2024-07-04 05:20:33,472 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node3 2024-07-04 05:20:33,473 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node3 2024-07-04 05:20:33,473 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node3 2024-07-04 05:20:33,474 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node3 2024-07-04 05:20:33,475 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node3 2024-07-04 05:20:33,476 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node3 2024-07-04 05:20:33,478 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node3 2024-07-04 05:20:33,479 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node3 2024-07-04 05:20:33,479 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node3 2024-07-04 05:20:33,480 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node3 2024-07-04 05:20:33,480 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node3 2024-07-04 05:20:33,480 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node3 2024-07-04 05:20:33,482 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node3 2024-07-04 05:20:33,482 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node3 2024-07-04 05:20:33,483 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node3 2024-07-04 05:20:33,484 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node4 2024-07-04 05:20:34,082 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node4 2024-07-04 05:20:34,089 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node4 2024-07-04 05:20:34,090 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node4 2024-07-04 05:20:34,092 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node4 2024-07-04 05:20:34,093 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node4 2024-07-04 05:20:34,095 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node4 2024-07-04 05:20:34,098 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node4 2024-07-04 05:20:34,099 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node4 2024-07-04 05:20:34,100 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node4 2024-07-04 05:20:34,102 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node4 2024-07-04 05:20:34,103 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node4 2024-07-04 05:20:34,103 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node4 2024-07-04 05:20:34,105 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node4 2024-07-04 05:20:34,106 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node4 2024-07-04 05:20:34,106 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node4 2024-07-04 05:20:34,110 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node4 2024-07-04 05:20:34,111 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node4 2024-07-04 05:20:34,113 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node4 2024-07-04 05:20:34,114 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,345 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,347 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,349 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,350 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,350 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,353 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,368 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,374 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,824 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,838 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,897 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,897 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,898 CassandraDaemon.java:613 - Heap size: 176.000MiB/1.000GiB INFO [node1_ScheduledTasks:1] node1 2024-07-04 05:20:34,927 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,905 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1348224(1316K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,948 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 37418000(36541K) committed = 37879808(36992K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,948 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 6458624(6307K) committed = 6488064(6336K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,948 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 4737344(4626K) committed = 4915200(4800K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,948 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 67108864(65536K) committed = 83886080(81920K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,949 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 39282688(38362K) committed = 134217728(131072K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,949 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 8949720(8739K) committed = 16777216(16384K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,949 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 1634432(1596K) committed = 2555904(2496K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,950 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,950 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:34,995 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,001 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds WARN 05:20:35 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,428 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:20:35 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,437 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:20:35 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,438 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,498 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,500 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,525 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,536 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,537 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,539 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,540 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,550 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,560 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,560 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,561 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,562 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,563 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,564 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,568 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,570 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,572 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,573 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,574 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,574 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,576 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,576 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:20:35 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,578 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:20:35 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,579 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,581 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,585 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,590 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,590 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,591 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,591 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,592 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/hints DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,814 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:35,815 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,421 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,427 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,681 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,732 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,746 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node1_SecondaryIndexManagement:1] node1 2024-07-04 05:20:36,777 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,780 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,789 ColumnFamilyStore.java:508 - Initializing system.local INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,801 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,809 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,821 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,829 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,838 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,847 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,855 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,863 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,870 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,879 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,887 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,895 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,902 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,909 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,916 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,924 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,933 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,940 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,948 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,950 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,950 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:36,957 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,003 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,266 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,280 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,290 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,302 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,312 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,322 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,331 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,341 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,376 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,386 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,394 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,406 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,407 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,433 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,435 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,462 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,463 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,463 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,465 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,465 Startup.java:97 - Initializing as first CMS node in a new cluster DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,605 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,606 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,606 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,606 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,615 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_642653979221517633057.so DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,622 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,622 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,625 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,627 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,627 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,634 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,646 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,684 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,693 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,694 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,856 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,884 StorageService.java:494 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,887 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,913 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,915 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,915 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,929 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,930 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,941 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,943 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:37,943 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:20:38,023 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:38,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.582KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,201 Flushing.java:153 - Writing Memtable-columns@135833761(735B serialized bytes, 4 ops, 3.582KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,213 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,332 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,357 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,358 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,359 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,377 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_25ffdb00-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,410 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,412 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:38,437 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.012KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,488 Flushing.java:153 - Writing Memtable-tables@580325652(868B serialized bytes, 1 ops, 3.012KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,490 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,555 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_26391370-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,567 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,567 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:38,569 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 795B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,584 Flushing.java:153 - Writing Memtable-keyspaces@750662866(151B serialized bytes, 1 ops, 795B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,585 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,631 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_264d10a0-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,642 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,642 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:38,644 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:38,699 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=1} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:38,727 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,738 Flushing.java:153 - Writing Memtable-local_metadata_log@1414171198(110B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:38,739 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (41B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=1686) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,773 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_26652c80-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,776 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:38,776 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.084KiB), biggest 5.084KiB, smallest 5.084KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:38,781 LocalLog.java:492 - Enacted PreInitialize{addr=/127.0.0.1:7012}. New tail is Epoch{epoch=1} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:38,801 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,036 AbstractLocalProcessor.java:98 - Committed Initialize{baseState = Epoch{epoch=1}}. New epoch is Epoch{epoch=2} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,038 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=2} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,046 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.043KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,060 Flushing.java:153 - Writing Memtable-local_metadata_log@1522992087(1.409KiB serialized bytes, 1 ops, 2.043KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,062 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070435049, position=8779) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,096 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_26960080-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,099 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,100 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.750KiB), biggest 5.750KiB, smallest 5.750KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,105 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,113 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,146 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,154 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,160 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,165 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,175 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,184 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,203 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,204 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,204 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,214 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,216 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,217 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,225 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,242 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,257 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,267 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,373 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.705KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,384 Flushing.java:153 - Writing Memtable-columns@1086502442(11.795KiB serialized bytes, 68 ops, 54.705KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,391 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070435049, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,445 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_26c7bee0-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,457 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,457 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,458 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.364KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,477 Flushing.java:153 - Writing Memtable-tables@495391300(11.222KiB serialized bytes, 14 ops, 36.364KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,487 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070435049, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,541 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_26d4b730-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,553 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,554 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,557 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.305KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,567 Flushing.java:153 - Writing Memtable-keyspaces@488399024(471B serialized bytes, 3 ops, 2.305KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:39,568 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,616 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_26e3d260-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,621 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:39,622 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,622 LocalLog.java:492 - Enacted EXECUTED {Initialize{baseState = Epoch{epoch=1}}}. New tail is Epoch{epoch=2} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:39,627 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,635 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.1:7012), nic: lo, encryption: unencrypted DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,681 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,682 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,703 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,710 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,712 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,752 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,752 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,752 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,753 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,753 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,753 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,754 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,754 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,754 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,754 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,754 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,754 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,776 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,776 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,776 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,811 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,812 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,812 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,812 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,814 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:39,984 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,072 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,072 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,075 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,079 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,080 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,080 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,085 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,085 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,086 StorageService.java:704 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,086 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,089 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,264 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.121KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:40,273 Flushing.java:153 - Writing Memtable-local@2133262719(462B serialized bytes, 4 ops, 2.121KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:40,274 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (216B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=66061) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:40,298 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_274fb390-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:40,301 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:40,302 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.883KiB), biggest 5.883KiB, smallest 5.883KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,302 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,317 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,318 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.1:7012 because it is not a member in token metadata INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:40,323 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:41,624 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:41,927 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,227 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,228 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,313 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=3} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,315 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=3} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:42,318 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 817B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,362 Flushing.java:153 - Writing Memtable-local_metadata_log@713132887(168B serialized bytes, 1 ops, 817B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,362 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=67241) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,386 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_288d8ac0-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,388 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,389 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:42,389 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=3} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:42,391 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,391 Register.java:122 - Registering with endpoint /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,393 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 583B (0%) on-heap, 0B (0%) off-heap INFO [node1_OptionalTasks:1] node1 2024-07-04 05:20:42,395 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 571B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,406 Flushing.java:153 - Writing Memtable-local@254912881(65B serialized bytes, 1 ops, 583B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,406 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=67325) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,425 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_28948fa0-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,427 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,428 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,428 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000001, (Note: This should happen exactly once per node) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,437 BootStrapper.java:256 - tokens manually specified as [10] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,452 Flushing.java:153 - Writing Memtable-local@1909866951(53B serialized bytes, 1 ops, 571B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,453 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=67407) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,507 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=4} INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,516 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2899bfc0-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,516 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=4} DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,522 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,522 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:20:42,523 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.1:7012 because it is not a member in token metadata INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:42,523 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 764B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:42,533 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,537 Flushing.java:153 - Writing Memtable-local_metadata_log@910006907(115B serialized bytes, 1 ops, 764B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,538 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=68373) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,605 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_28a83eb0-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,610 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,610 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:42,611 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=4} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:42,613 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,644 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 576B (0%) on-heap, 0B (0%) off-heap INFO [node1_OptionalTasks:1] node1 2024-07-04 05:20:42,658 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 705B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,661 Flushing.java:153 - Writing Memtable-local@281044184(58B serialized bytes, 1 ops, 576B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=68456) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,716 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_28bb0360-39c5-11ef-9462-3bb8c7522e1d.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,719 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,719 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,719 Startup.java:400 - NORMAL INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,739 Flushing.java:153 - Writing Memtable-local@314060176(63B serialized bytes, 1 ops, 705B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,740 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=68533) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,751 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,751 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,777 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,777 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB WARN 05:20:42 Using stored Gossip Generation 1720070443 as it is greater than current system time 1720070442. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:20:42,785 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070443 as it is greater than current system time 1720070442. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:20:42,787 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 571B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,801 Flushing.java:153 - Writing Memtable-local@1369677433(53B serialized bytes, 1 ops, 571B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=68615) DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:42,807 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,808 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:42,810 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:42,811 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),41), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,825 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,846 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:42,849 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617874285773 bytes available, checking if we can write 919 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:42,850 CompactionTask.java:167 - Compacting (28d5de60-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,871 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:20:42,874 SnapshotManager.java:125 - Adding snapshots: . WARN 05:20:42 Using stored Gossip Generation 1720070444 as it is greater than current system time 1720070442. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:20:42,884 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070444 as it is greater than current system time 1720070442. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:20:42,886 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 571B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,895 Flushing.java:153 - Writing Memtable-local@186071156(53B serialized bytes, 1 ops, 571B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:42,896 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=68697) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:42,955 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:42,964 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,008 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,010 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,010 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,011 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,010 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,012 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,011 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,017 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,014 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,017 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,017 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,018 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,018 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,025 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,026 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,026 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,026 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,026 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,030 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,030 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,024 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,037 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,039 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,040 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,092 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:43,097 CompactionTask.java:258 - Compacted (28d5de60-39c5-11ef-9462-3bb8c7522e1d) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big,] to level=0. 919B to 867B (~94% of original) in 222ms. Read Throughput = 4.035KiB/s, Write Throughput = 3.807KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 132ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:43,099 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617874165146 bytes available, checking if we can write 373 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:43,099 CompactionTask.java:167 - Compacting (28fffba0-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,105 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,111 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,121 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:43,262 CompactionTask.java:258 - Compacted (28fffba0-39c5-11ef-9462-3bb8c7522e1d) 7 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big,] to level=0. 373B to 224B (~60% of original) in 154ms. Read Throughput = 2.357KiB/s, Write Throughput = 1.415KiB/s, Row Throughput = ~2/s. 7 total partitions merged to 1. Partition merge counts were {7:1, }. Time spent writing keys = 50ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:43,266 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:43,266 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,270 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,289 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,291 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,309 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,318 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,335 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,335 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,339 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,349 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,362 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,366 SSLFactory.java:264 - Initializing hot reloading SSLContext DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,371 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:43,377 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node4_ScheduledTasks:1] node4 2024-07-04 05:20:43,418 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node2_ScheduledTasks:1] node2 2024-07-04 05:20:43,425 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node3_ScheduledTasks:1] node3 2024-07-04 05:20:43,443 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,444 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,444 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,445 CassandraDaemon.java:613 - Heap size: 288.000MiB/1.000GiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,456 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1548544(1512K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,457 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 75507304(73737K) committed = 76087296(74304K) max = -1(-1K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,457 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 10857088(10602K) committed = 10944512(10688K) max = 122912768(120032K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,457 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 9544024(9320K) committed = 9830400(9600K) max = 1073741824(1048576K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,457 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 83886080(81920K) committed = 100663296(98304K) max = -1(-1K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,458 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 81364992(79458K) committed = 184549376(180224K) max = 1073741824(1048576K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,458 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 13348608(13035K) committed = 16777216(16384K) max = -1(-1K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,458 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 2777472(2712K) committed = 2818048(2752K) max = 122916864(120036K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,459 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,459 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,465 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,465 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,465 CassandraDaemon.java:613 - Heap size: 288.000MiB/1.000GiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,466 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1548544(1512K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,466 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 75647944(73874K) committed = 76283904(74496K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,466 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 10857088(10602K) committed = 10944512(10688K) max = 122912768(120032K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,466 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,466 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 9558352(9334K) committed = 9895936(9664K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,466 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,466 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 83886080(81920K) committed = 100663296(98304K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,466 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 81364992(79458K) committed = 184549376(180224K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,467 CassandraDaemon.java:613 - Heap size: 288.000MiB/1.000GiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,467 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 13348608(13035K) committed = 16777216(16384K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,467 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 2777472(2712K) committed = 2818048(2752K) max = 122916864(120036K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,467 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,467 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1548544(1512K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,467 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 75648112(73875K) committed = 76283904(74496K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,467 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,467 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 10857088(10602K) committed = 10944512(10688K) max = 122912768(120032K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,467 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 9558352(9334K) committed = 9895936(9664K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,468 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 83886080(81920K) committed = 100663296(98304K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,468 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 81364992(79458K) committed = 184549376(180224K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,468 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 13348608(13035K) committed = 16777216(16384K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,468 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 2777472(2712K) committed = 2818048(2752K) max = 122916864(120036K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,468 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,468 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,500 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:43,502 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,506 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,511 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:43,513 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:43,517 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds WARN 05:20:44 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,018 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:20:44 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,025 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:20:44 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,026 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN 05:20:44 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,109 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,110 FileUtil.java:113 - Reading file /proc/self/auxv WARN 05:20:44 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,113 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:20:44 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,121 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,121 FileUtil.java:113 - Reading file /proc/self/auxv WARN 05:20:44 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,122 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN 05:20:44 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,134 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:20:44 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,135 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,142 FileUtil.java:74 - Reading file /proc/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,145 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,146 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,146 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,146 FileUtil.java:74 - Reading file /proc/version DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,148 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,148 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,153 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,154 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,160 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,164 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,164 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,164 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,165 FileUtil.java:74 - Reading file /proc/version DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,166 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,174 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,177 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,179 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,179 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,180 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,180 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,180 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,180 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,181 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,181 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,181 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,182 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,182 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,182 FileUtil.java:74 - Reading file /proc/version DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,183 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,183 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,183 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,183 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,184 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,184 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:20:44 Cassandra server running in degraded mode. Swap should be disabled. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,185 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:20:44 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,185 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,187 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data2. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,190 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,191 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,193 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,194 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,194 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,194 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,195 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,195 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,196 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,196 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data2 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,196 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/commitlog DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,197 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/saved_caches DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,197 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/hints DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,200 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,200 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,200 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,196 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,200 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,201 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,201 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,201 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,201 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,201 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,202 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,202 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,202 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,202 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,202 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,202 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,203 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,203 FileUtil.java:74 - Reading file /proc/5322/io WARN 05:20:44 Cassandra server running in degraded mode. Swap should be disabled. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,203 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:20:44 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,203 FileUtil.java:344 - Reading file /proc/5322/status WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,203 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,204 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,204 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,204 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,205 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2. WARN 05:20:44 Cassandra server running in degraded mode. Swap should be disabled. WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,205 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:20:44 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,206 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,213 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,214 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,218 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,218 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,218 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/commitlog DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,218 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/saved_caches DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,218 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/hints DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,224 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,230 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,230 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,230 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/commitlog DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,230 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/saved_caches DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,231 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/hints DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,395 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,395 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,419 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:44,419 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,423 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,424 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,859 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:44,864 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:44,998 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,003 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,099 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,106 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,214 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,231 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,247 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,267 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,277 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node2_SecondaryIndexManagement:1] node2 2024-07-04 05:20:45,281 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,289 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,291 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,302 ColumnFamilyStore.java:508 - Initializing system.local INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,310 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,315 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,318 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node4_SecondaryIndexManagement:1] node4 2024-07-04 05:20:45,307 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,327 ColumnFamilyStore.java:508 - Initializing system.local INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,328 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,336 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,345 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,345 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,345 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,351 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,353 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,359 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,368 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,369 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,377 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,377 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node3_SecondaryIndexManagement:1] node3 2024-07-04 05:20:45,378 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,385 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,390 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,393 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,393 ColumnFamilyStore.java:508 - Initializing system.local INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,399 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,402 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,410 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,411 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,416 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,418 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,424 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,425 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,431 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,433 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,434 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,440 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,442 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,451 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,451 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,462 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,463 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,467 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,471 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,472 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,478 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,480 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,485 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,504 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,505 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,506 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,506 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,507 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,513 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,513 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,514 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,519 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,520 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,527 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,534 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,539 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,541 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,543 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,543 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,547 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,549 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,553 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,556 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,559 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,569 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,590 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,597 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,603 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,610 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,616 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,603 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,639 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,640 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,640 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,646 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,686 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,732 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,739 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,748 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,758 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,765 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,766 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,771 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,773 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,777 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,780 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,788 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,788 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,794 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,794 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,799 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,800 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,805 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,805 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,811 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,815 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,816 CassandraDaemon.java:514 - opening keyspace system DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,817 CassandraDaemon.java:514 - opening keyspace system_schema INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,817 ColumnFamilyStore.java:508 - Initializing system_schema.functions DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,817 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,823 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,828 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,828 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,828 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,830 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,830 Startup.java:108 - Initializing for discovery INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,838 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,838 CassandraDaemon.java:514 - opening keyspace system DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,839 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,840 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,849 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,849 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,850 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,851 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,851 Startup.java:108 - Initializing for discovery INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,861 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,868 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,877 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,901 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,908 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,915 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,922 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,928 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,935 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,941 ColumnFamilyStore.java:508 - Initializing system_schema.indexes DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,948 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,948 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,948 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,948 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,951 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,952 CassandraDaemon.java:514 - opening keyspace system DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,952 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,953 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,954 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6410309485628203613014.so DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,958 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,958 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,960 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,961 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,961 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,961 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,961 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,962 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:45,963 Startup.java:108 - Initializing for discovery DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,965 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,965 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,965 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,965 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,965 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,971 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,971 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6412559899358852399125.so DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,974 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,974 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,976 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,976 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,977 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,981 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,984 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,987 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,988 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node4_Messaging-EventLoop DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:45,988 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:45,999 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,002 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node2_Messaging-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,003 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,035 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,035 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,035 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,035 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,039 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6417029118057260884686.so DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,042 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,042 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,043 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,044 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,044 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,047 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,047 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,050 StorageService.java:494 - Initializing storage service mbean DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,052 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,052 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,062 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,064 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,065 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,065 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,065 StorageService.java:494 - Initializing storage service mbean DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,065 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,067 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,068 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node3_Messaging-EventLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,069 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,071 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,071 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,077 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,077 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,078 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,078 LocalLog.java:629 - Adding default listeners to LocalLog DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,078 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,078 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,084 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,084 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,091 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,092 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,092 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_COMMIT-LOG-WRITER] node4 2024-07-04 05:20:46,107 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,112 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.578KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_COMMIT-LOG-WRITER] node2 2024-07-04 05:20:46,124 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,131 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.578KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,136 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,140 StorageService.java:494 - Initializing storage service mbean INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,142 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,177 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,177 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,177 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,186 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,186 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,195 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,196 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,196 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,198 Flushing.java:153 - Writing Memtable-columns@2003396844(735B serialized bytes, 4 ops, 3.578KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,201 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=1479) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,223 Flushing.java:153 - Writing Memtable-columns@281519006(735B serialized bytes, 4 ops, 3.578KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,226 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=1479) INFO [node3_COMMIT-LOG-WRITER] node3 2024-07-04 05:20:46,233 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,240 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.573KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,268 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,274 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,275 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,275 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,282 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,284 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_2acccc60-39c5-11ef-b980-e34c7a70c3a6.log INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,288 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,289 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,289 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,296 Flushing.java:153 - Writing Memtable-columns@942959429(735B serialized bytes, 4 ops, 3.573KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,296 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_2acfd9a0-39c5-11ef-bf85-f712d21df3f6.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,299 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=1479) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,300 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,301 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,303 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.008KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,308 Flushing.java:153 - Writing Memtable-tables@204031098(868B serialized bytes, 1 ops, 3.008KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,309 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=1479) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,311 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,311 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,313 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.008KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,318 Flushing.java:153 - Writing Memtable-tables@1982933645(868B serialized bytes, 1 ops, 3.008KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,318 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=1479) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,345 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_2ae906f0-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,348 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,348 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,348 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 791B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,350 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_2aea8d90-39c5-11ef-bf85-f712d21df3f6.log INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,352 Flushing.java:153 - Writing Memtable-keyspaces@459055381(151B serialized bytes, 1 ops, 791B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,353 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=1479) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,353 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,357 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,357 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,357 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 791B (0%) on-heap, 0B (0%) off-heap INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,360 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,360 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,372 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,373 Flushing.java:153 - Writing Memtable-keyspaces@1446043103(151B serialized bytes, 1 ops, 791B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,373 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=1479) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,402 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_2ae05460-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,422 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,423 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,424 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.003KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,451 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_2af00bd0-39c5-11ef-b980-e34c7a70c3a6.log INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,451 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_2af16b60-39c5-11ef-bf85-f712d21df3f6.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,451 Flushing.java:153 - Writing Memtable-tables@666028708(868B serialized bytes, 1 ops, 3.003KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,453 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=1479) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,455 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,455 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,455 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,455 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,469 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_2afba490-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,472 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,472 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,472 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 786B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,475 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,475 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,477 Flushing.java:153 - Writing Memtable-keyspaces@1212431743(151B serialized bytes, 1 ops, 786B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,477 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=1479) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,481 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.2:7012), nic: null, encryption: unencrypted INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,481 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.4:7012), nic: null, encryption: unencrypted INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,493 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_2b02f790-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,496 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,496 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,497 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,498 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,498 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,499 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,499 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,502 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,505 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,505 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,506 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,508 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,509 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,520 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,521 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,521 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,521 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,521 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,524 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.3:7012), nic: null, encryption: unencrypted DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,527 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,527 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,527 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,528 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,528 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,528 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,528 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,528 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,528 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,528 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,529 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,529 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,529 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,529 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,529 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,537 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,537 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,537 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,538 Startup.java:205 - Discovering other nodes in the system DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,538 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:46,539 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@38e9f68d) to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,546 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,546 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,551 Startup.java:205 - Discovering other nodes in the system DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,551 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,552 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:46,553 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@16a57733) to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,562 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,563 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,580 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,580 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,580 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,580 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,581 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,589 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,589 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,590 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,601 Startup.java:205 - Discovering other nodes in the system DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,601 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,601 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,601 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,602 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@1001f49e INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:46,602 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@460ca502) to /127.0.0.1:7012 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,605 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,605 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,605 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,605 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,605 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,610 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,610 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,610 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@65be8ba DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,625 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,625 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,626 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@6fc1b10 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,628 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,629 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,629 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,629 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,629 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,630 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,630 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,630 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,630 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,630 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:46,649 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:51262)->/127.0.0.1:7012-URGENT_MESSAGES-c0fb7cc0 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:46,651 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:51266)->/127.0.0.1:7012-URGENT_MESSAGES-b0e95f57 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,653 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:51262)->/127.0.0.1:7012-URGENT_MESSAGES-1090844f messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:46,653 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:51266)->/127.0.0.1:7012-URGENT_MESSAGES-5d5f5a80 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:46,656 Discovery.java:182 - Responding to discovery request from /127.0.0.2:7012: [/127.0.0.1:7012] DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:46,656 Discovery.java:182 - Responding to discovery request from /127.0.0.4:7012: [/127.0.0.1:7012] DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,657 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,657 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,658 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@25803217 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,660 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,660 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,660 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,660 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,661 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,663 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:51282)->/127.0.0.1:7012-URGENT_MESSAGES-dc415c9e messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:46,680 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:51282)->/127.0.0.1:7012-URGENT_MESSAGES-4ff099df successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:46,684 Discovery.java:182 - Responding to discovery request from /127.0.0.3:7012: [/127.0.0.1:7012] INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:46,691 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:49698)->/127.0.0.2:7012-URGENT_MESSAGES-f2d0d1d6 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:46,691 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:34576)->/127.0.0.4:7012-URGENT_MESSAGES-efa6c2e7 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:46,694 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:55182)->/127.0.0.3:7012-URGENT_MESSAGES-fc935f0d successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:46,698 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:49698)->/127.0.0.2:7012-URGENT_MESSAGES-b5640e85 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:46,700 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:34576)->/127.0.0.4:7012-URGENT_MESSAGES-1b291c24 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:20:46,702 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:46,705 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:55182)->/127.0.0.3:7012-URGENT_MESSAGES-0f5d36fb messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:20:46,704 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:20:46,709 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:46,737 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:46,743 FetchCMSLog.java:119 - Responding to /127.0.0.4:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:46,749 FetchCMSLog.java:119 - Responding to /127.0.0.3:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:20:46,760 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:20:46,761 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:20:46,763 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:20:46,763 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,765 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 748B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,767 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 748B (0%) on-heap, 0B (0%) off-heap INFO [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:20:46,770 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:20:46,771 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,771 Flushing.java:153 - Writing Memtable-local_metadata_log@1749023909(103B serialized bytes, 1 ops, 748B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,772 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=1679) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,773 Flushing.java:153 - Writing Memtable-local_metadata_log@1087903468(103B serialized bytes, 1 ops, 748B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,773 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=1679) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,774 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 743B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,786 Flushing.java:153 - Writing Memtable-local_metadata_log@467529832(103B serialized bytes, 1 ops, 743B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,786 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=1679) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,818 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b2f85d0-39c5-11ef-bf85-f712d21df3f6.log INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,826 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b2ffb00-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,827 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,827 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,827 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,828 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,832 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,832 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,832 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,833 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,845 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.039KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,849 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.039KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,859 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b30e560-39c5-11ef-b92b-69af062a2179.log INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,863 Flushing.java:153 - Writing Memtable-local_metadata_log@74798187(1.409KiB serialized bytes, 1 ops, 2.039KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:46,863 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070443576, position=3129) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,867 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,867 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,867 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,868 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,871 Flushing.java:153 - Writing Memtable-local_metadata_log@318870088(1.409KiB serialized bytes, 1 ops, 2.039KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:46,872 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070443560, position=3129) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,885 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.034KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,908 Flushing.java:153 - Writing Memtable-local_metadata_log@1718755590(1.409KiB serialized bytes, 1 ops, 2.034KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:46,909 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070443540, position=3129) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,919 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b3be1e0-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,927 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:46,927 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.750KiB), biggest 5.750KiB, smallest 5.750KiB INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,941 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b3c5710-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,944 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:46,945 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.750KiB), biggest 5.750KiB, smallest 5.750KiB INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,947 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b41d550-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,949 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:46,949 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.750KiB), biggest 5.750KiB, smallest 5.750KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,950 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,951 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,953 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,956 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,956 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,957 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,961 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,961 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,962 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,966 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,967 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,967 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,970 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,972 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,973 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,974 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,977 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,977 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,978 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,983 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,983 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,983 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,988 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,988 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,989 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,989 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,989 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,993 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,994 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,994 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,996 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,996 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,996 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:46,997 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,997 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:46,997 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:46,997 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,001 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,001 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,002 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,002 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,002 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,002 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,002 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,006 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,007 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,007 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,010 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,012 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,012 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,017 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,017 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,022 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,022 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,046 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.679KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,061 Flushing.java:153 - Writing Memtable-columns@1470378118(11.795KiB serialized bytes, 68 ops, 54.679KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,067 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070443540, position=16149) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,074 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.693KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,077 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.693KiB (1%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,086 Flushing.java:153 - Writing Memtable-columns@1431117510(11.795KiB serialized bytes, 68 ops, 54.693KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,086 Flushing.java:153 - Writing Memtable-columns@2079290154(11.795KiB serialized bytes, 68 ops, 54.693KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,092 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070443576, position=16149) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,094 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070443560, position=16149) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,128 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_2b5a8d70-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,130 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,131 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,131 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.338KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,136 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_2b5f2150-39c5-11ef-bf85-f712d21df3f6.log INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,136 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_2b5eac20-39c5-11ef-b980-e34c7a70c3a6.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,137 Flushing.java:153 - Writing Memtable-tables@1046626504(11.222KiB serialized bytes, 14 ops, 36.338KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,139 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,139 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,139 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,139 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,140 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070443540, position=16149) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,140 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.353KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,140 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.353KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,144 Flushing.java:153 - Writing Memtable-tables@728193395(11.222KiB serialized bytes, 14 ops, 36.353KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,144 Flushing.java:153 - Writing Memtable-tables@736204717(11.222KiB serialized bytes, 14 ops, 36.353KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,147 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070443576, position=16149) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,147 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070443560, position=16149) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,170 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_2b6785c0-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,178 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,179 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,179 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.278KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,196 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_2b68be40-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,198 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,198 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,199 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.293KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,200 Flushing.java:153 - Writing Memtable-keyspaces@1254668764(471B serialized bytes, 3 ops, 2.278KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,201 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=16149) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,201 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_2b68be40-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,203 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,204 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,204 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.293KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,205 Flushing.java:153 - Writing Memtable-keyspaces@1009556640(471B serialized bytes, 3 ops, 2.293KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,206 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=16149) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,209 Flushing.java:153 - Writing Memtable-keyspaces@730355077(471B serialized bytes, 3 ops, 2.293KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,209 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=16149) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,252 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_2b6ed8c0-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,268 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,268 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,268 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,273 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,276 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_2b71bef0-39c5-11ef-bf85-f712d21df3f6.log INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,277 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 808B (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,287 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_2b728240-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,297 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,297 Flushing.java:153 - Writing Memtable-local_metadata_log@1036376978(168B serialized bytes, 1 ops, 808B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,298 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,298 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=16414) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,298 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,304 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,306 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,308 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,308 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,308 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,312 Flushing.java:153 - Writing Memtable-local_metadata_log@307511618(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,313 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=16414) DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,317 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,319 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,326 Flushing.java:153 - Writing Memtable-local_metadata_log@881070446(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,327 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=16414) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,338 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b7da5d0-39c5-11ef-b92b-69af062a2179.log INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,346 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b8239b0-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,346 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,347 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,348 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,349 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,347 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,349 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,351 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,351 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,357 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b843580-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,360 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,360 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:47,360 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:47,360 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,360 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,362 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:20:47,361 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:20:47,363 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,372 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:47,372 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,372 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:20:47,373 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,377 Flushing.java:153 - Writing Memtable-local_metadata_log@312608257(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:47,378 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=16535) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,378 Flushing.java:153 - Writing Memtable-local_metadata_log@1259601068(115B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:47,379 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=16535) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,384 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,398 Flushing.java:153 - Writing Memtable-local_metadata_log@159552022(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:47,399 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=16535) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,438 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b8c24c0-39c5-11ef-bf85-f712d21df3f6.log INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,438 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b8c4bd0-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,450 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,450 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:47,450 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:47,450 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,450 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,450 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:47,454 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:47,455 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:47,455 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:47,456 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,464 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2b8e2090-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,477 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:47,477 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,477 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:47,479 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:47,481 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,457 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,458 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,458 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,458 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,458 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,458 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,458 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,458 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,459 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,459 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,484 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,484 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,485 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,485 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,486 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,552 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,552 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,556 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,585 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,587 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,591 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,593 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,594 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,595 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,596 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,596 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,596 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,597 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,597 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,598 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,598 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,599 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,601 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,601 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,601 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,601 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,601 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,601 StorageService.java:704 - CQL version: 3.4.8 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,601 StorageService.java:704 - CQL version: 3.4.8 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,601 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,601 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,601 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,620 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,621 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,623 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,624 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,624 StorageService.java:704 - CQL version: 3.4.8 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,624 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,650 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,650 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,653 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,758 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.112KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:48,765 Flushing.java:153 - Writing Memtable-local@1742438662(462B serialized bytes, 4 ops, 2.112KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:48,766 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=61213) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:48,802 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2c5fa160-39c5-11ef-b92b-69af062a2179.log INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,804 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.117KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:48,805 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:48,805 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.882KiB), biggest 5.882KiB, smallest 5.882KiB DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,805 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,806 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,807 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,807 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:48,808 Flushing.java:153 - Writing Memtable-local@903456519(462B serialized bytes, 4 ops, 2.117KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:48,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=61213) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,811 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:48,812 Gossiper.java:511 - Convicting /127.0.0.1:7012 with status NORMAL - alive true INFO [node3_GossipStage:1] node3 2024-07-04 05:20:48,812 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:20:48,813 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:48,813 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:48,814 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node3_GossipStage:1] node3 2024-07-04 05:20:48,817 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,817 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.117KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_GossipStage:1] node3 2024-07-04 05:20:48,818 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:48,819 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:51294)->/127.0.0.1:7012-URGENT_MESSAGES-bcda57ed successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:48,819 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:51294)->/127.0.0.1:7012-URGENT_MESSAGES-3f47bbdb messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:48,827 Flushing.java:153 - Writing Memtable-local@415235732(462B serialized bytes, 4 ops, 2.117KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:48,827 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=61213) DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:48,828 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:20:48,828 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:20:48,830 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,832 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,832 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,832 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,833 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:20:48,833 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:48,842 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2c66cd50-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:48,844 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:48,844 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.882KiB), biggest 5.882KiB, smallest 5.882KiB DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,845 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,846 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,846 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,846 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:48,850 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2c68c920-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,851 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:48,852 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:48,853 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.883KiB), biggest 5.883KiB, smallest 5.883KiB INFO [node2_GossipStage:1] node2 2024-07-04 05:20:48,853 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,853 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:20:48,853 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,854 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,854 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,854 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} INFO [node2_GossipStage:1] node2 2024-07-04 05:20:48,854 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:48,856 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:51296)->/127.0.0.1:7012-URGENT_MESSAGES-d81e91c9 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:48,856 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:51296)->/127.0.0.1:7012-URGENT_MESSAGES-89a431de messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,859 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:20:48,862 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node4_GossipStage:1] node4 2024-07-04 05:20:48,862 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:48,864 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:48,865 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:20:48,865 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:20:48,865 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster INFO [node4_GossipStage:1] node4 2024-07-04 05:20:48,865 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,865 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,865 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,865 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:48,866 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:51308)->/127.0.0.1:7012-URGENT_MESSAGES-cbee5896 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:48,866 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:51308)->/127.0.0.1:7012-URGENT_MESSAGES-5db4f515 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,867 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:20:48,867 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:48,873 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:48,873 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:20:48,873 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:20:48,873 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,873 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,874 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,874 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:48,875 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:20:48,875 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP WARN 05:20:49 Not marking nodes down due to local pause of 12558075966ns > 5000000000ns WARN [node1_GossipTasks:1] node1 2024-07-04 05:20:49,321 FailureDetector.java:355 - Not marking nodes down due to local pause of 12558075966ns > 5000000000ns DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:49,321 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:49,321 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node2_GossipStage:1] node2 2024-07-04 05:20:49,325 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,326 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,327 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,327 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata INFO [node2_GossipStage:1] node2 2024-07-04 05:20:49,327 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,328 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,328 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,328 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:49,328 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:55186)->/127.0.0.3:7012-URGENT_MESSAGES-b46f35d3 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:49,329 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:55186)->/127.0.0.3:7012-URGENT_MESSAGES-b5305157 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:49,330 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:34592)->/127.0.0.4:7012-URGENT_MESSAGES-c195d9e1 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:49,330 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:34592)->/127.0.0.4:7012-URGENT_MESSAGES-f513152a successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:49,333 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:49710)->/127.0.0.2:7012-URGENT_MESSAGES-4bf15bb0 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:49,333 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:49710)->/127.0.0.2:7012-URGENT_MESSAGES-2c04c200 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,334 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:20:49,334 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:49,335 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:49722)->/127.0.0.2:7012-URGENT_MESSAGES-414562da messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:49,335 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:49722)->/127.0.0.2:7012-URGENT_MESSAGES-6edb4d78 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:49,336 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:20:49,336 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,114 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 46, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:50,165 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 46, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:50,173 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 46, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:50,322 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:50,323 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:50,324 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node4_GossipStage:1] node4 2024-07-04 05:20:50,330 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,331 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,331 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,331 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata INFO [node4_GossipStage:1] node4 2024-07-04 05:20:50,332 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,335 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,336 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,336 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,336 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:20:50,336 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:50,338 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:55192)->/127.0.0.3:7012-URGENT_MESSAGES-b33fd135 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:50,338 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:55192)->/127.0.0.3:7012-URGENT_MESSAGES-6339b643 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:50,343 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:34606)->/127.0.0.4:7012-URGENT_MESSAGES-05c53a80 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:50,343 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:34606)->/127.0.0.4:7012-URGENT_MESSAGES-db0385b3 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:50,344 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:20:50,345 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,414 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 46, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:50,466 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 46, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:50,474 Gossiper.java:1957 - Gossip not settled after 2 polls. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,715 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 46, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,716 Gossiper.java:1971 - No gossip backlog; proceeding DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:50,780 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 47, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:50,780 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 46, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:50,781 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:50,789 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=4}} from /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:50,795 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=5} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:50,795 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=5} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:50,796 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 817B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:50,801 Flushing.java:153 - Writing Memtable-local_metadata_log@409107306(168B serialized bytes, 1 ops, 817B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:50,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=72311) INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:50,807 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=4}} from /127.0.0.2:7012 DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:50,844 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:50,844 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:50,844 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:50,844 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=5} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:50,845 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:50,845 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=5}, logState=LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}}} to sender /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:50,845 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:20:50,846 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,847 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:50,849 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 808B (0%) on-heap, 0B (0%) off-heap INFO [node3_GossipStage:1] node3 2024-07-04 05:20:50,850 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster INFO [node2_GossipStage:1] node2 2024-07-04 05:20:50,851 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=5} DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,851 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,851 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,851 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:50,851 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=6} INFO [node3_GossipStage:1] node3 2024-07-04 05:20:50,851 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:50,851 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=6} DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,851 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,851 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,851 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:50,852 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 817B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,853 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:20:50,853 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:50,854 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:20:50,854 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:50,854 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=4}} from /127.0.0.2:7012: start = Epoch{epoch=4}, current = Epoch{epoch=5} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:50,857 Flushing.java:153 - Writing Memtable-local_metadata_log@1758646904(168B serialized bytes, 1 ops, 808B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:50,857 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=61934) INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:50,858 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:20:50,859 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:50,861 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:50,867 Flushing.java:153 - Writing Memtable-local_metadata_log@1273303387(168B serialized bytes, 1 ops, 817B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:50,868 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=73491) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:50,877 Flushing.java:153 - Writing Memtable-local_metadata_log@1833497728(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:50,878 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=61934) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:50,927 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2d9eb110-39c5-11ef-b92b-69af062a2179.log INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:50,930 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2da0ace0-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:50,930 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:50,930 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:50,931 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:50,931 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:50,932 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:50,932 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,932 Register.java:122 - Registering with endpoint /127.0.0.3:7012 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:50,932 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:50,932 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=6} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:50,933 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:50,933 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:50,933 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:20:50,934 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,934 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 574B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:50,934 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:50,934 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:50,935 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_OptionalTasks:1] node3 2024-07-04 05:20:50,935 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 562B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:50,935 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:20:50,935 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:50,936 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:50,936 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:50,937 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=6}, logState=LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}}} to sender /127.0.0.2:7012 INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:20:50,937 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:20:50,938 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:50,938 Flushing.java:153 - Writing Memtable-local@2077789627(65B serialized bytes, 1 ops, 574B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:50,938 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=62018) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:50,939 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:50,945 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 808B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:50,945 Flushing.java:153 - Writing Memtable-local_metadata_log@1562834490(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:50,946 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62108) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:50,968 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2daba960-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:50,971 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:50,971 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,971 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000002, (Note: This should happen exactly once per node) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:50,974 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2dabf780-39c5-11ef-bf85-f712d21df3f6.log INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:50,974 BootStrapper.java:256 - tokens manually specified as [30] INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:50,976 Flushing.java:153 - Writing Memtable-local@796584176(53B serialized bytes, 1 ops, 562B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:50,976 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=62100) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:50,977 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:50,977 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:50,978 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=6} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:50,978 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:50,978 LocalLog.java:523 - An already appended entry Epoch{epoch=5} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=6} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:50,979 Register.java:122 - Registering with endpoint /127.0.0.2:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:50,980 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 579B (0%) on-heap, 0B (0%) off-heap INFO [node2_OptionalTasks:1] node2 2024-07-04 05:20:50,981 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:50,985 Flushing.java:153 - Writing Memtable-local@1605788049(65B serialized bytes, 1 ops, 579B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:50,985 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62192) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,002 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2db14eb0-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,013 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,014 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:20:51,014 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:51,014 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,031 Flushing.java:153 - Writing Memtable-local_metadata_log@336760744(168B serialized bytes, 1 ops, 808B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,031 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=62274) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,080 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2db2ae40-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,081 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 47, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 12, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 12, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 12, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,088 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,089 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,089 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000003, (Note: This should happen exactly once per node) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,091 BootStrapper.java:256 - tokens manually specified as [20] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,093 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=6}} from /127.0.0.2:7012 INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,098 Flushing.java:153 - Writing Memtable-local@665785599(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,098 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62274) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,111 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2db7de60-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,114 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,114 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,114 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=6} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,115 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:51,116 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:20:51,116 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,116 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=6}} from /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,119 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=7} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,119 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=7} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,121 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 764B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,124 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2dc35010-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,126 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,127 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:20:51,127 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:51,127 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,128 Flushing.java:153 - Writing Memtable-local_metadata_log@116919816(115B serialized bytes, 1 ops, 764B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,128 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=74457) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:51,162 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,162 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,162 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,162 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=7} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,162 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),867)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,163 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901819904 bytes available, checking if we can write 1116 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,163 CompactionTask.java:167 - Compacting (2dce73a0-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,164 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,164 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,164 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=7}, logState=LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}}} to sender /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:51,164 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,165 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:51,166 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:51,166 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,166 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,194 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=8} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,194 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=8} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,195 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,195 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 764B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,196 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,198 CompactionTask.java:258 - Compacted (2dce73a0-39c5-11ef-9462-3bb8c7522e1d) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.090KiB to 995B (~89% of original) in 33ms. Read Throughput = 32.577KiB/s, Write Throughput = 29.045KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,198 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,199 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,199 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,200 Flushing.java:153 - Writing Memtable-local_metadata_log@882790971(115B serialized bytes, 1 ops, 764B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,200 Flushing.java:153 - Writing Memtable-local_metadata_log@1789775424(115B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,200 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=76053) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,200 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=62395) INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,201 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,201 Flushing.java:153 - Writing Memtable-local_metadata_log@224991358(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,202 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62395) INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,203 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,206 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,265 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2dd3cad0-39c5-11ef-bf85-f712d21df3f6.log INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,265 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2dd37cb0-39c5-11ef-b92b-69af062a2179.log DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,276 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:51,277 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,277 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,277 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=8} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,279 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:51,279 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,281 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} to /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,282 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=8}, logState=LogState{baseState=none , entries=2: Epoch{epoch=7} -> Epoch{epoch=8}}} to sender /127.0.0.3:7012 INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:20:51,282 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:20:51,283 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,283 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=7} -> Epoch{epoch=8}} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,287 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,287 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,287 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,287 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,287 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=7} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,287 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=7} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,295 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,296 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:51,297 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_OptionalTasks:1] node2 2024-07-04 05:20:51,307 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 701B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,312 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,317 Flushing.java:153 - Writing Memtable-local@1737799887(63B serialized bytes, 1 ops, 701B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,317 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62472) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,318 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,323 Flushing.java:153 - Writing Memtable-local_metadata_log@1437017083(115B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,324 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=63023) DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:51,324 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:51,324 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:51,324 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node4_GossipStage:1] node4 2024-07-04 05:20:51,326 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=8} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:51,328 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=4}} from /127.0.0.4:7012: start = Epoch{epoch=4}, current = Epoch{epoch=8} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:51,332 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=4: Epoch{epoch=5} -> Epoch{epoch=8}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:20:51,334 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=5} -> Epoch{epoch=8}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,335 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,343 Flushing.java:153 - Writing Memtable-local_metadata_log@1911731323(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,344 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=61934) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,345 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2de493b0-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,353 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,353 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.024KiB), biggest 5.024KiB, smallest 5.024KiB WARN 05:20:51 Using stored Gossip Generation 1720070451 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-07-04 05:20:51,357 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070451 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,358 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2de66870-39c5-11ef-b92b-69af062a2179.log INFO [node2_OptionalTasks:1] node2 2024-07-04 05:20:51,359 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,361 Flushing.java:153 - Writing Memtable-local_metadata_log@197326661(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,361 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62593) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,367 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,367 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,367 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,370 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,381 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070440, version = 48, AppStateMap = {LOAD=Value(52184.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 12, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 12, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 12, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,382 Gossiper.java:1969 - Gossip settled after 2 extra polls; proceeding INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,381 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 569B (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,386 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2de90080-39c5-11ef-b980-e34c7a70c3a6.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,388 Flushing.java:153 - Writing Memtable-local@761425111(92B serialized bytes, 2 ops, 819B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,389 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=63183) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,392 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,392 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,393 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,393 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:51,394 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:20:51,394 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,395 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,408 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2deb9890-39c5-11ef-bf85-f712d21df3f6.log INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,409 Flushing.java:153 - Writing Memtable-local_metadata_log@1701430346(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,409 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=62108) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,419 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,420 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,420 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,421 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,425 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 572B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,437 Flushing.java:153 - Writing Memtable-local@1410667054(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,438 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62675) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,446 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2df00560-39c5-11ef-b92b-69af062a2179.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,465 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,465 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.092KiB), biggest 5.092KiB, smallest 5.092KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,465 Startup.java:400 - NORMAL WARN 05:20:51 Using stored Gossip Generation 1720070451 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems WARN [node3_OptionalTasks:1] node3 2024-07-04 05:20:51,469 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070451 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems INFO [node3_OptionalTasks:1] node3 2024-07-04 05:20:51,470 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 562B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,475 SnapshotManager.java:125 - Adding snapshots: . INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,475 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,480 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,481 Flushing.java:153 - Writing Memtable-local@755878172(53B serialized bytes, 1 ops, 562B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,482 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=63265) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,482 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,482 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,484 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,485 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,485 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2df22840-39c5-11ef-b980-e34c7a70c3a6.log INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:51,488 FetchCMSLog.java:119 - Responding to /127.0.0.3:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=8}}) with log delta: LogState{baseState=none , entries=0: []} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,489 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,489 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,489 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=6} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,490 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:51,490 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:20:51,490 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,491 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901512499 bytes available, checking if we can write 1216 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,492 CompactionTask.java:167 - Compacting (2dffe3e0-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,493 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,494 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2df5d1c0-39c5-11ef-bf85-f712d21df3f6.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,498 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,498 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:20:51,503 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,503 Flushing.java:153 - Writing Memtable-local@293227066(58B serialized bytes, 1 ops, 572B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,503 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62758) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,505 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB WARN 05:20:51 Using stored Gossip Generation 1720070452 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-07-04 05:20:51,507 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070452 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-07-04 05:20:51,508 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,510 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap WARN 05:20:51 Using stored Gossip Generation 1720070452 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems WARN [node3_OptionalTasks:1] node3 2024-07-04 05:20:51,516 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070452 as it is greater than current system time 1720070451. See CASSANDRA-3654 if you experience problems INFO [node3_OptionalTasks:1] node3 2024-07-04 05:20:51,517 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 562B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,517 Flushing.java:153 - Writing Memtable-local_metadata_log@2020014291(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,518 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=62229) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,521 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2e01b8a0-39c5-11ef-bf85-f712d21df3f6.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,524 Flushing.java:153 - Writing Memtable-local@701947187(53B serialized bytes, 1 ops, 562B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,524 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=63347) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,527 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,527 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,527 Startup.java:400 - NORMAL DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,565 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,565 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,568 Flushing.java:153 - Writing Memtable-local@1399511578(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,568 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=62840) DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,571 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,571 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,572 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2e03b470-39c5-11ef-b980-e34c7a70c3a6.log INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,574 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,574 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,576 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:51,577 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=8}}) with log delta: LogState{baseState=none , entries=0: []} DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,581 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901341286 bytes available, checking if we can write 1216 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,581 CompactionTask.java:167 - Compacting (2e0d9f80-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,582 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,590 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,590 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.095KiB), biggest 5.095KiB, smallest 5.095KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,591 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=7} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:20:51,592 SnapshotManager.java:125 - Adding snapshots: . DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,593 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:51,593 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,608 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:51,609 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,611 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,621 Flushing.java:153 - Writing Memtable-local_metadata_log@525001237(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,622 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=62857) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,631 CompactionTask.java:258 - Compacted (2dffe3e0-39c5-11ef-b92b-69af062a2179) 8 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.188KiB to 1012B (~83% of original) in 135ms. Read Throughput = 8.776KiB/s, Write Throughput = 7.304KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 34ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,632 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,632 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901267354 bytes available, checking if we can write 353 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,632 CompactionTask.java:167 - Compacting (2e1603f0-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,634 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,635 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,637 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,639 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,640 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,642 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,643 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:51,643 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:51,644 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,644 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,670 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2e12f6b0-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,682 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,682 CompactionTask.java:258 - Compacted (2e0d9f80-39c5-11ef-bf85-f712d21df3f6) 8 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.188KiB to 1013B (~83% of original) in 96ms. Read Throughput = 12.362KiB/s, Write Throughput = 10.298KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 37ms DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,682 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,682 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,682 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,683 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901516390 bytes available, checking if we can write 373 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,683 CompactionTask.java:167 - Compacting (2e1df330-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,685 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,685 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:51,685 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,687 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,687 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=8}} from /127.0.0.4:7012 INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,689 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,691 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=9} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,691 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=9} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,692 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,692 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 817B (0%) on-heap, 0B (0%) off-heap INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,694 CompactionTask.java:258 - Compacted (2e1603f0-39c5-11ef-b92b-69af062a2179) 6 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 353B to 231B (~65% of original) in 60ms. Read Throughput = 5.710KiB/s, Write Throughput = 3.736KiB/s, Row Throughput = ~2/s. 6 total partitions merged to 1. Partition merge counts were {6:1, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,695 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,696 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,696 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,696 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,698 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,698 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,700 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,700 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,702 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,704 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:51,706 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,709 Flushing.java:153 - Writing Memtable-local_metadata_log@1068287721(168B serialized bytes, 1 ops, 817B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,710 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=78778) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,742 CompactionTask.java:258 - Compacted (2e1df330-39c5-11ef-bf85-f712d21df3f6) 7 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big,] to level=0. 373B to 231B (~61% of original) in 57ms. Read Throughput = 6.356KiB/s, Write Throughput = 3.937KiB/s, Row Throughput = ~2/s. 7 total partitions merged to 1. Partition merge counts were {7:1, }. Time spent writing keys = 15ms DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,743 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,744 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,744 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,745 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:51,745 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,745 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,745 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=9} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,745 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,746 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,746 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:51,746 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:20:51,746 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:20:51,746 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=9}, logState=LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}}} to sender /127.0.0.4:7012 INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:51,747 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:51,747 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:20:51,747 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:20:51,747 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,747 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,748 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,748 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 808B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,748 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,750 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,751 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,752 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,755 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,756 Flushing.java:153 - Writing Memtable-local_metadata_log@1166187273(168B serialized bytes, 1 ops, 808B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,756 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=66542) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,757 Flushing.java:153 - Writing Memtable-local_metadata_log@1326348269(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,757 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,757 Flushing.java:153 - Writing Memtable-local_metadata_log@2071977195(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,758 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=65969) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,758 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=63538) INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:51,760 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node3_GossipStage:1] node3 2024-07-04 05:20:51,810 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node2_GossipStage:1] node2 2024-07-04 05:20:51,815 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,827 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2e287a80-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,827 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:51,827 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:51,827 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,827 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=9} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,828 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:51,828 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:20:51,829 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:51,838 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,838 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:51,838 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,838 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=9} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,838 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:51,839 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:20:51,839 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,842 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,842 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db')] (1 sstables, 5.139KiB), biggest 5.139KiB, smallest 5.139KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,843 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=9} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,843 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,843 Register.java:122 - Registering with endpoint /127.0.0.4:7012 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,845 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 579B (0%) on-heap, 0B (0%) off-heap INFO [node4_OptionalTasks:1] node4 2024-07-04 05:20:51,847 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,853 Flushing.java:153 - Writing Memtable-local@1344212058(65B serialized bytes, 1 ops, 579B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,853 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=63622) INFO [node4_GossipStage:1] node4 2024-07-04 05:20:51,857 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,891 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2e36ab50-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,894 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,894 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,894 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000004, (Note: This should happen exactly once per node) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,897 BootStrapper.java:256 - tokens manually specified as [40] INFO [node4_GossipStage:1] node4 2024-07-04 05:20:51,898 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,899 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=9}} from /127.0.0.4:7012 INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,902 Flushing.java:153 - Writing Memtable-local@535873258(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,903 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=63704) INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,917 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=10} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,917 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=10} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,917 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 764B (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,922 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2e3e2560-39c5-11ef-b980-e34c7a70c3a6.log INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,923 Flushing.java:153 - Writing Memtable-local_metadata_log@1545631630(115B serialized bytes, 1 ops, 764B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:51,923 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=79744) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,925 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:51,925 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:20:51,925 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:51,926 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 25, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,16), DC=Value(dc0,17), RACK=Value(rack0,18), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,19), INTERNAL_IP=Value(127.0.0.4,6), RPC_ADDRESS=Value(127.0.0.4,20), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,21), TOKENS=Value(,22), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,23), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,24), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,939 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:51,939 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,940 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,940 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=10} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,940 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),995), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,941 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901901619 bytes available, checking if we can write 1199 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,941 CompactionTask.java:167 - Compacting (2e452a40-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:51,941 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,941 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,942 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:20:51,942 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:20:51,942 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=10}, logState=LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}}} to sender /127.0.0.4:7012 INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:20:51,942 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:20:51,942 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:20:51,942 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:20:51,943 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:51,943 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:51,958 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:51,962 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:51,966 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,967 Flushing.java:153 - Writing Memtable-local_metadata_log@2075677626(115B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,967 Flushing.java:153 - Writing Memtable-local_metadata_log@1474483531(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:51,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=67210) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:51,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=64919) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,977 CompactionTask.java:258 - Compacted (2e452a40-39c5-11ef-9462-3bb8c7522e1d) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 1.171KiB to 1.066KiB (~91% of original) in 35ms. Read Throughput = 33.169KiB/s, Write Throughput = 30.209KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 8ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,977 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:51,978 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,978 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,979 Flushing.java:153 - Writing Memtable-local_metadata_log@871798848(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:51,980 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=67371) INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,980 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,982 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:51,983 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,045 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_2e481070-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:52,045 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:52,045 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:52,046 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:52,046 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=10} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:52,048 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:52,048 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,059 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,059 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:52,059 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=10} DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:52,061 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:52,061 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:52,061 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:52,061 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=10} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:52,061 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:52,062 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:52,063 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node4_OptionalTasks:1] node4 2024-07-04 05:20:52,080 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 724B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,088 Flushing.java:153 - Writing Memtable-local@1392493528(92B serialized bytes, 2 ops, 836B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,089 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=65079) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,102 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_2e5aae10-39c5-11ef-b980-e34c7a70c3a6.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,104 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,104 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,105 Startup.java:400 - NORMAL WARN 05:20:52 Using stored Gossip Generation 1720070452 as it is greater than current system time 1720070452. See CASSANDRA-3654 if you experience problems WARN [node4_OptionalTasks:1] node4 2024-07-04 05:20:52,108 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070452 as it is greater than current system time 1720070452. See CASSANDRA-3654 if you experience problems INFO [node4_OptionalTasks:1] node4 2024-07-04 05:20:52,108 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,116 Flushing.java:153 - Writing Memtable-local@2049603585(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,117 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=65161) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,117 SnapshotManager.java:125 - Adding snapshots: . INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,117 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,124 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,125 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,126 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,127 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,129 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:52,130 FetchCMSLog.java:119 - Responding to /127.0.0.4:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=10}}) with log delta: LogState{baseState=none , entries=0: []} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,135 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,136 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901812122 bytes available, checking if we can write 1367 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,136 CompactionTask.java:167 - Compacting (2e622820-39c5-11ef-b980-e34c7a70c3a6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,141 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,145 SnapshotManager.java:125 - Adding snapshots: . WARN 05:20:52 Using stored Gossip Generation 1720070453 as it is greater than current system time 1720070452. See CASSANDRA-3654 if you experience problems WARN [node4_OptionalTasks:1] node4 2024-07-04 05:20:52,149 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070453 as it is greater than current system time 1720070452. See CASSANDRA-3654 if you experience problems INFO [node4_OptionalTasks:1] node4 2024-07-04 05:20:52,150 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,156 Flushing.java:153 - Writing Memtable-local@1668556344(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,156 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=65243) INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:52,162 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:43754)->/127.0.0.2:7012-SMALL_MESSAGES-55ac07dd messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:52,162 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:57214)->/127.0.0.4:7012-SMALL_MESSAGES-160ca179 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:52,162 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:43754)->/127.0.0.2:7012-SMALL_MESSAGES-c59e1e22 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:52,162 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:38658)->/127.0.0.3:7012-SMALL_MESSAGES-a0251402 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:52,163 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:57214)->/127.0.0.4:7012-SMALL_MESSAGES-0416567c successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:52,163 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:38658)->/127.0.0.3:7012-SMALL_MESSAGES-2397e13e successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:52,174 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:40228)->/127.0.0.1:7012-SMALL_MESSAGES-7b866d75 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:52,174 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:40230)->/127.0.0.1:7012-SMALL_MESSAGES-f9a152d0 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:52,174 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:40228)->/127.0.0.1:7012-SMALL_MESSAGES-655e3c3c successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:52,175 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:40234)->/127.0.0.1:7012-SMALL_MESSAGES-ae03c779 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:52,175 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:40234)->/127.0.0.1:7012-SMALL_MESSAGES-be9b8f00 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:52,174 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:40230)->/127.0.0.1:7012-SMALL_MESSAGES-0ad2f0f1 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,176 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:52,177 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 38, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,28), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), INTERNAL_IP=Value(127.0.0.4,6), RPC_ADDRESS=Value(127.0.0.4,32), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,33), TOKENS=Value(40,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,36), STATUS_WITH_PORT=Value(NORMAL,40,37), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:52,197 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:43756)->/127.0.0.2:7012-SMALL_MESSAGES-376af8f1 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:52,197 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:43758)->/127.0.0.2:7012-SMALL_MESSAGES-9836fef9 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:52,199 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:38682)->/127.0.0.3:7012-SMALL_MESSAGES-13d92b71 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:52,199 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:43756)->/127.0.0.2:7012-SMALL_MESSAGES-131a91ae successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:52,201 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:38668)->/127.0.0.3:7012-SMALL_MESSAGES-cee2f371 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:52,202 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:43758)->/127.0.0.2:7012-SMALL_MESSAGES-bcf88723 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:52,203 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:38682)->/127.0.0.3:7012-SMALL_MESSAGES-dac8a7d5 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:52,204 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:57216)->/127.0.0.4:7012-SMALL_MESSAGES-400ac5f8 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:52,204 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:57216)->/127.0.0.4:7012-SMALL_MESSAGES-79b96fe4 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:52,204 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:38668)->/127.0.0.3:7012-SMALL_MESSAGES-f95b202e successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:52,209 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:57218)->/127.0.0.4:7012-SMALL_MESSAGES-d79a8533 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:52,210 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:57218)->/127.0.0.4:7012-SMALL_MESSAGES-871c68c5 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,239 CompactionTask.java:258 - Compacted (2e622820-39c5-11ef-b980-e34c7a70c3a6) 10 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big,] to level=0. 1.335KiB to 1.063KiB (~79% of original) in 97ms. Read Throughput = 13.651KiB/s, Write Throughput = 10.865KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 36ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,240 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617901722624 bytes available, checking if we can write 351 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,241 CompactionTask.java:167 - Compacting (2e72f100-39c5-11ef-b980-e34c7a70c3a6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,251 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,253 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,254 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,257 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,259 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,261 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,263 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,265 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,267 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,269 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,300 CompactionTask.java:258 - Compacted (2e72f100-39c5-11ef-b980-e34c7a70c3a6) 6 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 351B to 228B (~64% of original) in 57ms. Read Throughput = 5.992KiB/s, Write Throughput = 3.892KiB/s, Row Throughput = ~2/s. 6 total partitions merged to 1. Partition merge counts were {6:1, }. Time spent writing keys = 14ms INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,301 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,302 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,302 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,303 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,305 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,307 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,309 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:52,311 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:52,325 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:52,325 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:52,325 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node1_GossipStage:1] node1 2024-07-04 05:20:52,327 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node1_GossipStage:1] node1 2024-07-04 05:20:52,332 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,333 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node1_GossipStage:1] node1 2024-07-04 05:20:52,336 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:20:52,348 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:20:52,355 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:20:52,368 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,389 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (distributed_test_keyspace) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,392 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,398 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New epoch is Epoch{epoch=11} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,399 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=11} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,400 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 924B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,404 Flushing.java:153 - Writing Memtable-local_metadata_log@451852876(275B serialized bytes, 1 ops, 924B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,404 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85193) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,419 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:52,419 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:52,419 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,430 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.132KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,434 Flushing.java:153 - Writing Memtable-column_masks@1546075296(10.483KiB serialized bytes, 253 ops, 68.132KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,439 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,484 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.452KiB), biggest 8.452KiB, smallest 8.452KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,484 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.313KiB (2%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,488 Flushing.java:153 - Writing Memtable-columns@90518083(43.473KiB serialized bytes, 253 ops, 198.313KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,498 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,515 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,515 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.364KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,519 Flushing.java:153 - Writing Memtable-dropped_columns@1520871782(135B serialized bytes, 3 ops, 1.364KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,519 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,543 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,544 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 735B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,548 Flushing.java:153 - Writing Memtable-triggers@905266340(16B serialized bytes, 2 ops, 735B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,548 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,588 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,589 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 735B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,598 Flushing.java:153 - Writing Memtable-types@1355988102(16B serialized bytes, 2 ops, 735B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,599 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,654 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,654 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 735B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,658 Flushing.java:153 - Writing Memtable-functions@2080996341(16B serialized bytes, 2 ops, 735B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,659 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,686 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,686 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 735B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,690 Flushing.java:153 - Writing Memtable-aggregates@327880843(16B serialized bytes, 2 ops, 735B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,690 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,711 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,712 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.366KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,715 Flushing.java:153 - Writing Memtable-indexes@214218298(213B serialized bytes, 3 ops, 1.366KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,716 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,759 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,760 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.705KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,766 Flushing.java:153 - Writing Memtable-tables@1236733352(28.593KiB serialized bytes, 38 ops, 90.705KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,768 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) INFO [node3_GossipStage:1] node3 2024-07-04 05:20:52,810 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,822 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.195KiB), biggest 9.195KiB, smallest 9.195KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,823 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 735B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,835 Flushing.java:153 - Writing Memtable-views@2127954360(16B serialized bytes, 2 ops, 735B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,836 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) INFO [node2_GossipStage:1] node2 2024-07-04 05:20:52,850 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,867 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,868 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.346KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,871 Flushing.java:153 - Writing Memtable-keyspaces@890395041(415B serialized bytes, 5 ops, 2.346KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:52,872 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=85390) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:52,887 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.477KiB), biggest 5.477KiB, smallest 5.477KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,887 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}}. New tail is Epoch{epoch=11} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:52,889 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,895 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,896 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.2:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:52,896 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.4:7012 INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:20:52,899 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:20:52,899 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:52,902 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:52,903 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:20:52,903 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:20:52,903 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:52,903 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:52,906 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:52,907 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:52,909 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 920B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:52,911 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 915B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:52,914 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 920B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:52,914 Flushing.java:153 - Writing Memtable-local_metadata_log@1881026462(275B serialized bytes, 1 ops, 920B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:52,914 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=68707) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:52,916 Flushing.java:153 - Writing Memtable-local_metadata_log@951984376(275B serialized bytes, 1 ops, 915B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:52,916 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=68546) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,921 Flushing.java:153 - Writing Memtable-local_metadata_log@578682768(275B serialized bytes, 1 ops, 920B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,921 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=68921) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:52,937 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:52,937 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:52,938 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:52,938 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),1013), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),187)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:52,938 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617926447309 bytes available, checking if we can write 1351 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:52,938 CompactionTask.java:167 - Compacting (2edd72a0-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:52,939 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.124KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:52,940 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:52,941 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:52,941 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:52,941 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),1012), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),187)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:52,942 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617926439526 bytes available, checking if we can write 1350 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:52,942 CompactionTask.java:167 - Compacting (2edde7d0-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:52,943 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.114KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:52,945 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,945 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:52,945 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:52,947 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.124KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:52,953 Flushing.java:153 - Writing Memtable-column_masks@656297369(10.483KiB serialized bytes, 253 ops, 68.114KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:52,953 Flushing.java:153 - Writing Memtable-column_masks@1973518733(10.483KiB serialized bytes, 253 ops, 68.124KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:52,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070443540, position=68743) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:52,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070443576, position=68904) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,963 Flushing.java:153 - Writing Memtable-column_masks@246417668(10.483KiB serialized bytes, 253 ops, 68.124KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:52,969 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:53,009 CompactionTask.java:258 - Compacted (2edde7d0-39c5-11ef-b92b-69af062a2179) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 1.318KiB to 1.209KiB (~91% of original) in 65ms. Read Throughput = 20.185KiB/s, Write Throughput = 18.510KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 24ms DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:53,009 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:53,009 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:53,009 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,010 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.452KiB), biggest 8.452KiB, smallest 8.452KiB INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:53,010 CompactionTask.java:258 - Compacted (2edd72a0-39c5-11ef-bf85-f712d21df3f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 1.319KiB to 1.210KiB (~91% of original) in 70ms. Read Throughput = 18.809KiB/s, Write Throughput = 17.249KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 18ms INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,010 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.305KiB (2%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:53,010 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:53,010 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:53,011 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,021 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.452KiB), biggest 8.452KiB, smallest 8.452KiB DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,021 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.452KiB), biggest 8.452KiB, smallest 8.452KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,022 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.305KiB (2%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,022 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.295KiB (2%) on-heap, 0B (0%) off-heap INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:53,022 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:53,023 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,025 Flushing.java:153 - Writing Memtable-columns@1227633099(43.473KiB serialized bytes, 253 ops, 198.305KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:53,025 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:53,026 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,026 Flushing.java:153 - Writing Memtable-columns@661881507(43.473KiB serialized bytes, 253 ops, 198.305KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:53,028 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:53,028 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,029 Flushing.java:153 - Writing Memtable-columns@1989525664(43.473KiB serialized bytes, 253 ops, 198.295KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,039 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070443576, position=69365) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,040 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,041 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69408) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,122 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.356KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,122 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.356KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,133 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,133 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.347KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,138 Flushing.java:153 - Writing Memtable-dropped_columns@1702114707(135B serialized bytes, 3 ops, 1.356KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,139 Flushing.java:153 - Writing Memtable-dropped_columns@1319076918(135B serialized bytes, 3 ops, 1.356KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,139 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=69937) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,139 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,140 Flushing.java:153 - Writing Memtable-dropped_columns@1334409291(135B serialized bytes, 3 ops, 1.347KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,141 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,170 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.397KiB), biggest 5.397KiB, smallest 5.397KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,170 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,172 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,172 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.397KiB), biggest 5.397KiB, smallest 5.397KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,172 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 717B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,172 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,175 Flushing.java:153 - Writing Memtable-triggers@1341927588(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,176 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=69937) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,177 Flushing.java:153 - Writing Memtable-triggers@108607650(16B serialized bytes, 2 ops, 717B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,177 Flushing.java:153 - Writing Memtable-triggers@683202514(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,177 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,177 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,230 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,231 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,231 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 717B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,231 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,231 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,231 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,238 Flushing.java:153 - Writing Memtable-types@642651112(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,238 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,239 Flushing.java:153 - Writing Memtable-types@1407115121(16B serialized bytes, 2 ops, 717B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,239 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,249 Flushing.java:153 - Writing Memtable-types@917011775(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,249 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=69937) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,311 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,311 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,311 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 717B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,312 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,315 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,315 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,316 Flushing.java:153 - Writing Memtable-functions@186025322(16B serialized bytes, 2 ops, 717B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,316 Flushing.java:153 - Writing Memtable-functions@487848728(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,316 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,316 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,320 Flushing.java:153 - Writing Memtable-functions@513974344(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,321 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=69937) DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:53,326 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:53,326 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:20:53,326 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node2_GossipStage:1] node2 2024-07-04 05:20:53,326 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:53,328 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=10}} from /127.0.0.2:7012: start = Epoch{epoch=10}, current = Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:53,331 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:20:53,332 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,348 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,349 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 717B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,350 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,351 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,353 Flushing.java:153 - Writing Memtable-aggregates@265940835(16B serialized bytes, 2 ops, 717B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,354 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,355 Flushing.java:153 - Writing Memtable-aggregates@1502584196(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,355 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,357 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,357 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,364 Flushing.java:153 - Writing Memtable-aggregates@749611422(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,365 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=70122) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,424 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,430 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.349KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,434 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,434 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.358KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,445 Flushing.java:153 - Writing Memtable-indexes@1076521490(213B serialized bytes, 3 ops, 1.349KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,445 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,449 Flushing.java:153 - Writing Memtable-indexes@937936672(213B serialized bytes, 3 ops, 1.358KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,449 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,457 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,457 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.358KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,463 Flushing.java:153 - Writing Memtable-indexes@41506239(213B serialized bytes, 3 ops, 1.358KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,463 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=70122) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,488 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,488 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.688KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,489 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,489 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.697KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,493 Flushing.java:153 - Writing Memtable-tables@1705639985(28.593KiB serialized bytes, 38 ops, 90.688KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,494 Flushing.java:153 - Writing Memtable-tables@1642091367(28.593KiB serialized bytes, 38 ops, 90.697KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,495 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,496 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,498 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,498 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.697KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,506 Flushing.java:153 - Writing Memtable-tables@2009960778(28.593KiB serialized bytes, 38 ops, 90.697KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,508 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070443576, position=70122) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,554 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,554 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,571 Flushing.java:153 - Writing Memtable-views@1663676280(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,572 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,572 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,572 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 717B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,576 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,576 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,581 Flushing.java:153 - Writing Memtable-views@1512629307(16B serialized bytes, 2 ops, 717B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,581 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,591 Flushing.java:153 - Writing Memtable-views@2087112475(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,592 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=70122) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,645 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,645 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.334KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,648 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,648 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.319KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,650 Flushing.java:153 - Writing Memtable-keyspaces@1190100260(415B serialized bytes, 5 ops, 2.334KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,650 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69118) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,651 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,651 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.334KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,659 Flushing.java:153 - Writing Memtable-keyspaces@559541200(415B serialized bytes, 5 ops, 2.334KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,659 Flushing.java:153 - Writing Memtable-keyspaces@449489642(415B serialized bytes, 5 ops, 2.319KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,660 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=69784) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,660 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=70122) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,694 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,694 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=11} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,703 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,703 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,703 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=11} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,710 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,710 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=11} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,710 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,711 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,723 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,723 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,723 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (tr) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,724 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,724 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,725 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,735 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New epoch is Epoch{epoch=12} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,735 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=12} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:53,736 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 874B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:53,741 Flushing.java:153 - Writing Memtable-local_metadata_log@474893407(225B serialized bytes, 1 ops, 874B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:53,741 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=86889) DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:53,780 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:53,780 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.219KiB), biggest 5.219KiB, smallest 5.219KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:53,780 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:53,783 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:53,796 Flushing.java:153 - Writing Memtable-keyspaces@1835391027(153B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:53,796 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=87059) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:53,847 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:53,848 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}}. New tail is Epoch{epoch=12} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:53,848 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617925361664 bytes available, checking if we can write 615 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:53,849 CompactionTask.java:167 - Compacting (2f684d80-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:53,849 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GossipStage:1] node2 2024-07-04 05:20:53,850 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:53,851 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=11}} from /127.0.0.2:7012: start = Epoch{epoch=11}, current = Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:53,854 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,855 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,855 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.2:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:53,855 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.4:7012 DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:20:53,856 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:20:53,856 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:20:53,857 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:20:53,857 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:20:53,857 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:20:53,857 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:20:53,858 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,860 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,860 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,860 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,860 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,862 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,862 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] INFO [node4_GossipStage:1] node4 2024-07-04 05:20:53,868 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:53,869 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=11}} from /127.0.0.4:7012: start = Epoch{epoch=11}, current = Epoch{epoch=12} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,869 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,870 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:20:53,879 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,881 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:20:53,881 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,881 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 870B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,884 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 865B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,889 Flushing.java:153 - Writing Memtable-local_metadata_log@1766168297(225B serialized bytes, 1 ops, 870B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,889 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=70814) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,890 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 870B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,892 Flushing.java:153 - Writing Memtable-local_metadata_log@153303387(225B serialized bytes, 1 ops, 865B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,893 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=70476) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,902 Flushing.java:153 - Writing Memtable-local_metadata_log@1337490462(225B serialized bytes, 1 ops, 870B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,902 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=69995) INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:53,923 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:53,924 CompactionTask.java:258 - Compacted (2f684d80-39c5-11ef-9462-3bb8c7522e1d) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 364B (~59% of original) in 72ms. Read Throughput = 8.247KiB/s, Write Throughput = 4.881KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 35ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:53,926 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:53,928 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:53,930 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:53,940 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.219KiB), biggest 5.219KiB, smallest 5.219KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:53,940 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:53,940 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:53,943 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 756B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:53,943 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.219KiB), biggest 5.219KiB, smallest 5.219KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:53,943 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:53,944 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:53,945 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db')] (1 sstables, 5.219KiB), biggest 5.219KiB, smallest 5.219KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:53,945 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:53,945 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,947 Flushing.java:153 - Writing Memtable-keyspaces@1922633034(153B serialized bytes, 1 ops, 756B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:53,947 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=70984) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:53,948 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 756B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:53,949 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 751B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,954 Flushing.java:153 - Writing Memtable-keyspaces@1019026374(153B serialized bytes, 1 ops, 751B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:53,954 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=70646) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,954 Flushing.java:153 - Writing Memtable-keyspaces@748709349(153B serialized bytes, 1 ops, 756B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:53,955 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=70165) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:54,024 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,025 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=12} DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,025 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922556109 bytes available, checking if we can write 615 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,025 CompactionTask.java:167 - Compacting (2f832880-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,032 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:54,049 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,049 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=12} DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,049 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922544435 bytes available, checking if we can write 615 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,050 CompactionTask.java:167 - Compacting (2f86f910-39c5-11ef-b980-e34c7a70c3a6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:54,054 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,055 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=12} DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,056 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922536653 bytes available, checking if we can write 615 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,056 CompactionTask.java:167 - Compacting (2f87e370-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,056 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,056 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:54,064 Schema.java:287 - Submitting schema transformation CreateTableStatement (tr, x) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:54,083 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New epoch is Epoch{epoch=13} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:20:54,083 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=13} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,084 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.590KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,086 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,090 CompactionTask.java:258 - Compacted (2f832880-39c5-11ef-bf85-f712d21df3f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 364B (~59% of original) in 62ms. Read Throughput = 9.547KiB/s, Write Throughput = 5.651KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 14ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,090 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,091 Flushing.java:153 - Writing Memtable-local_metadata_log@602988518(979B serialized bytes, 1 ops, 1.590KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,092 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=93153) INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,092 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,094 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,100 CompactionTask.java:258 - Compacted (2f87e370-39c5-11ef-b92b-69af062a2179) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 364B (~59% of original) in 42ms. Read Throughput = 14.011KiB/s, Write Throughput = 8.293KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 16ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,102 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,106 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,106 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,109 CompactionTask.java:258 - Compacted (2f86f910-39c5-11ef-b980-e34c7a70c3a6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 364B (~59% of original) in 53ms. Read Throughput = 11.257KiB/s, Write Throughput = 6.662KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 17ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,109 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,111 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,112 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,114 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,116 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:54,150 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,150 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,150 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,151 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1092)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,152 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922828493 bytes available, checking if we can write 2126 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,152 CompactionTask.java:167 - Compacting (2f968970-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,153 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,169 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 583B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,174 Flushing.java:153 - Writing Memtable-column_masks@76039528(32B serialized bytes, 1 ops, 583B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,174 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=94237) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,192 CompactionTask.java:258 - Compacted (2f968970-39c5-11ef-9462-3bb8c7522e1d) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.076KiB to 1.794KiB (~86% of original) in 38ms. Read Throughput = 53.778KiB/s, Write Throughput = 46.467KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,192 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,192 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,193 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,194 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,196 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,198 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:54,203 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,203 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.143KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,208 Flushing.java:153 - Writing Memtable-columns@1791679762(159B serialized bytes, 1 ops, 1.143KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,208 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=95271) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:54,232 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,233 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922828493 bytes available, checking if we can write 8318 bytes INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,233 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.898KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,233 CompactionTask.java:167 - Compacting (2fa2e580-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,237 Flushing.java:153 - Writing Memtable-tables@699216952(773B serialized bytes, 1 ops, 2.898KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,237 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=95271) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:54,304 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,305 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,313 Flushing.java:153 - Writing Memtable-keyspaces@210223364(153B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:54,314 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=95271) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,347 CompactionTask.java:258 - Compacted (2fa2e580-39c5-11ef-9462-3bb8c7522e1d) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.938KiB (~97% of original) in 112ms. Read Throughput = 72.046KiB/s, Write Throughput = 70.400KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 46ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,347 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,348 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922758451 bytes available, checking if we can write 4687 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,348 CompactionTask.java:167 - Compacting (2fb471b0-39c5-11ef-9462-3bb8c7522e1d) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,350 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,352 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,354 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:54,373 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,373 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}}. New tail is Epoch{epoch=13} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:20:54,373 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:54,377 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:54,378 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.2:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:20:54,378 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.4:7012 INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:54,381 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:20:54,381 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:20:54,381 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:20:54,381 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:20:54,383 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:20:54,384 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:54,384 CompactionTask.java:258 - Compacted (2fb471b0-39c5-11ef-9462-3bb8c7522e1d) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.005KiB (~87% of original) in 34ms. Read Throughput = 133.237KiB/s, Write Throughput = 116.579KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 16ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,387 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,388 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.586KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,389 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.586KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,392 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,393 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.581KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:54,394 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,395 Flushing.java:153 - Writing Memtable-local_metadata_log@944572949(979B serialized bytes, 1 ops, 1.586KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,395 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=73081) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,396 Flushing.java:153 - Writing Memtable-local_metadata_log@47996262(979B serialized bytes, 1 ops, 1.586KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,396 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=72254) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,398 Flushing.java:153 - Writing Memtable-local_metadata_log@556345686(979B serialized bytes, 1 ops, 1.581KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,398 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=72743) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:54,480 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,480 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,480 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,480 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),1088), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),187)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,481 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922703974 bytes available, checking if we can write 2122 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,481 CompactionTask.java:167 - Compacting (2fc8bd00-39c5-11ef-b980-e34c7a70c3a6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, ] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,483 ColumnFamilyStore.java:508 - Initializing tr.x DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:54,484 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,484 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,484 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,487 ColumnFamilyStore.java:508 - Initializing tr.x DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:54,489 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,489 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,489 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,492 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,502 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 579B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,505 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 579B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,508 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 574B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,510 Flushing.java:153 - Writing Memtable-column_masks@1063716420(32B serialized bytes, 1 ops, 579B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,510 Flushing.java:153 - Writing Memtable-column_masks@1453617575(32B serialized bytes, 1 ops, 579B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=73338) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=74165) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,512 Flushing.java:153 - Writing Memtable-column_masks@1853577827(32B serialized bytes, 1 ops, 574B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,512 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=73827) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,528 CompactionTask.java:258 - Compacted (2fc8bd00-39c5-11ef-b980-e34c7a70c3a6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big,] to level=0. 2.072KiB to 1.788KiB (~86% of original) in 45ms. Read Throughput = 45.436KiB/s, Write Throughput = 39.205KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 14ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,528 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,529 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,529 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,530 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,532 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,533 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:54,549 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,550 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.139KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:54,551 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:54,551 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,551 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.134KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,551 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.139KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,558 Flushing.java:153 - Writing Memtable-columns@328423236(159B serialized bytes, 1 ops, 1.139KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,558 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=74165) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,565 Flushing.java:153 - Writing Memtable-columns@867419450(159B serialized bytes, 1 ops, 1.139KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,566 Flushing.java:153 - Writing Memtable-columns@2122473238(159B serialized bytes, 1 ops, 1.134KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,566 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=73827) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,566 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=74380) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:54,645 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,645 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.890KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,645 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922501632 bytes available, checking if we can write 8318 bytes DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,645 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922501632 bytes available, checking if we can write 8318 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,646 CompactionTask.java:167 - Compacting (2fe1ea50-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,646 CompactionTask.java:167 - Compacting (2fe1ea50-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:54,646 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,647 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.895KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:54,649 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,649 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922493850 bytes available, checking if we can write 8318 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,649 CompactionTask.java:167 - Compacting (2fe28690-39c5-11ef-b980-e34c7a70c3a6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,649 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.895KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,650 Flushing.java:153 - Writing Memtable-tables@708122667(773B serialized bytes, 1 ops, 2.890KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,650 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=73827) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,651 Flushing.java:153 - Writing Memtable-tables@471007716(773B serialized bytes, 1 ops, 2.895KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,652 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=74380) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,655 Flushing.java:153 - Writing Memtable-tables@702212897(773B serialized bytes, 1 ops, 2.895KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,655 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=74165) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:54,678 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,678 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 751B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:54,681 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,682 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 756B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:54,683 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,683 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 756B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,686 Flushing.java:153 - Writing Memtable-keyspaces@2093242477(153B serialized bytes, 1 ops, 756B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:54,687 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=74380) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,687 Flushing.java:153 - Writing Memtable-keyspaces@1119811490(153B serialized bytes, 1 ops, 751B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:54,687 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=73827) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,688 Flushing.java:153 - Writing Memtable-keyspaces@2031571373(153B serialized bytes, 1 ops, 756B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:54,689 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=74165) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:54,760 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,760 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,760 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big INFO [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,760 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=13} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,762 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,762 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,765 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,765 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:20:54,765 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:54,766 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,767 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=13} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:20:54,767 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,772 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,773 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:54,773 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,773 CompactionTask.java:258 - Compacted (2fe1ea50-39c5-11ef-bf85-f712d21df3f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.938KiB (~97% of original) in 113ms. Read Throughput = 71.455KiB/s, Write Throughput = 69.831KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 50ms INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,773 CompactionTask.java:258 - Compacted (2fe1ea50-39c5-11ef-b92b-69af062a2179) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.950KiB (~97% of original) in 113ms. Read Throughput = 71.510KiB/s, Write Throughput = 69.988KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 51ms INFO [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,773 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=13} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,775 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,775 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,775 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922474394 bytes available, checking if we can write 4687 bytes DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,775 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922474394 bytes available, checking if we can write 4687 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,775 CompactionTask.java:167 - Compacting (2ff57250-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,775 CompactionTask.java:167 - Compacting (2ff59960-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,777 CompactionTask.java:258 - Compacted (2fe28690-39c5-11ef-b980-e34c7a70c3a6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.936KiB (~97% of original) in 124ms. Read Throughput = 65.196KiB/s, Write Throughput = 63.691KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 60ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,778 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617922513306 bytes available, checking if we can write 4687 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,782 CompactionTask.java:167 - Compacting (2ff60e90-39c5-11ef-b980-e34c7a70c3a6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,782 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:20:54,783 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,785 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:54,869 CompactionTask.java:258 - Compacted (2ff57250-39c5-11ef-bf85-f712d21df3f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.003KiB (~87% of original) in 90ms. Read Throughput = 50.569KiB/s, Write Throughput = 44.225KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 34ms INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:54,870 CompactionTask.java:258 - Compacted (2ff60e90-39c5-11ef-b980-e34c7a70c3a6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.002KiB (~87% of original) in 83ms. Read Throughput = 54.614KiB/s, Write Throughput = 47.751KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 26ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,874 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,875 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,876 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,878 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,879 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,880 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:54,882 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,884 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:54,884 CompactionTask.java:258 - Compacted (2ff59960-39c5-11ef-b92b-69af062a2179) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.003KiB (~87% of original) in 95ms. Read Throughput = 48.038KiB/s, Write Throughput = 42.011KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 32ms INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,884 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:54,887 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,889 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:54,894 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node1_Repair-Task:1] node1 2024-07-04 05:20:55,173 RepairCoordinator.java:366 - Starting repair command #1 (3030f4b0-39c5-11ef-9462-3bb8c7522e1d), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,195 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(40,10]], parentRepairSession=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, isIncremental=true, timestamp=1720070455184, isGlobal=true} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,195 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(40,10]], parentRepairSession=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, isIncremental=true, timestamp=1720070455184, isGlobal=true} INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:20:55,208 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:20:55,209 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:55,212 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:40244)->/127.0.0.1:7012-SMALL_MESSAGES-e45494bc successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:55,212 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:40244)->/127.0.0.1:7012-SMALL_MESSAGES-664c6ff3 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,217 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455184, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,216 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455184, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,218 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455184, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,224 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 11.602KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,224 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 12.188KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,224 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 8.027KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:55,230 Flushing.java:153 - Writing Memtable-x@1990333908(580B serialized bytes, 20 ops, 8.027KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:55,230 Flushing.java:153 - Writing Memtable-x@1247966969(870B serialized bytes, 30 ops, 11.602KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:55,232 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (235B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=77718) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:55,232 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (355B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=100536) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:55,233 Flushing.java:153 - Writing Memtable-x@206253665(870B serialized bytes, 30 ops, 12.188KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:55,235 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (355B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=79237) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:55,264 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.470KiB), biggest 5.470KiB, smallest 5.470KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:55,264 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.271KiB), biggest 5.271KiB, smallest 5.271KiB DEBUG [node3_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node3 2024-07-04 05:20:55,266 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node1_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node1 2024-07-04 05:20:55,266 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node3_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node3 2024-07-04 05:20:55,267 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node1 2024-07-04 05:20:55,267 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node3 2024-07-04 05:20:55,268 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node1 2024-07-04 05:20:55,268 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node3_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node3 2024-07-04 05:20:55,269 LocalSessions.java:863 - Prepare phase for incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d completed INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,270 CompactionManager.java:928 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] Starting anticompaction for tr.x on 1/1 sstables INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,271 CompactionManager.java:994 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (,10] INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,271 CompactionManager.java:994 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (40,] INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,271 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,271 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:55,297 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.467KiB), biggest 5.467KiB, smallest 5.467KiB DEBUG [node2_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node2 2024-07-04 05:20:55,299 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node2_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node2 2024-07-04 05:20:55,299 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_Repair-3030f4b0-39c5-11ef-9462-3bb8c7522e1d:1] node2 2024-07-04 05:20:55,300 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,302 CompactionManager.java:928 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] Starting anticompaction for tr.x on 1/1 sstables INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,302 CompactionManager.java:994 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (,10] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,303 CompactionManager.java:994 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (40,] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,303 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,304 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,395 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,395 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,396 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d. INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,396 CompactionManager.java:948 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] Completed anticompaction successfully DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,396 LocalSessions.java:863 - Prepare phase for incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:55,397 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,405 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,405 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,405 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,405 CompactionManager.java:948 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d] Completed anticompaction successfully DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,406 LocalSessions.java:863 - Prepare phase for incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d completed INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,407 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,410 CoordinatorSession.java:225 - Incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d successfully prepared. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,411 CoordinatorSession.java:353 - Incremental repair 3030f4b0-39c5-11ef-9462-3bb8c7522e1d prepare phase completed in 0 seconds INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,412 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.2:7012, /127.0.0.3:7012], transEndpoints=[/127.0.0.3:7012], ranges=[(40,10]], hasSkippedReplicas=false} INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,416 RepairSession.java:297 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] parentSessionId = 3030f4b0-39c5-11ef-9462-3bb8c7522e1d: new session: will sync /127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012 on range CommonRange{endpoints=[/127.0.0.2:7012, /127.0.0.3:7012], transEndpoints=[/127.0.0.3:7012], ranges=[(40,10]], hasSkippedReplicas=false} for tr.[x] INFO [node1_Repair#1:1] node1 2024-07-04 05:20:55,424 RepairJob.java:137 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] tr.x not running paxos repair INFO [node1_RepairJobTask:1] node1 2024-07-04 05:20:55,426 RepairJob.java:504 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Requesting merkle trees for x (to [/127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.1:7012]) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,429 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070455} org.apache.cassandra.repair.messages.ValidationRequest@66863137 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,430 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070455} org.apache.cassandra.repair.messages.ValidationRequest@66863137 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,430 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070455} org.apache.cassandra.repair.messages.ValidationRequest@66863137 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,433 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455184, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,433 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455184, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} to REPAIRING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,433 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=3030f4b0-39c5-11ef-9462-3bb8c7522e1d, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455184, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} to REPAIRING INFO [node1_RequestResponseStage-2] node1 2024-07-04 05:20:55,437 RepairMessage.java:259 - [#3030f4b0-39c5-11ef-9462-3bb8c7522e1d] VALIDATION_REQ received by /127.0.0.2:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:20:55,437 RepairMessage.java:259 - [#3030f4b0-39c5-11ef-9462-3bb8c7522e1d] VALIDATION_REQ received by /127.0.0.1:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:20:55,437 RepairMessage.java:259 - [#3030f4b0-39c5-11ef-9462-3bb8c7522e1d] VALIDATION_REQ received by /127.0.0.3:7012 INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,440 CassandraValidationIterator.java:215 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d], parentSessionId=3030f4b0-39c5-11ef-9462-3bb8c7522e1d: Performing validation compaction on 1 sstables in tr.x INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,440 CassandraValidationIterator.java:215 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d], parentSessionId=3030f4b0-39c5-11ef-9462-3bb8c7522e1d: Performing validation compaction on 1 sstables in tr.x INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,441 CassandraValidationIterator.java:215 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d], parentSessionId=3030f4b0-39c5-11ef-9462-3bb8c7522e1d: Performing validation compaction on 0 sstables in tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,454 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,454 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,454 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,454 Validator.java:158 - Prepared AEService trees of size 1 for [repair #30576870-39c5-11ef-9462-3bb8c7522e1d on tr/x, [(40,10]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,457 Validator.java:229 - Validated 0 partitions for 30576870-39c5-11ef-9462-3bb8c7522e1d. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,458 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,458 Validator.java:231 - Validated 0 partitions for 30576870-39c5-11ef-9462-3bb8c7522e1d. Partition sizes are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,458 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,458 Validator.java:257 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Sending completed merkle tree to /127.0.0.1:7012 for tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,458 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 19 msec, for [repair #30576870-39c5-11ef-9462-3bb8c7522e1d on tr/x, [(40,10]]] WARN 05:20:55 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:55,461 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,461 RepairSession.java:242 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,470 Validator.java:158 - Prepared AEService trees of size 127 for [repair #30576870-39c5-11ef-9462-3bb8c7522e1d on tr/x, [(40,10]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,471 Validator.java:158 - Prepared AEService trees of size 127 for [repair #30576870-39c5-11ef-9462-3bb8c7522e1d on tr/x, [(40,10]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,477 Validator.java:229 - Validated 20 partitions for 30576870-39c5-11ef-9462-3bb8c7522e1d. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [0..0]: 123 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [1..1]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [2..2]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [3..3]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [4..9]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 Validator.java:231 - Validated 20 partitions for 30576870-39c5-11ef-9462-3bb8c7522e1d. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [0..8]: 123 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [9..57]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,478 EstimatedHistogram.java:337 - [58..106]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,479 EstimatedHistogram.java:337 - [107..155]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,479 EstimatedHistogram.java:337 - [156..441]: 2 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,479 Validator.java:257 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Sending completed merkle tree to /127.0.0.1:7012 for tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,479 ValidationManager.java:152 - Validation of 20 partitions (~235B) finished in 40 msec, for [repair #30576870-39c5-11ef-9462-3bb8c7522e1d on tr/x, [(40,10]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,479 Validator.java:229 - Validated 20 partitions for 30576870-39c5-11ef-9462-3bb8c7522e1d. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,480 EstimatedHistogram.java:337 - [0..0]: 123 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,480 EstimatedHistogram.java:337 - [1..1]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,480 EstimatedHistogram.java:337 - [2..2]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,480 EstimatedHistogram.java:337 - [3..3]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,480 EstimatedHistogram.java:337 - [4..9]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,480 Validator.java:231 - Validated 20 partitions for 30576870-39c5-11ef-9462-3bb8c7522e1d. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,481 EstimatedHistogram.java:337 - [0..8]: 123 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,481 EstimatedHistogram.java:337 - [9..57]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,481 EstimatedHistogram.java:337 - [58..106]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,481 EstimatedHistogram.java:337 - [107..155]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,481 EstimatedHistogram.java:337 - [156..441]: 2 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,481 Validator.java:262 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Local completed merkle tree for /127.0.0.1:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:55,481 ValidationManager.java:152 - Validation of 20 partitions (~235B) finished in 42 msec, for [repair #30576870-39c5-11ef-9462-3bb8c7522e1d on tr/x, [(40,10]]] INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,482 RepairSession.java:242 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Received merkle tree for x from /127.0.0.1:7012 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,484 RepairSession.java:242 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Received merkle tree for x from /127.0.0.2:7012 INFO [node1_RepairJobTask:3] node1 2024-07-04 05:20:55,487 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 3030f4b0-39c5-11ef-9462-3bb8c7522e1d (took: 3ms) INFO [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,488 SyncTask.java:93 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Endpoints /127.0.0.1:7012 and /127.0.0.3:7012 have 1 range(s) out of sync for x INFO [node1_RepairJobTask:3] node1 2024-07-04 05:20:55,488 SyncTask.java:93 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Endpoints /127.0.0.2:7012 and /127.0.0.3:7012 have 1 range(s) out of sync for x INFO [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,488 LocalSyncTask.java:118 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Performing streaming repair of 1 ranges with /127.0.0.3:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,490 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.1:7012, src=/127.0.0.2:7012, dst=/127.0.0.3:7012, ranges=[(40,10]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@2127ea5a INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,498 StreamingRepairTask.java:84 - [streaming task #30576870-39c5-11ef-9462-3bb8c7522e1d] Performing asymmetric streaming repair of 1 ranges with /127.0.0.3:7012 INFO [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,509 StreamResultFuture.java:98 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Executing streaming plan for Repair INFO [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,510 StreamSession.java:396 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Starting streaming to 127.0.0.3:7012 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,513 StreamingRepairTask.java:87 - [streaming task #30576870-39c5-11ef-9462-3bb8c7522e1d] Stream plan created in 17ms DEBUG [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,515 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,518 StreamResultFuture.java:98 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Executing streaming plan for Repair INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,518 StreamSession.java:396 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Starting streaming to 127.0.0.3:7012 INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:55,521 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:38690)->/127.0.0.3:7012-STREAMING-51216ed9 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,523 StreamingMultiplexedChannel.java:473 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d channel: b0bf3836] Scheduling keep-alive task with 300s period. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,523 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator DEBUG [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,525 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:38690 channel.id b0bf3836 INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:55,527 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:38700)->/127.0.0.3:7012-STREAMING-d51a0fa9 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,530 StreamSession.java:596 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Changing session state from INITIALIZED to PREPARING INFO [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,531 StreamCoordinator.java:268 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d, ID#0] Beginning stream session with /127.0.0.3:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,532 StreamingMultiplexedChannel.java:473 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 channel: cc0e0b2d] Scheduling keep-alive task with 300s period. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,532 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:38700 channel.id cc0e0b2d DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,534 StreamSession.java:596 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Changing session state from INITIALIZED to PREPARING INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,535 StreamCoordinator.java:268 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6, ID#0] Beginning stream session with /127.0.0.3:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:20:55,536 RepairMessage.java:259 - [#3030f4b0-39c5-11ef-9462-3bb8c7522e1d] SYNC_REQ received by /127.0.0.2:7012 INFO [node3_Stream-Deserializer-/127.0.0.1:7012-51216ed9] node3 2024-07-04 05:20:55,539 StreamResultFuture.java:123 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d ID#0] Creating new streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:38690 channel.local /127.0.0.3:7012 channel.id 51216ed9 INFO [node3_Stream-Deserializer-/127.0.0.1:7012-51216ed9] node3 2024-07-04 05:20:55,549 StreamResultFuture.java:131 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d, ID#0] Received streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:38690 channel.local /127.0.0.3:7012 channel.id 51216ed9 INFO [node3_Stream-Deserializer-/127.0.0.2:7012-d51a0fa9] node3 2024-07-04 05:20:55,549 StreamResultFuture.java:123 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 ID#0] Creating new streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:38700 channel.local /127.0.0.3:7012 channel.id d51a0fa9 INFO [node3_Stream-Deserializer-/127.0.0.2:7012-d51a0fa9] node3 2024-07-04 05:20:55,549 StreamResultFuture.java:131 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6, ID#0] Received streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:38700 channel.local /127.0.0.3:7012 channel.id d51a0fa9 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-51216ed9] node3 2024-07-04 05:20:55,549 StreamDeserializingTask.java:132 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d channel: 51216ed9] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 3062b310-39c5-11ef-9462-3bb8c7522e1d, session index = 0 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-d51a0fa9] node3 2024-07-04 05:20:55,549 StreamDeserializingTask.java:132 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 channel: d51a0fa9] Received StreamInitMessage: from = /127.0.0.2:7012, planId = 306439b0-39c5-11ef-bf85-f712d21df3f6, session index = 0 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-51216ed9] node3 2024-07-04 05:20:55,551 StreamDeserializingTask.java:132 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d channel: 51216ed9] Received Prepare SYN (1 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-d51a0fa9] node3 2024-07-04 05:20:55,551 StreamDeserializingTask.java:132 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 channel: d51a0fa9] Received Prepare SYN (1 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-d51a0fa9] node3 2024-07-04 05:20:55,551 StreamSession.java:596 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Changing session state from INITIALIZED to PREPARING DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-51216ed9] node3 2024-07-04 05:20:55,551 StreamSession.java:596 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Changing session state from INITIALIZED to PREPARING DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,555 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,556 StreamResultFuture.java:187 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,560 StreamSession.java:596 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Changing session state from PREPARING to COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,560 StreamDeserializingTask.java:132 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 channel: cc0e0b2d] Received Prepare SYNACK ( 0 files} INFO [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,561 StreamResultFuture.java:187 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,562 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,562 StreamResultFuture.java:187 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,563 StreamSession.java:596 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Changing session state from PREPARING to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,563 StreamDeserializingTask.java:132 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d channel: b0bf3836] Received Prepare SYNACK ( 0 files} DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,563 StreamSession.java:596 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Changing session state from COMPLETE to COMPLETE INFO [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,563 StreamResultFuture.java:187 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,563 StreamResultFuture.java:201 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Session with /127.0.0.2:7012 is complete DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,564 StreamSession.java:596 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Changing session state from PREPARING to STREAMING DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,564 StreamSession.java:596 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,564 StreamDeserializingTask.java:132 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6 channel: cc0e0b2d] Received Complete DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,564 StreamSession.java:1128 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] handling Complete message, state = WAIT_COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,565 StreamSession.java:596 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,565 StreamResultFuture.java:201 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Session with /127.0.0.3:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,565 StreamResultFuture.java:260 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] All sessions completed INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,566 StreamResultFuture.java:260 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] All sessions completed DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,566 StreamSession.java:596 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Changing session state from COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,566 StreamResultFuture.java:201 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Session with /127.0.0.1:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,566 StreamResultFuture.java:260 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] All sessions completed DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,567 StreamSession.java:596 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Changing session state from PREPARING to STREAMING DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,567 StreamSession.java:596 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,567 StreamDeserializingTask.java:132 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d channel: b0bf3836] Received Complete DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,567 StreamSession.java:1128 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] handling Complete message, state = WAIT_COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,567 StreamingRepairTask.java:121 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] streaming task succeed, returning response to /127.0.0.1:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:55,567 StreamSession.java:596 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:55,568 StreamResultFuture.java:201 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Session with /127.0.0.3:7012 is complete INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:55,569 StreamResultFuture.java:260 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] All sessions completed DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,569 StreamSession.java:564 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Will close attached inbound {cc0e0b2d=org.apache.cassandra.streaming.async.NettyStreamingChannel@67d575e2} and outbound {cc0e0b2d=org.apache.cassandra.streaming.async.NettyStreamingChannel@67d575e2} channels INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:55,570 LocalSyncTask.java:168 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Sync complete using session 30576870-39c5-11ef-9462-3bb8c7522e1d between /127.0.0.1:7012 and /127.0.0.3:7012 on x DEBUG [Streaming-EventLoop-4-1] node2 2024-07-04 05:20:55,570 StreamingMultiplexedChannel.java:514 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,570 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cc0e0b2d] node2 2024-07-04 05:20:55,571 StreamSession.java:712 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Socket closed after session completed with state COMPLETE DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:55,571 StreamSession.java:564 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Will close attached inbound {b0bf3836=org.apache.cassandra.streaming.async.NettyStreamingChannel@354aff18} and outbound {b0bf3836=org.apache.cassandra.streaming.async.NettyStreamingChannel@354aff18} channels DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:55,571 StreamingMultiplexedChannel.java:514 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Closing stream connection channels on /127.0.0.2:7012 DEBUG [Streaming-EventLoop-4-1] node1 2024-07-04 05:20:55,571 StreamingMultiplexedChannel.java:514 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,572 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,572 RepairSession.java:263 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Repair completed between /127.0.0.2:7012 and /127.0.0.3:7012 on x DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b0bf3836] node1 2024-07-04 05:20:55,572 StreamSession.java:712 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Socket closed after session completed with state COMPLETE DEBUG [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:55,572 StreamingMultiplexedChannel.java:514 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-d51a0fa9] node3 2024-07-04 05:20:55,573 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-d51a0fa9] node3 2024-07-04 05:20:55,573 StreamSession.java:712 - [Stream #306439b0-39c5-11ef-bf85-f712d21df3f6] Socket closed after session completed with state COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-51216ed9] node3 2024-07-04 05:20:55,573 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-51216ed9] node3 2024-07-04 05:20:55,573 StreamSession.java:712 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Socket closed after session completed with state COMPLETE INFO [node1_RepairJobTask:2] node1 2024-07-04 05:20:55,573 RepairJob.java:210 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] tr.x is fully synced INFO [node1_RepairJobTask:3] node1 2024-07-04 05:20:55,576 RepairSession.java:355 - [repair #30576870-39c5-11ef-9462-3bb8c7522e1d] Session completed successfully INFO [node1_RepairJobTask:3] node1 2024-07-04 05:20:55,576 RepairCoordinator.java:191 - Repair session 30576870-39c5-11ef-9462-3bb8c7522e1d for range [(40,10]] finished DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:20:55,576 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=30576870-39c5-11ef-9462-3bb8c7522e1d, keyspace='tr', ranges=[(40,10]], repairJobResults=[org.apache.cassandra.repair.RepairResult@1103a98d], skippedReplicas=false}] INFO [node1_RepairJobTask:3] node1 2024-07-04 05:20:55,579 CoordinatorSession.java:242 - Proposing finalization of repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:20:55,581 StreamSession.java:1379 - [Stream #3062b310-39c5-11ef-9462-3bb8c7522e1d] Stream session with peer /127.0.0.3:7012 is already in a final state on abort. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.236KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.228KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.232KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:55,593 Flushing.java:153 - Writing Memtable-repairs@1987838186(475B serialized bytes, 4 ops, 3.236KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:55,594 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=102131) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:55,595 Flushing.java:153 - Writing Memtable-repairs@448044793(475B serialized bytes, 4 ops, 3.228KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:55,595 Flushing.java:153 - Writing Memtable-repairs@90923483(475B serialized bytes, 4 ops, 3.232KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:55,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=79168) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:55,595 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=81017) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:55,650 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:55,650 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.831KiB), biggest 5.831KiB, smallest 5.831KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:55,650 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,651 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d, responded with FinalizePromise DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,651 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d, responded with FinalizePromise DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,651 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d, responded with FinalizePromise INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,652 CoordinatorSession.java:278 - Finalization proposal for repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d accepted by all participants. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,652 CoordinatorSession.java:373 - Incremental repair 3030f4b0-39c5-11ef-9462-3bb8c7522e1d finalization phase completed in 0 seconds INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,652 CoordinatorSession.java:287 - Committing finalization of repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,653 CoordinatorSessions.java:97 - Removing completed session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d with state FINALIZED INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,653 CoordinatorSession.java:294 - Incremental repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d completed DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,653 CoordinatorSession.java:376 - Incremental repair 3030f4b0-39c5-11ef-9462-3bb8c7522e1d phase completed in 0 seconds DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,658 LocalSessions.java:1010 - Finalized local repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,658 RepairCoordinator.java:250 - [repair #3030f4b0-39c5-11ef-9462-3bb8c7522e1d]Repair command #1 finished in 0 seconds DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,661 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,661 LocalSessions.java:1010 - Finalized local repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,662 RepairMessageVerbHandler.java:290 - cleaning up repair INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,662 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070455184 and session id = 3030f4b0-39c5-11ef-9462-3bb8c7522e1d INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,664 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070455184 and session id = 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:55,665 LocalSessions.java:1010 - Finalized local repair session 3030f4b0-39c5-11ef-9462-3bb8c7522e1d DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,667 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 3030f4b0-39c5-11ef-9462-3bb8c7522e1d on tr.x DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:55,667 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 3030f4b0-39c5-11ef-9462-3bb8c7522e1d on tr.x INFO [node2_Repair-Task:1] node2 2024-07-04 05:20:55,772 RepairCoordinator.java:366 - Starting repair command #1 (308d6c90-39c5-11ef-bf85-f712d21df3f6), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,789 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(10,20]], parentRepairSession=308d6c90-39c5-11ef-bf85-f712d21df3f6, isIncremental=true, timestamp=1720070455786, isGlobal=true} DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:55,795 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(10,20]], parentRepairSession=308d6c90-39c5-11ef-bf85-f712d21df3f6, isIncremental=true, timestamp=1720070455786, isGlobal=true} INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:20:55,804 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:20:55,805 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,807 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=308d6c90-39c5-11ef-bf85-f712d21df3f6, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455786, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:55,808 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:43778)->/127.0.0.2:7012-SMALL_MESSAGES-6dfec848 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node3 2024-07-04 05:20:55,809 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node3_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node3 2024-07-04 05:20:55,809 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:55,809 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:43778)->/127.0.0.2:7012-SMALL_MESSAGES-5984062d successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node3 2024-07-04 05:20:55,809 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,811 CompactionManager.java:928 - [repair #308d6c90-39c5-11ef-bf85-f712d21df3f6] Starting anticompaction for tr.x on 1/1 sstables INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,811 CompactionManager.java:994 - [repair #308d6c90-39c5-11ef-bf85-f712d21df3f6] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([11,30]) will be anticompacted on range (10,20] INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,812 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,813 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=308d6c90-39c5-11ef-bf85-f712d21df3f6, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455786, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,814 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:55,816 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=308d6c90-39c5-11ef-bf85-f712d21df3f6, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455786, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:55,819 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 8.125KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node2 2024-07-04 05:20:55,820 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node2_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node2 2024-07-04 05:20:55,820 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node2 2024-07-04 05:20:55,821 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,821 CompactionManager.java:928 - [repair #308d6c90-39c5-11ef-bf85-f712d21df3f6] Starting anticompaction for tr.x on 1/2 sstables INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,821 CompactionManager.java:987 - [repair #308d6c90-39c5-11ef-bf85-f712d21df3f6] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (10,20], mutating repairedAt instead of anticompacting DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,831 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,832 CompactionManager.java:948 - [repair #308d6c90-39c5-11ef-bf85-f712d21df3f6] Completed anticompaction successfully DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:55,832 LocalSessions.java:863 - Prepare phase for incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 completed INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:55,836 Flushing.java:153 - Writing Memtable-x@2065052823(580B serialized bytes, 20 ops, 8.125KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:55,838 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (235B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=79290) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:55,881 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.269KiB), biggest 5.269KiB, smallest 5.269KiB DEBUG [node4_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node4 2024-07-04 05:20:55,883 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node4_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node4 2024-07-04 05:20:55,883 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node4 2024-07-04 05:20:55,884 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node4_Repair-308d6c90-39c5-11ef-bf85-f712d21df3f6:1] node4 2024-07-04 05:20:55,885 LocalSessions.java:863 - Prepare phase for incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 completed DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,900 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,900 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,900 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 308d6c90-39c5-11ef-bf85-f712d21df3f6. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,900 CompactionManager.java:948 - [repair #308d6c90-39c5-11ef-bf85-f712d21df3f6] Completed anticompaction successfully DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:55,901 LocalSessions.java:863 - Prepare phase for incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,902 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,902 CoordinatorSession.java:225 - Incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 successfully prepared. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,904 CoordinatorSession.java:353 - Incremental repair 308d6c90-39c5-11ef-bf85-f712d21df3f6 prepare phase completed in 0 seconds INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,904 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.3:7012, /127.0.0.4:7012], transEndpoints=[/127.0.0.4:7012], ranges=[(10,20]], hasSkippedReplicas=false} INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,906 RepairSession.java:297 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] parentSessionId = 308d6c90-39c5-11ef-bf85-f712d21df3f6: new session: will sync /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012 on range CommonRange{endpoints=[/127.0.0.3:7012, /127.0.0.4:7012], transEndpoints=[/127.0.0.4:7012], ranges=[(10,20]], hasSkippedReplicas=false} for tr.[x] INFO [node2_Repair#1:1] node2 2024-07-04 05:20:55,912 RepairJob.java:137 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] tr.x not running paxos repair INFO [node2_RepairJobTask:1] node2 2024-07-04 05:20:55,913 RepairJob.java:504 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Requesting merkle trees for x (to [/127.0.0.3:7012, /127.0.0.4:7012, /127.0.0.2:7012]) DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,915 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070455} org.apache.cassandra.repair.messages.ValidationRequest@66863137 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,915 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070455} org.apache.cassandra.repair.messages.ValidationRequest@66863137 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,915 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=308d6c90-39c5-11ef-bf85-f712d21df3f6, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455786, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,915 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=308d6c90-39c5-11ef-bf85-f712d21df3f6, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455786, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} to REPAIRING DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:55,917 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070455} org.apache.cassandra.repair.messages.ValidationRequest@66863137 INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,918 CassandraValidationIterator.java:215 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6], parentSessionId=308d6c90-39c5-11ef-bf85-f712d21df3f6: Performing validation compaction on 1 sstables in tr.x INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,918 CassandraValidationIterator.java:215 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6], parentSessionId=308d6c90-39c5-11ef-bf85-f712d21df3f6: Performing validation compaction on 1 sstables in tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,919 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:55,920 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=308d6c90-39c5-11ef-bf85-f712d21df3f6, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070455786, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070455, lastUpdate=1720070455} to REPAIRING DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,920 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:20:55,921 RepairMessage.java:259 - [#308d6c90-39c5-11ef-bf85-f712d21df3f6] VALIDATION_REQ received by /127.0.0.3:7012 INFO [node2_RequestResponseStage-2] node2 2024-07-04 05:20:55,921 RepairMessage.java:259 - [#308d6c90-39c5-11ef-bf85-f712d21df3f6] VALIDATION_REQ received by /127.0.0.2:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,924 Validator.java:158 - Prepared AEService trees of size 127 for [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6 on tr/x, [(10,20]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,926 Validator.java:229 - Validated 10 partitions for 30a22d10-39c5-11ef-bf85-f712d21df3f6. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,927 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,927 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,927 Validator.java:231 - Validated 10 partitions for 30a22d10-39c5-11ef-bf85-f712d21df3f6. Partition sizes are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,927 Validator.java:158 - Prepared AEService trees of size 127 for [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6 on tr/x, [(10,20]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,927 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,927 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,927 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,928 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,928 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,928 Validator.java:262 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Local completed merkle tree for /127.0.0.2:7012 for tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:55,928 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 10 msec, for [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6 on tr/x, [(10,20]]] WARN 05:20:55 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,929 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:20:55,931 RepairMessage.java:259 - [#308d6c90-39c5-11ef-bf85-f712d21df3f6] VALIDATION_REQ received by /127.0.0.4:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,932 Validator.java:229 - Validated 10 partitions for 30a22d10-39c5-11ef-bf85-f712d21df3f6. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,932 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,932 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,932 Validator.java:231 - Validated 10 partitions for 30a22d10-39c5-11ef-bf85-f712d21df3f6. Partition sizes are: INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,932 RepairSession.java:242 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Received merkle tree for x from /127.0.0.2:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,933 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,933 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,933 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,933 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,933 EstimatedHistogram.java:337 - [65..196]: 2 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:55,933 ValidationManager.java:152 - Validation of 10 partitions (~115B) finished in 15 msec, for [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6 on tr/x, [(10,20]]] INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,933 Validator.java:257 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Sending completed merkle tree to /127.0.0.2:7012 for tr.x INFO [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,934 CassandraValidationIterator.java:215 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6], parentSessionId=308d6c90-39c5-11ef-bf85-f712d21df3f6: Performing validation compaction on 0 sstables in tr.x INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,936 RepairSession.java:242 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,942 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,943 Validator.java:158 - Prepared AEService trees of size 1 for [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6 on tr/x, [(10,20]]] DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,943 Validator.java:229 - Validated 0 partitions for 30a22d10-39c5-11ef-bf85-f712d21df3f6. Partitions per leaf are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,944 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,944 Validator.java:231 - Validated 0 partitions for 30a22d10-39c5-11ef-bf85-f712d21df3f6. Partition sizes are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,944 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:55,944 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 11 msec, for [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6 on tr/x, [(10,20]]] INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:55,944 Validator.java:257 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Sending completed merkle tree to /127.0.0.2:7012 for tr.x INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,946 RepairSession.java:242 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Received merkle tree for x from /127.0.0.4:7012 INFO [node2_RepairJobTask:4] node2 2024-07-04 05:20:55,948 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 308d6c90-39c5-11ef-bf85-f712d21df3f6 (took: 2ms) INFO [node2_RepairJobTask:4] node2 2024-07-04 05:20:55,948 SyncTask.java:93 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Endpoints /127.0.0.3:7012 and /127.0.0.4:7012 have 1 range(s) out of sync for x INFO [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,948 SyncTask.java:93 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Endpoints /127.0.0.2:7012 and /127.0.0.4:7012 have 1 range(s) out of sync for x INFO [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,948 LocalSyncTask.java:118 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Performing streaming repair of 1 ranges with /127.0.0.4:7012 INFO [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,949 StreamResultFuture.java:98 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Executing streaming plan for Repair INFO [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,949 StreamSession.java:396 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Starting streaming to 127.0.0.4:7012 DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,949 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.4:7012 as initiator DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,950 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.2:7012, src=/127.0.0.3:7012, dst=/127.0.0.4:7012, ranges=[(10,20]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@9285869f DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,952 StreamingMultiplexedChannel.java:473 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 channel: 5fcf6f15] Scheduling keep-alive task with 300s period. DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,952 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:57234 channel.id 5fcf6f15 DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,952 StreamSession.java:596 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Changing session state from INITIALIZED to PREPARING INFO [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,953 StreamCoordinator.java:268 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6, ID#0] Beginning stream session with /127.0.0.4:7012 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,953 StreamingRepairTask.java:84 - [streaming task #30a22d10-39c5-11ef-bf85-f712d21df3f6] Performing asymmetric streaming repair of 1 ranges with /127.0.0.4:7012 INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:55,953 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:57234)->/127.0.0.4:7012-STREAMING-69336ac1 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,956 StreamingRepairTask.java:87 - [streaming task #30a22d10-39c5-11ef-bf85-f712d21df3f6] Stream plan created in 2ms INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,957 StreamResultFuture.java:98 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Executing streaming plan for Repair INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,957 StreamSession.java:396 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Starting streaming to 127.0.0.4:7012 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,957 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.4:7012 as initiator INFO [node4_Stream-Deserializer-/127.0.0.2:7012-69336ac1] node4 2024-07-04 05:20:55,959 StreamResultFuture.java:123 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 ID#0] Creating new streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:57234 channel.local /127.0.0.4:7012 channel.id 69336ac1 INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:55,960 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:57246)->/127.0.0.4:7012-STREAMING-aba2bbdd streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,961 StreamingMultiplexedChannel.java:473 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 channel: 56a304ef] Scheduling keep-alive task with 300s period. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,961 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:57246 channel.id 56a304ef DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,961 StreamSession.java:596 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,962 StreamCoordinator.java:268 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179, ID#0] Beginning stream session with /127.0.0.4:7012 INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:20:55,963 RepairMessage.java:259 - [#308d6c90-39c5-11ef-bf85-f712d21df3f6] SYNC_REQ received by /127.0.0.3:7012 INFO [node4_Stream-Deserializer-/127.0.0.2:7012-69336ac1] node4 2024-07-04 05:20:55,967 StreamResultFuture.java:131 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6, ID#0] Received streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:57234 channel.local /127.0.0.4:7012 channel.id 69336ac1 INFO [node4_Stream-Deserializer-/127.0.0.3:7012-aba2bbdd] node4 2024-07-04 05:20:55,967 StreamResultFuture.java:123 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 ID#0] Creating new streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:57246 channel.local /127.0.0.4:7012 channel.id aba2bbdd DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-69336ac1] node4 2024-07-04 05:20:55,967 StreamDeserializingTask.java:132 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 channel: 69336ac1] Received StreamInitMessage: from = /127.0.0.2:7012, planId = 30a8bcc0-39c5-11ef-bf85-f712d21df3f6, session index = 0 INFO [node4_Stream-Deserializer-/127.0.0.3:7012-aba2bbdd] node4 2024-07-04 05:20:55,967 StreamResultFuture.java:131 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179, ID#0] Received streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:57246 channel.local /127.0.0.4:7012 channel.id aba2bbdd DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-aba2bbdd] node4 2024-07-04 05:20:55,967 StreamDeserializingTask.java:132 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 channel: aba2bbdd] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 30a98010-39c5-11ef-b92b-69af062a2179, session index = 0 DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-69336ac1] node4 2024-07-04 05:20:55,968 StreamDeserializingTask.java:132 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 channel: 69336ac1] Received Prepare SYN (1 requests, 0 files} DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-aba2bbdd] node4 2024-07-04 05:20:55,968 StreamDeserializingTask.java:132 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 channel: aba2bbdd] Received Prepare SYN (1 requests, 0 files} DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-69336ac1] node4 2024-07-04 05:20:55,968 StreamSession.java:596 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Changing session state from INITIALIZED to PREPARING DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-aba2bbdd] node4 2024-07-04 05:20:55,968 StreamSession.java:596 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,972 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,973 StreamResultFuture.java:187 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,977 StreamDeserializingTask.java:132 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 channel: 5fcf6f15] Received Prepare SYNACK ( 0 files} INFO [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,977 StreamResultFuture.java:187 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,977 StreamSession.java:596 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Changing session state from PREPARING to COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,977 StreamSession.java:596 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Changing session state from PREPARING to STREAMING DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,977 StreamSession.java:596 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,977 StreamDeserializingTask.java:132 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6 channel: 5fcf6f15] Received Complete DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,977 StreamSession.java:1128 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] handling Complete message, state = WAIT_COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,978 StreamSession.java:596 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,978 StreamResultFuture.java:201 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Session with /127.0.0.4:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,978 StreamResultFuture.java:260 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] All sessions completed INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,978 LocalSyncTask.java:168 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Sync complete using session 30a22d10-39c5-11ef-bf85-f712d21df3f6 between /127.0.0.2:7012 and /127.0.0.4:7012 on x DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:55,978 StreamSession.java:564 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Will close attached inbound {5fcf6f15=org.apache.cassandra.streaming.async.NettyStreamingChannel@c8c415f} and outbound {5fcf6f15=org.apache.cassandra.streaming.async.NettyStreamingChannel@c8c415f} channels DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,978 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-5fcf6f15] node2 2024-07-04 05:20:55,978 StreamSession.java:712 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node2 2024-07-04 05:20:55,978 StreamingMultiplexedChannel.java:514 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,979 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,979 StreamResultFuture.java:187 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,979 StreamSession.java:596 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,979 StreamDeserializingTask.java:132 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 channel: 56a304ef] Received Prepare SYNACK ( 0 files} DEBUG [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:55,979 StreamingMultiplexedChannel.java:514 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Closing stream connection channels on /127.0.0.2:7012 INFO [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,979 StreamResultFuture.java:187 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,979 StreamSession.java:596 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Changing session state from COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,980 StreamResultFuture.java:201 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Session with /127.0.0.2:7012 is complete DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,980 StreamSession.java:596 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,980 StreamSession.java:596 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,980 StreamDeserializingTask.java:132 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179 channel: 56a304ef] Received Complete DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,980 StreamSession.java:1128 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] handling Complete message, state = WAIT_COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,980 StreamSession.java:596 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,980 StreamResultFuture.java:201 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.4:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,980 StreamResultFuture.java:260 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] All sessions completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,980 StreamingRepairTask.java:121 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] streaming task succeed, returning response to /127.0.0.2:7012 DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-69336ac1] node4 2024-07-04 05:20:55,981 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-69336ac1] node4 2024-07-04 05:20:55,981 StreamSession.java:712 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Socket closed after session completed with state COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,981 StreamResultFuture.java:260 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] All sessions completed DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,982 StreamSession.java:596 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Changing session state from COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,982 StreamResultFuture.java:201 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.3:7012 is complete DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:55,982 StreamSession.java:564 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Will close attached inbound {56a304ef=org.apache.cassandra.streaming.async.NettyStreamingChannel@30479958} and outbound {56a304ef=org.apache.cassandra.streaming.async.NettyStreamingChannel@30479958} channels INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:55,982 StreamResultFuture.java:260 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] All sessions completed DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,983 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-56a304ef] node3 2024-07-04 05:20:55,983 StreamSession.java:712 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-1] node3 2024-07-04 05:20:55,983 StreamingMultiplexedChannel.java:514 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:55,983 StreamingMultiplexedChannel.java:514 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,983 RepairSession.java:263 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Repair completed between /127.0.0.3:7012 and /127.0.0.4:7012 on x DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-aba2bbdd] node4 2024-07-04 05:20:55,983 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-aba2bbdd] node4 2024-07-04 05:20:55,983 StreamSession.java:712 - [Stream #30a98010-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE INFO [node2_RepairJobTask:3] node2 2024-07-04 05:20:55,984 RepairJob.java:210 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] tr.x is fully synced INFO [node2_RepairJobTask:4] node2 2024-07-04 05:20:55,986 RepairSession.java:355 - [repair #30a22d10-39c5-11ef-bf85-f712d21df3f6] Session completed successfully INFO [node2_RepairJobTask:4] node2 2024-07-04 05:20:55,987 RepairCoordinator.java:191 - Repair session 30a22d10-39c5-11ef-bf85-f712d21df3f6 for range [(10,20]] finished DEBUG [node2_RepairJobTask:4] node2 2024-07-04 05:20:55,987 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=30a22d10-39c5-11ef-bf85-f712d21df3f6, keyspace='tr', ranges=[(10,20]], repairJobResults=[org.apache.cassandra.repair.RepairResult@1c0c49a3], skippedReplicas=false}] INFO [node2_RepairJobTask:4] node2 2024-07-04 05:20:55,987 CoordinatorSession.java:242 - Proposing finalization of repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node2_RepairJobTask:4] node2 2024-07-04 05:20:55,989 StreamSession.java:1379 - [Stream #30a8bcc0-39c5-11ef-bf85-f712d21df3f6] Stream session with peer /127.0.0.4:7012 is already in a final state on abort. INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:55,990 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.109KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:55,990 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:55,991 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.232KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:55,999 Flushing.java:153 - Writing Memtable-repairs@2065043892(950B serialized bytes, 5 ops, 6.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:56,000 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=83712) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:56,001 Flushing.java:153 - Writing Memtable-repairs@1445049562(475B serialized bytes, 4 ops, 3.232KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:56,001 Flushing.java:153 - Writing Memtable-repairs@406993348(950B serialized bytes, 5 ops, 6.109KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:56,001 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=80492) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:56,001 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=81811) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:56,075 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.934KiB), biggest 5.934KiB, smallest 5.934KiB DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,075 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6, responded with FinalizePromise DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:56,080 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.934KiB), biggest 5.934KiB, smallest 5.934KiB DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,080 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6, responded with FinalizePromise DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:56,084 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.830KiB), biggest 5.830KiB, smallest 5.830KiB DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,085 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6, responded with FinalizePromise INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,085 CoordinatorSession.java:278 - Finalization proposal for repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 accepted by all participants. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,086 CoordinatorSession.java:373 - Incremental repair 308d6c90-39c5-11ef-bf85-f712d21df3f6 finalization phase completed in 0 seconds INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,086 CoordinatorSession.java:287 - Committing finalization of repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,086 CoordinatorSessions.java:97 - Removing completed session 308d6c90-39c5-11ef-bf85-f712d21df3f6 with state FINALIZED INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,086 CoordinatorSession.java:294 - Incremental repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 completed DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,086 CoordinatorSession.java:376 - Incremental repair 308d6c90-39c5-11ef-bf85-f712d21df3f6 phase completed in 0 seconds DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,088 LocalSessions.java:1010 - Finalized local repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,094 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070455786 and session id = 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,096 RepairCoordinator.java:250 - [repair #308d6c90-39c5-11ef-bf85-f712d21df3f6]Repair command #1 finished in 0 seconds DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,097 LocalSessions.java:1010 - Finalized local repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,097 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 308d6c90-39c5-11ef-bf85-f712d21df3f6 on tr.x DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,098 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,098 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,099 LocalSessions.java:1010 - Finalized local repair session 308d6c90-39c5-11ef-bf85-f712d21df3f6 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:20:56,099 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070455786 and session id = 308d6c90-39c5-11ef-bf85-f712d21df3f6 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:20:56,101 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 308d6c90-39c5-11ef-bf85-f712d21df3f6 on tr.x INFO [node3_Repair-Task:1] node3 2024-07-04 05:20:56,202 RepairCoordinator.java:366 - Starting repair command #1 (30cf3080-39c5-11ef-b92b-69af062a2179), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,214 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(20,30]], parentRepairSession=30cf3080-39c5-11ef-b92b-69af062a2179, isIncremental=true, timestamp=1720070456212, isGlobal=true} DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,213 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(20,30]], parentRepairSession=30cf3080-39c5-11ef-b92b-69af062a2179, isIncremental=true, timestamp=1720070456212, isGlobal=true} INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:20:56,219 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:20:56,219 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,222 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=30cf3080-39c5-11ef-b92b-69af062a2179, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456212, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070456, lastUpdate=1720070456} DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,222 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=30cf3080-39c5-11ef-b92b-69af062a2179, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456212, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070456, lastUpdate=1720070456} INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:20:56,223 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:38708)->/127.0.0.3:7012-SMALL_MESSAGES-2c10d1fa successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:56,223 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:38708)->/127.0.0.3:7012-SMALL_MESSAGES-d20ce7c7 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node4 2024-07-04 05:20:56,223 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node4_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node4 2024-07-04 05:20:56,223 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node4 2024-07-04 05:20:56,223 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node1 2024-07-04 05:20:56,223 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node1_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node1 2024-07-04 05:20:56,224 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node1 2024-07-04 05:20:56,224 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node1 2024-07-04 05:20:56,224 LocalSessions.java:863 - Prepare phase for incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179 completed INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,224 CompactionManager.java:928 - [repair #30cf3080-39c5-11ef-b92b-69af062a2179] Starting anticompaction for tr.x on 1/1 sstables INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,225 CompactionManager.java:994 - [repair #30cf3080-39c5-11ef-b92b-69af062a2179] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([21,40]) will be anticompacted on range (20,30] DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,225 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=30cf3080-39c5-11ef-b92b-69af062a2179, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456212, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070456, lastUpdate=1720070456} INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,225 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,226 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node3_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node3 2024-07-04 05:20:56,226 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node3_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node3 2024-07-04 05:20:56,226 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_Repair-30cf3080-39c5-11ef-b92b-69af062a2179:1] node3 2024-07-04 05:20:56,227 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,228 CompactionManager.java:928 - [repair #30cf3080-39c5-11ef-b92b-69af062a2179] Starting anticompaction for tr.x on 1/2 sstables INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,229 CompactionManager.java:987 - [repair #30cf3080-39c5-11ef-b92b-69af062a2179] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (20,30], mutating repairedAt instead of anticompacting DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,230 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,231 CompactionManager.java:948 - [repair #30cf3080-39c5-11ef-b92b-69af062a2179] Completed anticompaction successfully DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,231 LocalSessions.java:863 - Prepare phase for incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179 completed DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,280 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,280 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,281 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 30cf3080-39c5-11ef-b92b-69af062a2179. INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,281 CompactionManager.java:948 - [repair #30cf3080-39c5-11ef-b92b-69af062a2179] Completed anticompaction successfully DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,281 LocalSessions.java:863 - Prepare phase for incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179 completed INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,282 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,283 CoordinatorSession.java:225 - Incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179 successfully prepared. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,284 CoordinatorSession.java:353 - Incremental repair 30cf3080-39c5-11ef-b92b-69af062a2179 prepare phase completed in 0 seconds INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,284 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.4:7012, /127.0.0.1:7012], transEndpoints=[/127.0.0.1:7012], ranges=[(20,30]], hasSkippedReplicas=false} INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,286 RepairSession.java:297 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] parentSessionId = 30cf3080-39c5-11ef-b92b-69af062a2179: new session: will sync /127.0.0.3:7012, /127.0.0.4:7012, /127.0.0.1:7012 on range CommonRange{endpoints=[/127.0.0.4:7012, /127.0.0.1:7012], transEndpoints=[/127.0.0.1:7012], ranges=[(20,30]], hasSkippedReplicas=false} for tr.[x] INFO [node3_Repair#1:1] node3 2024-07-04 05:20:56,294 RepairJob.java:137 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] tr.x not running paxos repair INFO [node3_RepairJobTask:1] node3 2024-07-04 05:20:56,295 RepairJob.java:504 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Requesting merkle trees for x (to [/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012]) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,297 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070456} org.apache.cassandra.repair.messages.ValidationRequest@66863138 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,297 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070456} org.apache.cassandra.repair.messages.ValidationRequest@66863138 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,297 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070456} org.apache.cassandra.repair.messages.ValidationRequest@66863138 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,297 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=30cf3080-39c5-11ef-b92b-69af062a2179, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456212, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070456, lastUpdate=1720070456} to REPAIRING DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,297 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=30cf3080-39c5-11ef-b92b-69af062a2179, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456212, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070456, lastUpdate=1720070456} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,298 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=30cf3080-39c5-11ef-b92b-69af062a2179, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456212, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070456, lastUpdate=1720070456} to REPAIRING INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,300 CassandraValidationIterator.java:215 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179], parentSessionId=30cf3080-39c5-11ef-b92b-69af062a2179: Performing validation compaction on 0 sstables in tr.x INFO [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,300 CassandraValidationIterator.java:215 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179], parentSessionId=30cf3080-39c5-11ef-b92b-69af062a2179: Performing validation compaction on 1 sstables in tr.x INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,300 CassandraValidationIterator.java:215 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179], parentSessionId=30cf3080-39c5-11ef-b92b-69af062a2179: Performing validation compaction on 1 sstables in tr.x INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:20:56,300 RepairMessage.java:259 - [#30cf3080-39c5-11ef-b92b-69af062a2179] VALIDATION_REQ received by /127.0.0.1:7012 INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:20:56,301 RepairMessage.java:259 - [#30cf3080-39c5-11ef-b92b-69af062a2179] VALIDATION_REQ received by /127.0.0.4:7012 INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:20:56,301 RepairMessage.java:259 - [#30cf3080-39c5-11ef-b92b-69af062a2179] VALIDATION_REQ received by /127.0.0.3:7012 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,301 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,301 Validator.java:158 - Prepared AEService trees of size 1 for [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179 on tr/x, [(20,30]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,301 Validator.java:229 - Validated 0 partitions for 30dc4fe0-39c5-11ef-b92b-69af062a2179. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,301 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,301 Validator.java:231 - Validated 0 partitions for 30dc4fe0-39c5-11ef-b92b-69af062a2179. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,301 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,301 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,301 Validator.java:257 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Sending completed merkle tree to /127.0.0.3:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,301 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 2 msec, for [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179 on tr/x, [(20,30]]] DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,302 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes WARN 05:20:56 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:56,303 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,303 RepairSession.java:242 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Received merkle tree for x from /127.0.0.1:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,305 Validator.java:158 - Prepared AEService trees of size 127 for [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179 on tr/x, [(20,30]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,307 Validator.java:229 - Validated 10 partitions for 30dc4fe0-39c5-11ef-b92b-69af062a2179. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,308 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,308 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,308 Validator.java:231 - Validated 10 partitions for 30dc4fe0-39c5-11ef-b92b-69af062a2179. Partition sizes are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,308 Validator.java:158 - Prepared AEService trees of size 127 for [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179 on tr/x, [(20,30]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,308 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,308 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,309 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,309 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,309 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,309 Validator.java:262 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Local completed merkle tree for /127.0.0.3:7012 for tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:20:56,309 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 8 msec, for [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179 on tr/x, [(20,30]]] INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,309 RepairSession.java:242 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,314 Validator.java:229 - Validated 10 partitions for 30dc4fe0-39c5-11ef-b92b-69af062a2179. Partitions per leaf are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,315 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,315 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,315 Validator.java:231 - Validated 10 partitions for 30dc4fe0-39c5-11ef-b92b-69af062a2179. Partition sizes are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,316 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,316 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,316 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,316 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,316 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,316 Validator.java:257 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Sending completed merkle tree to /127.0.0.3:7012 for tr.x DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,316 ValidationManager.java:152 - Validation of 10 partitions (~115B) finished in 16 msec, for [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179 on tr/x, [(20,30]]] INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,319 RepairSession.java:242 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Received merkle tree for x from /127.0.0.4:7012 INFO [node3_RepairJobTask:4] node3 2024-07-04 05:20:56,320 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 30cf3080-39c5-11ef-b92b-69af062a2179 (took: 1ms) INFO [node3_RepairJobTask:4] node3 2024-07-04 05:20:56,321 SyncTask.java:93 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Endpoints /127.0.0.4:7012 and /127.0.0.1:7012 have 1 range(s) out of sync for x INFO [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,321 SyncTask.java:93 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Endpoints /127.0.0.3:7012 and /127.0.0.1:7012 have 1 range(s) out of sync for x INFO [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,321 LocalSyncTask.java:118 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Performing streaming repair of 1 ranges with /127.0.0.1:7012 INFO [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,321 StreamResultFuture.java:98 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Executing streaming plan for Repair INFO [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,322 StreamSession.java:396 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Starting streaming to 127.0.0.1:7012 DEBUG [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,322 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,323 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.3:7012, src=/127.0.0.4:7012, dst=/127.0.0.1:7012, ranges=[(20,30]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@eab7aead INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:56,324 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:40252)->/127.0.0.1:7012-STREAMING-e94ce054 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,324 StreamingMultiplexedChannel.java:473 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 channel: 92f26beb] Scheduling keep-alive task with 300s period. DEBUG [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,324 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:40252 channel.id 92f26beb DEBUG [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,325 StreamSession.java:596 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING INFO [node1_Stream-Deserializer-/127.0.0.3:7012-e94ce054] node1 2024-07-04 05:20:56,325 StreamResultFuture.java:123 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 ID#0] Creating new streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:40252 channel.local /127.0.0.1:7012 channel.id e94ce054 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,325 StreamingRepairTask.java:84 - [streaming task #30dc4fe0-39c5-11ef-b92b-69af062a2179] Performing asymmetric streaming repair of 1 ranges with /127.0.0.1:7012 INFO [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,325 StreamCoordinator.java:268 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179, ID#0] Beginning stream session with /127.0.0.1:7012 INFO [node1_Stream-Deserializer-/127.0.0.3:7012-e94ce054] node1 2024-07-04 05:20:56,326 StreamResultFuture.java:131 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179, ID#0] Received streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:40252 channel.local /127.0.0.1:7012 channel.id e94ce054 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-e94ce054] node1 2024-07-04 05:20:56,326 StreamDeserializingTask.java:132 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 channel: e94ce054] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 30e1a710-39c5-11ef-b92b-69af062a2179, session index = 0 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-e94ce054] node1 2024-07-04 05:20:56,326 StreamDeserializingTask.java:132 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 channel: e94ce054] Received Prepare SYN (1 requests, 0 files} DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-e94ce054] node1 2024-07-04 05:20:56,326 StreamSession.java:596 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,328 StreamingRepairTask.java:87 - [streaming task #30dc4fe0-39c5-11ef-b92b-69af062a2179] Stream plan created in 2ms DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,328 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,328 StreamResultFuture.java:98 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Executing streaming plan for Repair INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,328 StreamSession.java:396 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Starting streaming to 127.0.0.1:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,328 StreamResultFuture.java:187 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,328 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,329 StreamSession.java:596 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,329 StreamDeserializingTask.java:132 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 channel: 92f26beb] Received Prepare SYNACK ( 0 files} INFO [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,329 StreamResultFuture.java:187 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,329 StreamSession.java:596 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Changing session state from COMPLETE to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,329 StreamSession.java:596 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,329 StreamSession.java:596 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Changing session state from STREAMING to WAIT_COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,329 StreamResultFuture.java:201 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.3:7012 is complete INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,330 StreamResultFuture.java:260 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] All sessions completed DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,330 StreamDeserializingTask.java:132 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179 channel: 92f26beb] Received Complete DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,330 StreamSession.java:1128 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] handling Complete message, state = WAIT_COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:56,330 StreamSession.java:596 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:56,330 StreamResultFuture.java:201 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.1:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:56,330 StreamResultFuture.java:260 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] All sessions completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:56,330 LocalSyncTask.java:168 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Sync complete using session 30dc4fe0-39c5-11ef-b92b-69af062a2179 between /127.0.0.3:7012 and /127.0.0.1:7012 on x DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:20:56,330 StreamSession.java:564 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Will close attached inbound {92f26beb=org.apache.cassandra.streaming.async.NettyStreamingChannel@606c5535} and outbound {92f26beb=org.apache.cassandra.streaming.async.NettyStreamingChannel@606c5535} channels DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,331 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-92f26beb] node3 2024-07-04 05:20:56,331 StreamSession.java:712 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node3 2024-07-04 05:20:56,331 StreamingMultiplexedChannel.java:514 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:56,331 StreamingMultiplexedChannel.java:514 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-e94ce054] node1 2024-07-04 05:20:56,331 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-e94ce054] node1 2024-07-04 05:20:56,331 StreamSession.java:712 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:56,332 InboundConnectionInitiator.java:450 - /127.0.0.4:7012(/127.0.0.1:40266)->/127.0.0.1:7012-STREAMING-91471053 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,332 StreamingMultiplexedChannel.java:473 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 channel: abeca038] Scheduling keep-alive task with 300s period. DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,333 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:40266 channel.id abeca038 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,333 StreamSession.java:596 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Changing session state from INITIALIZED to PREPARING INFO [node1_Stream-Deserializer-/127.0.0.4:7012-91471053] node1 2024-07-04 05:20:56,333 StreamResultFuture.java:123 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 ID#0] Creating new streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:40266 channel.local /127.0.0.1:7012 channel.id 91471053 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,334 StreamCoordinator.java:268 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6, ID#0] Beginning stream session with /127.0.0.1:7012 INFO [node1_Stream-Deserializer-/127.0.0.4:7012-91471053] node1 2024-07-04 05:20:56,334 StreamResultFuture.java:131 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6, ID#0] Received streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:40266 channel.local /127.0.0.1:7012 channel.id 91471053 DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91471053] node1 2024-07-04 05:20:56,334 StreamDeserializingTask.java:132 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 channel: 91471053] Received StreamInitMessage: from = /127.0.0.4:7012, planId = 30e26a60-39c5-11ef-b980-e34c7a70c3a6, session index = 0 DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91471053] node1 2024-07-04 05:20:56,334 StreamDeserializingTask.java:132 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 channel: 91471053] Received Prepare SYN (1 requests, 0 files} DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91471053] node1 2024-07-04 05:20:56,334 StreamSession.java:596 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Changing session state from INITIALIZED to PREPARING INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:20:56,335 RepairMessage.java:259 - [#30cf3080-39c5-11ef-b92b-69af062a2179] SYNC_REQ received by /127.0.0.4:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,335 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,335 StreamResultFuture.java:187 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,336 StreamSession.java:596 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Changing session state from PREPARING to COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,336 StreamDeserializingTask.java:132 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 channel: abeca038] Received Prepare SYNACK ( 0 files} INFO [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,336 StreamResultFuture.java:187 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,336 StreamSession.java:596 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Changing session state from COMPLETE to COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,336 StreamSession.java:596 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Changing session state from PREPARING to STREAMING INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,336 StreamResultFuture.java:201 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Session with /127.0.0.4:7012 is complete DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,336 StreamSession.java:596 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Changing session state from STREAMING to WAIT_COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,336 StreamResultFuture.java:260 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] All sessions completed DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,337 StreamDeserializingTask.java:132 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6 channel: abeca038] Received Complete DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,337 StreamSession.java:1128 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] handling Complete message, state = WAIT_COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,337 StreamSession.java:596 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,337 StreamResultFuture.java:201 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Session with /127.0.0.1:7012 is complete INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,337 StreamResultFuture.java:260 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] All sessions completed INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,337 StreamingRepairTask.java:121 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] streaming task succeed, returning response to /127.0.0.3:7012 DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,339 StreamSession.java:564 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Will close attached inbound {abeca038=org.apache.cassandra.streaming.async.NettyStreamingChannel@74e456e1} and outbound {abeca038=org.apache.cassandra.streaming.async.NettyStreamingChannel@74e456e1} channels DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,339 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-abeca038] node4 2024-07-04 05:20:56,339 StreamSession.java:712 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-1] node4 2024-07-04 05:20:56,340 StreamingMultiplexedChannel.java:514 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,340 RepairSession.java:263 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Repair completed between /127.0.0.4:7012 and /127.0.0.1:7012 on x INFO [node3_RepairJobTask:2] node3 2024-07-04 05:20:56,340 RepairJob.java:210 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] tr.x is fully synced DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:56,340 StreamingMultiplexedChannel.java:514 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91471053] node1 2024-07-04 05:20:56,340 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91471053] node1 2024-07-04 05:20:56,340 StreamSession.java:712 - [Stream #30e26a60-39c5-11ef-b980-e34c7a70c3a6] Socket closed after session completed with state COMPLETE INFO [node3_RepairJobTask:4] node3 2024-07-04 05:20:56,343 RepairSession.java:355 - [repair #30dc4fe0-39c5-11ef-b92b-69af062a2179] Session completed successfully INFO [node3_RepairJobTask:4] node3 2024-07-04 05:20:56,343 RepairCoordinator.java:191 - Repair session 30dc4fe0-39c5-11ef-b92b-69af062a2179 for range [(20,30]] finished DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:20:56,343 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=30dc4fe0-39c5-11ef-b92b-69af062a2179, keyspace='tr', ranges=[(20,30]], repairJobResults=[org.apache.cassandra.repair.RepairResult@53a8f9f9], skippedReplicas=false}] INFO [node3_RepairJobTask:4] node3 2024-07-04 05:20:56,344 CoordinatorSession.java:242 - Proposing finalization of repair session 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:20:56,345 StreamSession.java:1379 - [Stream #30e1a710-39c5-11ef-b92b-69af062a2179] Stream session with peer /127.0.0.1:7012 is already in a final state on abort. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,346 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.127KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,347 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,347 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.109KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:56,361 Flushing.java:153 - Writing Memtable-repairs@917563113(950B serialized bytes, 5 ops, 6.127KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:56,361 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=105826) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:56,362 Flushing.java:153 - Writing Memtable-repairs@1387893723(950B serialized bytes, 5 ops, 6.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:56,362 Flushing.java:153 - Writing Memtable-repairs@771018377(950B serialized bytes, 5 ops, 6.109KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:56,363 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=82899) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:20:56,363 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=83939) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:56,422 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.944KiB), biggest 5.944KiB, smallest 5.944KiB DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,422 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179, responded with FinalizePromise DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:20:56,426 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.936KiB), biggest 5.936KiB, smallest 5.936KiB DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,426 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179, responded with FinalizePromise DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:56,431 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.936KiB), biggest 5.936KiB, smallest 5.936KiB DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,431 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179, responded with FinalizePromise INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,432 CoordinatorSession.java:278 - Finalization proposal for repair session 30cf3080-39c5-11ef-b92b-69af062a2179 accepted by all participants. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,432 CoordinatorSession.java:373 - Incremental repair 30cf3080-39c5-11ef-b92b-69af062a2179 finalization phase completed in 0 seconds INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,432 CoordinatorSession.java:287 - Committing finalization of repair session 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,432 CoordinatorSessions.java:97 - Removing completed session 30cf3080-39c5-11ef-b92b-69af062a2179 with state FINALIZED INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,432 CoordinatorSession.java:294 - Incremental repair session 30cf3080-39c5-11ef-b92b-69af062a2179 completed DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,432 CoordinatorSession.java:376 - Incremental repair 30cf3080-39c5-11ef-b92b-69af062a2179 phase completed in 0 seconds DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,434 LocalSessions.java:1010 - Finalized local repair session 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,435 LocalSessions.java:1010 - Finalized local repair session 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,435 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070456212 and session id = 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,438 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 30cf3080-39c5-11ef-b92b-69af062a2179 on tr.x INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,440 RepairCoordinator.java:250 - [repair #30cf3080-39c5-11ef-b92b-69af062a2179]Repair command #1 finished in 0 seconds DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,441 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,441 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:20:56,443 LocalSessions.java:1010 - Finalized local repair session 30cf3080-39c5-11ef-b92b-69af062a2179 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,443 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070456212 and session id = 30cf3080-39c5-11ef-b92b-69af062a2179 DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:20:56,444 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 30cf3080-39c5-11ef-b92b-69af062a2179 on tr.x INFO [node4_Repair-Task:1] node4 2024-07-04 05:20:56,531 RepairCoordinator.java:366 - Starting repair command #1 (31013d00-39c5-11ef-b980-e34c7a70c3a6), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,542 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(30,40]], parentRepairSession=31013d00-39c5-11ef-b980-e34c7a70c3a6, isIncremental=true, timestamp=1720070456540, isGlobal=true} DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,542 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(30,40]], parentRepairSession=31013d00-39c5-11ef-b980-e34c7a70c3a6, isIncremental=true, timestamp=1720070456540, isGlobal=true} INFO [node4_RequestResponseStage-2] node4 2024-07-04 05:20:56,547 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 INFO [node4_RequestResponseStage-2] node4 2024-07-04 05:20:56,547 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,549 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=31013d00-39c5-11ef-b980-e34c7a70c3a6, state=PREPARING, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456540, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070456, lastUpdate=1720070456} DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,549 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=31013d00-39c5-11ef-b980-e34c7a70c3a6, state=PREPARING, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456540, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070456, lastUpdate=1720070456} DEBUG [node1_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node1 2024-07-04 05:20:56,551 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 31013d00-39c5-11ef-b980-e34c7a70c3a6 DEBUG [node2_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node2 2024-07-04 05:20:56,551 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 31013d00-39c5-11ef-b980-e34c7a70c3a6 DEBUG [node2_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node2 2024-07-04 05:20:56,551 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node1 2024-07-04 05:20:56,551 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:56,551 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:57258)->/127.0.0.4:7012-SMALL_MESSAGES-012612b1 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node2 2024-07-04 05:20:56,551 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:56,551 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:57258)->/127.0.0.4:7012-SMALL_MESSAGES-5782c2c6 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node1 2024-07-04 05:20:56,551 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node2_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node2 2024-07-04 05:20:56,551 LocalSessions.java:863 - Prepare phase for incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 completed INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:56,551 CompactionManager.java:928 - [repair #31013d00-39c5-11ef-b980-e34c7a70c3a6] Starting anticompaction for tr.x on 1/2 sstables INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:56,551 CompactionManager.java:987 - [repair #31013d00-39c5-11ef-b980-e34c7a70c3a6] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (30,40], mutating repairedAt instead of anticompacting DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,553 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=31013d00-39c5-11ef-b980-e34c7a70c3a6, state=PREPARING, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456540, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070456, lastUpdate=1720070456} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:56,553 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 31013d00-39c5-11ef-b980-e34c7a70c3a6 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:56,553 CompactionManager.java:948 - [repair #31013d00-39c5-11ef-b980-e34c7a70c3a6] Completed anticompaction successfully DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:56,553 LocalSessions.java:863 - Prepare phase for incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 completed DEBUG [node4_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node4 2024-07-04 05:20:56,554 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 31013d00-39c5-11ef-b980-e34c7a70c3a6 DEBUG [node4_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node4 2024-07-04 05:20:56,554 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_Repair-31013d00-39c5-11ef-b980-e34c7a70c3a6:1] node4 2024-07-04 05:20:56,554 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,555 CompactionManager.java:928 - [repair #31013d00-39c5-11ef-b980-e34c7a70c3a6] Starting anticompaction for tr.x on 1/2 sstables INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,555 CompactionManager.java:987 - [repair #31013d00-39c5-11ef-b980-e34c7a70c3a6] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (30,40], mutating repairedAt instead of anticompacting DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,556 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 31013d00-39c5-11ef-b980-e34c7a70c3a6 INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,557 CompactionManager.java:948 - [repair #31013d00-39c5-11ef-b980-e34c7a70c3a6] Completed anticompaction successfully DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,557 LocalSessions.java:863 - Prepare phase for incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 completed INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,559 CoordinatorSession.java:225 - Incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 successfully prepared. DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,560 CoordinatorSession.java:353 - Incremental repair 31013d00-39c5-11ef-b980-e34c7a70c3a6 prepare phase completed in 0 seconds INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,560 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.1:7012, /127.0.0.2:7012], transEndpoints=[/127.0.0.2:7012], ranges=[(30,40]], hasSkippedReplicas=false} INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,562 RepairSession.java:297 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] parentSessionId = 31013d00-39c5-11ef-b980-e34c7a70c3a6: new session: will sync /127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012 on range CommonRange{endpoints=[/127.0.0.1:7012, /127.0.0.2:7012], transEndpoints=[/127.0.0.2:7012], ranges=[(30,40]], hasSkippedReplicas=false} for tr.[x] INFO [node4_Repair#1:1] node4 2024-07-04 05:20:56,570 RepairJob.java:137 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] tr.x not running paxos repair INFO [node4_RepairJobTask:1] node4 2024-07-04 05:20:56,571 RepairJob.java:504 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Requesting merkle trees for x (to [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.4:7012]) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,573 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070456} org.apache.cassandra.repair.messages.ValidationRequest@66863138 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,573 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070456} org.apache.cassandra.repair.messages.ValidationRequest@66863138 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,573 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=31013d00-39c5-11ef-b980-e34c7a70c3a6, state=PREPARED, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456540, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070456, lastUpdate=1720070456} to REPAIRING DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,573 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=31013d00-39c5-11ef-b980-e34c7a70c3a6, state=PREPARED, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456540, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070456, lastUpdate=1720070456} to REPAIRING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,574 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070456} org.apache.cassandra.repair.messages.ValidationRequest@66863138 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,574 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=31013d00-39c5-11ef-b980-e34c7a70c3a6, state=PREPARED, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070456540, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070456, lastUpdate=1720070456} to REPAIRING INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,576 CassandraValidationIterator.java:215 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6], parentSessionId=31013d00-39c5-11ef-b980-e34c7a70c3a6: Performing validation compaction on 1 sstables in tr.x INFO [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,576 CassandraValidationIterator.java:215 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6], parentSessionId=31013d00-39c5-11ef-b980-e34c7a70c3a6: Performing validation compaction on 1 sstables in tr.x INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,576 CassandraValidationIterator.java:215 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6], parentSessionId=31013d00-39c5-11ef-b980-e34c7a70c3a6: Performing validation compaction on 0 sstables in tr.x INFO [node4_RequestResponseStage-1] node4 2024-07-04 05:20:56,576 RepairMessage.java:259 - [#31013d00-39c5-11ef-b980-e34c7a70c3a6] VALIDATION_REQ received by /127.0.0.2:7012 INFO [node4_RequestResponseStage-1] node4 2024-07-04 05:20:56,576 RepairMessage.java:259 - [#31013d00-39c5-11ef-b980-e34c7a70c3a6] VALIDATION_REQ received by /127.0.0.1:7012 INFO [node4_RequestResponseStage-1] node4 2024-07-04 05:20:56,576 RepairMessage.java:259 - [#31013d00-39c5-11ef-b980-e34c7a70c3a6] VALIDATION_REQ received by /127.0.0.4:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,577 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,577 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,577 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,577 Validator.java:158 - Prepared AEService trees of size 1 for [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6 on tr/x, [(30,40]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,577 Validator.java:229 - Validated 0 partitions for 31066d20-39c5-11ef-b980-e34c7a70c3a6. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,577 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,577 Validator.java:231 - Validated 0 partitions for 31066d20-39c5-11ef-b980-e34c7a70c3a6. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,577 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,578 Validator.java:257 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Sending completed merkle tree to /127.0.0.4:7012 for tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:20:56,578 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 1 msec, for [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6 on tr/x, [(30,40]]] WARN 05:20:56 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:20:56,579 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,579 RepairSession.java:242 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Received merkle tree for x from /127.0.0.2:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,581 Validator.java:158 - Prepared AEService trees of size 127 for [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6 on tr/x, [(30,40]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,581 Validator.java:158 - Prepared AEService trees of size 127 for [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6 on tr/x, [(30,40]]] DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,583 Validator.java:229 - Validated 10 partitions for 31066d20-39c5-11ef-b980-e34c7a70c3a6. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,583 Validator.java:229 - Validated 10 partitions for 31066d20-39c5-11ef-b980-e34c7a70c3a6. Partitions per leaf are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 Validator.java:231 - Validated 10 partitions for 31066d20-39c5-11ef-b980-e34c7a70c3a6. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,584 Validator.java:231 - Validated 10 partitions for 31066d20-39c5-11ef-b980-e34c7a70c3a6. Partition sizes are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,584 Validator.java:262 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Local completed merkle tree for /127.0.0.4:7012 for tr.x DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:20:56,584 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 9 msec, for [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6 on tr/x, [(30,40]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,585 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,585 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,585 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,585 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,585 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,585 Validator.java:257 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Sending completed merkle tree to /127.0.0.4:7012 for tr.x INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,585 RepairSession.java:242 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Received merkle tree for x from /127.0.0.4:7012 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:20:56,585 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 9 msec, for [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6 on tr/x, [(30,40]]] INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,587 RepairSession.java:242 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Received merkle tree for x from /127.0.0.1:7012 INFO [node4_RepairJobTask:4] node4 2024-07-04 05:20:56,589 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 31013d00-39c5-11ef-b980-e34c7a70c3a6 (took: 1ms) INFO [node4_RepairJobTask:4] node4 2024-07-04 05:20:56,590 SyncTask.java:93 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Endpoints /127.0.0.1:7012 and /127.0.0.2:7012 have 1 range(s) out of sync for x INFO [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,590 SyncTask.java:93 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Endpoints /127.0.0.4:7012 and /127.0.0.2:7012 have 1 range(s) out of sync for x INFO [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,590 LocalSyncTask.java:118 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Performing streaming repair of 1 ranges with /127.0.0.2:7012 INFO [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,590 StreamResultFuture.java:98 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Executing streaming plan for Repair INFO [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,590 StreamSession.java:396 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Starting streaming to 127.0.0.2:7012 DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,590 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,591 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.4:7012, src=/127.0.0.1:7012, dst=/127.0.0.2:7012, ranges=[(30,40]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@bfe026ed INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:56,593 InboundConnectionInitiator.java:450 - /127.0.0.4:7012(/127.0.0.1:43788)->/127.0.0.2:7012-STREAMING-04b9f545 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,593 StreamingMultiplexedChannel.java:473 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 channel: 0620898e] Scheduling keep-alive task with 300s period. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,593 StreamingRepairTask.java:84 - [streaming task #31066d20-39c5-11ef-b980-e34c7a70c3a6] Performing asymmetric streaming repair of 1 ranges with /127.0.0.2:7012 DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,593 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:43788 channel.id 0620898e INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,593 StreamingRepairTask.java:87 - [streaming task #31066d20-39c5-11ef-b980-e34c7a70c3a6] Stream plan created in 0ms DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,594 StreamSession.java:596 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Changing session state from INITIALIZED to PREPARING INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,594 StreamResultFuture.java:98 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Executing streaming plan for Repair INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,594 StreamSession.java:396 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Starting streaming to 127.0.0.2:7012 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,594 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator INFO [node2_Stream-Deserializer-/127.0.0.4:7012-04b9f545] node2 2024-07-04 05:20:56,594 StreamResultFuture.java:123 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 ID#0] Creating new streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:43788 channel.local /127.0.0.2:7012 channel.id 04b9f545 INFO [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,594 StreamCoordinator.java:268 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node2_Stream-Deserializer-/127.0.0.4:7012-04b9f545] node2 2024-07-04 05:20:56,594 StreamResultFuture.java:131 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6, ID#0] Received streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:43788 channel.local /127.0.0.2:7012 channel.id 04b9f545 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-04b9f545] node2 2024-07-04 05:20:56,594 StreamDeserializingTask.java:132 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 channel: 04b9f545] Received StreamInitMessage: from = /127.0.0.4:7012, planId = 310ab2e0-39c5-11ef-b980-e34c7a70c3a6, session index = 0 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-04b9f545] node2 2024-07-04 05:20:56,595 StreamDeserializingTask.java:132 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 channel: 04b9f545] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-04b9f545] node2 2024-07-04 05:20:56,595 StreamSession.java:596 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Changing session state from INITIALIZED to PREPARING INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:56,596 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:43802)->/127.0.0.2:7012-STREAMING-91203775 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,596 StreamingMultiplexedChannel.java:473 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d channel: bb86c928] Scheduling keep-alive task with 300s period. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,597 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:43802 channel.id bb86c928 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,597 StreamSession.java:596 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Changing session state from INITIALIZED to PREPARING INFO [node2_Stream-Deserializer-/127.0.0.1:7012-91203775] node2 2024-07-04 05:20:56,597 StreamResultFuture.java:123 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d ID#0] Creating new streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:43802 channel.local /127.0.0.2:7012 channel.id 91203775 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,597 StreamCoordinator.java:268 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node2_Stream-Deserializer-/127.0.0.1:7012-91203775] node2 2024-07-04 05:20:56,598 StreamResultFuture.java:131 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d, ID#0] Received streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:43802 channel.local /127.0.0.2:7012 channel.id 91203775 DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-91203775] node2 2024-07-04 05:20:56,598 StreamDeserializingTask.java:132 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d channel: 91203775] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 310b2810-39c5-11ef-9462-3bb8c7522e1d, session index = 0 DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,598 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-91203775] node2 2024-07-04 05:20:56,598 StreamDeserializingTask.java:132 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d channel: 91203775] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-91203775] node2 2024-07-04 05:20:56,598 StreamSession.java:596 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Changing session state from INITIALIZED to PREPARING INFO [node4_RequestResponseStage-1] node4 2024-07-04 05:20:56,598 RepairMessage.java:259 - [#31013d00-39c5-11ef-b980-e34c7a70c3a6] SYNC_REQ received by /127.0.0.1:7012 INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,598 StreamResultFuture.java:187 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,599 StreamSession.java:596 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Changing session state from PREPARING to COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,599 StreamDeserializingTask.java:132 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 channel: 0620898e] Received Prepare SYNACK ( 0 files} INFO [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,599 StreamResultFuture.java:187 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,599 StreamSession.java:596 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Changing session state from PREPARING to STREAMING DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,599 StreamSession.java:596 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,599 StreamDeserializingTask.java:132 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6 channel: 0620898e] Received Complete DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,599 StreamSession.java:1128 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] handling Complete message, state = WAIT_COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,599 StreamSession.java:596 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,599 StreamResultFuture.java:201 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Session with /127.0.0.2:7012 is complete INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,599 StreamResultFuture.java:260 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] All sessions completed INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,600 LocalSyncTask.java:168 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Sync complete using session 31066d20-39c5-11ef-b980-e34c7a70c3a6 between /127.0.0.4:7012 and /127.0.0.2:7012 on x DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,600 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:20:56,600 StreamSession.java:564 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Will close attached inbound {0620898e=org.apache.cassandra.streaming.async.NettyStreamingChannel@34d4768f} and outbound {0620898e=org.apache.cassandra.streaming.async.NettyStreamingChannel@34d4768f} channels DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,600 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,600 StreamResultFuture.java:187 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-0620898e] node4 2024-07-04 05:20:56,600 StreamSession.java:712 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node4 2024-07-04 05:20:56,600 StreamingMultiplexedChannel.java:514 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,600 StreamSession.java:596 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Changing session state from PREPARING to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,601 StreamDeserializingTask.java:132 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d channel: bb86c928] Received Prepare SYNACK ( 0 files} INFO [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,601 StreamResultFuture.java:187 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,601 StreamSession.java:596 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Changing session state from COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,601 StreamResultFuture.java:201 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Session with /127.0.0.4:7012 is complete DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,601 StreamSession.java:596 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Changing session state from PREPARING to STREAMING DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,601 StreamSession.java:596 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Changing session state from STREAMING to WAIT_COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,601 StreamResultFuture.java:260 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] All sessions completed DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,601 StreamDeserializingTask.java:132 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d channel: bb86c928] Received Complete DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,601 StreamSession.java:1128 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] handling Complete message, state = WAIT_COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,601 StreamSession.java:596 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Changing session state from COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,601 StreamResultFuture.java:201 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Session with /127.0.0.1:7012 is complete DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,601 StreamSession.java:596 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:20:56,606 StreamResultFuture.java:260 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] All sessions completed DEBUG [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:20:56,601 StreamingMultiplexedChannel.java:514 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Closing stream connection channels on /127.0.0.4:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,606 StreamResultFuture.java:201 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Session with /127.0.0.2:7012 is complete INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,606 StreamResultFuture.java:260 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] All sessions completed DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-04b9f545] node2 2024-07-04 05:20:56,606 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-04b9f545] node2 2024-07-04 05:20:56,606 StreamSession.java:712 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Socket closed after session completed with state COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,606 StreamingRepairTask.java:121 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] streaming task succeed, returning response to /127.0.0.4:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:20:56,607 StreamSession.java:564 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Will close attached inbound {bb86c928=org.apache.cassandra.streaming.async.NettyStreamingChannel@6e2a1be5} and outbound {bb86c928=org.apache.cassandra.streaming.async.NettyStreamingChannel@6e2a1be5} channels DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,607 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-bb86c928] node1 2024-07-04 05:20:56,607 StreamSession.java:712 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node1 2024-07-04 05:20:56,607 StreamingMultiplexedChannel.java:514 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:56,607 StreamingMultiplexedChannel.java:514 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-91203775] node2 2024-07-04 05:20:56,608 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-91203775] node2 2024-07-04 05:20:56,608 StreamSession.java:712 - [Stream #310b2810-39c5-11ef-9462-3bb8c7522e1d] Socket closed after session completed with state COMPLETE DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,608 RepairSession.java:263 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Repair completed between /127.0.0.1:7012 and /127.0.0.2:7012 on x INFO [node4_RepairJobTask:2] node4 2024-07-04 05:20:56,608 RepairJob.java:210 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] tr.x is fully synced INFO [node4_RepairJobTask:4] node4 2024-07-04 05:20:56,612 RepairSession.java:355 - [repair #31066d20-39c5-11ef-b980-e34c7a70c3a6] Session completed successfully INFO [node4_RepairJobTask:4] node4 2024-07-04 05:20:56,612 RepairCoordinator.java:191 - Repair session 31066d20-39c5-11ef-b980-e34c7a70c3a6 for range [(30,40]] finished DEBUG [node4_RepairJobTask:4] node4 2024-07-04 05:20:56,613 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=31066d20-39c5-11ef-b980-e34c7a70c3a6, keyspace='tr', ranges=[(30,40]], repairJobResults=[org.apache.cassandra.repair.RepairResult@57cd668], skippedReplicas=false}] INFO [node4_RepairJobTask:4] node4 2024-07-04 05:20:56,613 CoordinatorSession.java:242 - Proposing finalization of repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 DEBUG [node4_RepairJobTask:4] node4 2024-07-04 05:20:56,614 StreamSession.java:1379 - [Stream #310ab2e0-39c5-11ef-b980-e34c7a70c3a6] Stream session with peer /127.0.0.2:7012 is already in a final state on abort. INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,617 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,617 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,617 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.127KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:56,626 Flushing.java:153 - Writing Memtable-repairs@207662801(950B serialized bytes, 5 ops, 6.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:56,626 Flushing.java:153 - Writing Memtable-repairs@76386010(950B serialized bytes, 5 ops, 6.127KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:20:56,627 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=85161) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:20:56,627 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070435049, position=108521) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:56,628 Flushing.java:153 - Writing Memtable-repairs@953138498(950B serialized bytes, 5 ops, 6.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:20:56,628 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=87407) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:20:56,655 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.938KiB), biggest 5.938KiB, smallest 5.938KiB DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,656 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6, responded with FinalizePromise DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:20:56,657 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.938KiB), biggest 5.938KiB, smallest 5.938KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:20:56,657 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.944KiB), biggest 5.944KiB, smallest 5.944KiB DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,657 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6, responded with FinalizePromise DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,658 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6, responded with FinalizePromise INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,658 CoordinatorSession.java:278 - Finalization proposal for repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 accepted by all participants. DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,658 CoordinatorSession.java:373 - Incremental repair 31013d00-39c5-11ef-b980-e34c7a70c3a6 finalization phase completed in 0 seconds INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,659 CoordinatorSession.java:287 - Committing finalization of repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,659 CoordinatorSessions.java:97 - Removing completed session 31013d00-39c5-11ef-b980-e34c7a70c3a6 with state FINALIZED INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,659 CoordinatorSession.java:294 - Incremental repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 completed DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,659 CoordinatorSession.java:376 - Incremental repair 31013d00-39c5-11ef-b980-e34c7a70c3a6 phase completed in 0 seconds DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,661 LocalSessions.java:1010 - Finalized local repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,662 LocalSessions.java:1010 - Finalized local repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:20:56,662 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070456540 and session id = 31013d00-39c5-11ef-b980-e34c7a70c3a6 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,664 RepairCoordinator.java:250 - [repair #31013d00-39c5-11ef-b980-e34c7a70c3a6]Repair command #1 finished in 0 seconds DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:20:56,664 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 31013d00-39c5-11ef-b980-e34c7a70c3a6 on tr.x DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:20:56,665 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:20:56,666 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:20:56,666 LocalSessions.java:1010 - Finalized local repair session 31013d00-39c5-11ef-b980-e34c7a70c3a6 INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,666 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070456540 and session id = 31013d00-39c5-11ef-b980-e34c7a70c3a6 DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:20:56,668 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 31013d00-39c5-11ef-b980-e34c7a70c3a6 on tr.x INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:20:56,668 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:20:56,672 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:20:56,674 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:20:56,674 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:20:56,674 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:20:56,674 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:20:56,674 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:20:56,674 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:56,674 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:56,674 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:56,675 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:20:56,675 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:20:56,675 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:20:56,675 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node4_GossipStage:1] node4 2024-07-04 05:20:56,675 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node2_GossipStage:1] node2 2024-07-04 05:20:56,675 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:20:56,675 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:56,813 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:40282)->/127.0.0.1:7012-URGENT_MESSAGES-69e2c180 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:56,813 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:40282)->/127.0.0.1:7012-URGENT_MESSAGES-4e96af77 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:20:56,852 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:40298)->/127.0.0.1:7012-URGENT_MESSAGES-d076afa9 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:56,852 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:40298)->/127.0.0.1:7012-URGENT_MESSAGES-bc95cdd6 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:56,859 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:40304)->/127.0.0.1:7012-URGENT_MESSAGES-5d802e8a successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:20:56,859 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:40304)->/127.0.0.1:7012-URGENT_MESSAGES-8f491b73 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_BatchlogTasks:1] node1 2024-07-04 05:20:57,727 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:20:58,706 HintsService.java:234 - Paused hints dispatch DEBUG [node1_isolatedExecutor:7] node1 2024-07-04 05:20:58,752 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node1_isolatedExecutor:7] node1 2024-07-04 05:20:58,752 MessagingService.java:643 - Waiting for messaging service to quiesce INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:58,816 NoSpamLogger.java:104 - /127.0.0.3:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:58,816 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:58,816 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:58,854 NoSpamLogger.java:104 - /127.0.0.2:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:58,855 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:58,855 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:58,862 NoSpamLogger.java:104 - /127.0.0.4:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:58,862 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:58,862 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:59,817 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:20:59,817 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:59,856 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:20:59,856 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:59,864 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:20:59,864 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:00,766 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:00,819 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:00,819 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:00,857 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:00,857 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:00,867 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:00,867 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [main] node1 2024-07-04 05:21:01,425 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-07-04 05:21:01,431 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-07-04 05:21:01,431 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node1 2024-07-04 05:21:01,432 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-07-04 05:21:01,433 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node1 2024-07-04 05:21:01,433 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-07-04 05:21:01,434 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node1 2024-07-04 05:21:01,434 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node1 2024-07-04 05:21:01,435 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-07-04 05:21:01,437 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-07-04 05:21:01,438 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-07-04 05:21:01,438 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node1 2024-07-04 05:21:01,438 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node1 2024-07-04 05:21:01,439 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-07-04 05:21:01,439 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-07-04 05:21:01,440 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node1 2024-07-04 05:21:01,441 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-07-04 05:21:01,442 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-07-04 05:21:01,442 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,513 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,514 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,515 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,515 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,515 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,516 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,526 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,527 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,621 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,632 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,665 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,665 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,666 CassandraDaemon.java:613 - Heap size: 432.000MiB/1.000GiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1570432(1533K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 190167336(185710K) committed = 191037440(186560K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 23779584(23222K) committed = 23789568(23232K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 24878688(24295K) committed = 25296896(24704K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 100663296(98304K) committed = 117440512(114688K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 318041600(310587K) committed = 402653184(393216K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 16777216(16384K) committed = 16777216(16384K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,667 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 6281216(6134K) committed = 6291456(6144K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,668 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,668 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_ScheduledTasks:1] node1 2024-07-04 05:21:01,716 StorageService.java:294 - Overriding RING_DELAY to 15000ms DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:01,820 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:01,820 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,852 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:01,852 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:01,858 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:01,858 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:01,870 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:01,870 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,089 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,090 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds WARN 05:21:02 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,312 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:02 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,318 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:02 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,319 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,344 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,344 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,357 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,360 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,361 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,361 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,361 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,367 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,372 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,372 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,372 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,373 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,373 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,375 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,377 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,377 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,378 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,378 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,379 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,379 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,379 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,379 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:21:02 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,380 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:02 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,380 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,382 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,382 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,387 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,387 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,388 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,388 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,389 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/hints INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,641 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,645 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,791 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,798 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,804 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node1_SecondaryIndexManagement:1] node1 2024-07-04 05:21:02,815 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,821 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:02,821 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:02,821 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:02,829 ColumnFamilyStore.java:508 - Initializing system.local INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:02,841 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:02,859 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:02,860 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:02,876 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:02,876 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:02,884 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:02,886 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:02,886 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:02,929 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:02,987 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big (233B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,086 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,096 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,110 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,116 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,125 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,138 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,145 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,163 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,169 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,173 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,179 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,185 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,191 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,196 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,204 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,212 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,224 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:03,232 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big (247B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,234 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big (241B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:03,235 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big (157B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,241 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,248 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,258 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big (1.803KiB) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,261 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,262 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,266 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,288 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,487 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,510 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big (373B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:03,514 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big (107B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,523 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,540 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big (4.014KiB) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,549 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,560 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big (7.946KiB) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,579 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,592 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big (3.301KiB) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:03,599 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big (27B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,608 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,614 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,624 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,631 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big (101B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,642 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,655 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,665 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,677 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,684 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,692 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,701 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,706 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,713 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:03,718 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big (173B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,735 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,736 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,737 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,737 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,756 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,756 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,756 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,762 Startup.java:504 - hasAnyEpoch = true, hasBootedBefore = true INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,763 Startup.java:103 - Initializing as non CMS node DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:03,822 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:03,822 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,832 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,833 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,833 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,833 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,840 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6412896954276115419088.so DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,843 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,843 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,845 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,846 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,847 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,851 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:03,861 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,861 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:03,861 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:03,877 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:03,878 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,883 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,888 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:03,889 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,226 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,237 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,237 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,239 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,256 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=Epoch{epoch=13}, entries=0: []} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:04,260 LocalLog.java:492 - Enacted ForceSnapshot{epoch=Epoch{epoch=13}}. New tail is Epoch{epoch=13} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,301 StorageService.java:494 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,303 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,318 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=13} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,319 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=13} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,319 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,323 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,323 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=13} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,332 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,339 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,345 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,352 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,358 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,363 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,369 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,389 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,396 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,397 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,397 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,414 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,414 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,415 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,419 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,420 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,420 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,427 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,436 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,446 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,453 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,465 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:04,472 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big (107B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:04,475 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big (200B) INFO [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:04,575 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,655 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 576B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:04,721 Flushing.java:153 - Writing Memtable-column_masks@174541279(32B serialized bytes, 1 ops, 576B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:04,724 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:04,810 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa_txn_flush_35db26b0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:04,823 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:04,823 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:04,829 CompactionManager.java:236 - Autocompaction on system_schema.column_masks is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:04,830 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,841 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 59.396KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:04,848 Flushing.java:153 - Writing Memtable-columns@1961139197(12.668KiB serialized bytes, 73 ops, 59.396KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:04,865 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:04,865 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:04,880 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:04,880 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:04,880 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db (5.229KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:04,911 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_35f5daa0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:04,914 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:04,914 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db')] (1 sstables, 7.404KiB), biggest 7.404KiB, smallest 7.404KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:04,916 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 42.240KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:04,940 Flushing.java:153 - Writing Memtable-tables@755749167(12.824KiB serialized bytes, 16 ops, 42.240KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:04,943 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db (7.195KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,052 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_36017360-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,064 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,064 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db')] (1 sstables, 8.211KiB), biggest 8.211KiB, smallest 8.211KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,065 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 4.574KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:05,074 Flushing.java:153 - Writing Memtable-keyspaces@1795955357(932B serialized bytes, 6 ops, 4.574KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:05,076 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db (676B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,156 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_3617e190-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,159 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,159 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db')] (1 sstables, 5.591KiB), biggest 5.591KiB, smallest 5.591KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,194 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN), (NodeId{id=2},JOIN), (NodeId{id=3},JOIN), (NodeId{id=4},JOIN)] INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:05,222 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 692B (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,224 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.1:7012), nic: lo, encryption: unencrypted INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:05,231 Flushing.java:153 - Writing Memtable-local@302508545(89B serialized bytes, 2 ops, 692B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:05,231 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (38B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=15953) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,263 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,263 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,268 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,270 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,319 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,319 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,319 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,319 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,319 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,320 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,320 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,320 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,320 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,320 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,320 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,320 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,324 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_36304b90-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,330 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,331 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,336 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,336 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,336 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:05,358 SecondaryIndexManager.java:947 - Executing pre-join post-bootstrap tasks for: CFS(Keyspace='tr', ColumnFamily='x') WARN 05:21:05 Using stored Gossip Generation 1720070466 as it is greater than current system time 1720070465. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:05,360 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070466 as it is greater than current system time 1720070465. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:05,366 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 564B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:05,373 Flushing.java:153 - Writing Memtable-local@1122803919(53B serialized bytes, 1 ops, 564B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:05,374 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=16035) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,382 CassandraDaemon.java:514 - opening keyspace distributed_test_keyspace DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,382 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,382 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,382 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,382 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,382 CassandraDaemon.java:514 - opening keyspace tr DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,383 TestChangeListener.java:42 - Registered TestChangeListener INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,454 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_36464490-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,459 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:05,459 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:05,481 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070465, version = 14, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,4), DC=Value(dc0,5), RACK=Value(rack0,6), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,7), RPC_ADDRESS=Value(127.0.0.1,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,9), TOKENS=Value(10,10), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,11), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,12), STATUS_WITH_PORT=Value(NORMAL,10,13)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:05,489 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:05,520 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:05,523 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,555 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,630 CommitLog.java:205 - Replaying /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/commitlog/CommitLog-9-1720070435049.log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,655 CommitLogReplayer.java:175 - Global replay position is CommitLogPosition(segmentId=-1, position=0) from columnfamilies 0ecdaa87-f8fb-3e60-88d1-74fb36fe5c0d:{}, b8b43d5f-d6c0-331c-8f7d-765ea658f4c4:{}, 618f817b-005f-3678-b8a4-53f3930b8e86:{}, b7b7f0c2-fd0a-3410-8c05-3ef614bb7c2d:{}, c4325fbb-8e5e-3baf-bd07-0f9250ed818e:{}, 5a8b1ca8-6602-3f77-a045-9273d308917a:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=85390)}, 0feb57ac-311f-382f-ba6d-9024d305702f:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=85390)}, 5a1ff267-ace0-3f12-8563-cfae6103c65e:{}, 4224a088-2ac9-3d0c-889d-fbb5f0facda0:{}, d6123acc-8649-3496-9d4e-f3fe39a6018b:{}, 4df70b66-6b05-3251-95a1-32b54005fd48:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=85390)}, deabd734-b99d-3b9c-92e5-fd92eb5abf14:{}, 176c39cd-b93d-33a5-a218-8eb06a56f66e:{}, ecb86667-40b2-3316-bb91-e612c8047457:{}, 4b3c50a9-ea87-3d76-9101-6dbc9c38494a:{}, 37f71aca-7dc2-383b-a706-72528af04d4f:{}, 24101c25-a2ae-3af7-87c1-b40ee1aca33f:{CommitLogPosition(segmentId=1720070435049, position=21799)=CommitLogPosition(segmentId=1720070435049, position=95271), CommitLogPosition(segmentId=1720070462106, position=28)=CommitLogPosition(segmentId=1720070462106, position=15780)}, 1ff78f1a-7df1-3a2a-a998-6f4932270af5:{}, d885727a-f67b-3a32-951b-78efe9c75732:{}, 7ad54392-bcdd-35a6-8417-4e047860b377:{CommitLogPosition(segmentId=1720070435049, position=66061)=CommitLogPosition(segmentId=1720070435049, position=68697), CommitLogPosition(segmentId=1720070462106, position=28)=CommitLogPosition(segmentId=1720070462106, position=16035)}, 7e5a361c-317c-351f-b15f-ffd8afd3dd4b:{}, afddfb9d-bc1e-3068-8056-eed6c302ba09:{CommitLogPosition(segmentId=1720070435049, position=21799)=CommitLogPosition(segmentId=1720070435049, position=95271), CommitLogPosition(segmentId=1720070462106, position=28)=CommitLogPosition(segmentId=1720070462106, position=15780)}, 5582b59f-8e4e-35e1-b913-3acada51eb04:{}, b4dbb7b4-dc49-3fb5-b3bf-ce6e434832ca:{}, 62efe31f-3be8-310c-8d29-8963439c1288:{}, 8826e8e9-e16a-3728-8753-3bc1fc713c25:{}, 9c48af00-13f6-3059-bb0e-8fcabba6eecb:{}, 9786ac1c-dd58-3201-a7cd-ad556410c985:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=85390)}, 0e65065f-e401-38ed-9507-b9213fae8d11:{}, 919a4bc5-7a33-3573-b03e-13fc3f68b465:{}, 5bc52802-de25-35ed-aeab-188eecebb090:{}, 6c22df66-c3bd-3df6-b74d-21179c6a9fe9:{}, 924c5587-2e3a-345b-b10c-12f37c1ba895:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=85390)}, 738cc5ed-0168-3268-b9d1-853d4bc278af:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=94237), CommitLogPosition(segmentId=1720070462106, position=28)=CommitLogPosition(segmentId=1720070462106, position=15780)}, 0bd47a48-d6ba-3c8e-b442-0f6349329bda:{}, 9f5c6374-d485-3229-9a0a-5094af9ad1e3:{}, abac5682-dea6-31c5-b535-b3d6cffd0fb6:{CommitLogPosition(segmentId=1720070435049, position=21799)=CommitLogPosition(segmentId=1720070435049, position=95271), CommitLogPosition(segmentId=1720070462106, position=28)=CommitLogPosition(segmentId=1720070462106, position=15780)}, 1b255f4d-ef25-40a6-0000-00000000000c:{CommitLogPosition(segmentId=1720070435049, position=93153)=CommitLogPosition(segmentId=1720070435049, position=100536)}, a3d277d1-cfaf-36f5-a2a7-38d5eea9ad6a:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=108521)}, 59dfeaea-8db2-3341-91ef-109974d81484:{}, 6775be21-7f1f-3a2f-90d5-bd313a15ce78:{}, e4ddd16e-bea6-31f4-8361-e88f07af8d4e:{CommitLogPosition(segmentId=1720070435049, position=67241)=CommitLogPosition(segmentId=1720070435049, position=93153)}, 3afbe79f-2194-31a7-add7-f5ab90d8ec9c:{}, c5e99f16-8677-3914-b17e-960613512345:{}, 6cad20f7-d4f5-3af2-b6e2-0da33c6c1f83:{}, 5e7583b5-f3f4-3af1-9a39-b7e1d6f5f11f:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=85390)}, 5f2fbdad-91f1-3946-bd25-d5da3a5c35ec:{}, 759fffad-624b-3181-80ee-fa9a52d1f627:{}, c539fcab-d65a-31d1-8133-d25605643ee3:{}, d46780c2-2f1c-3db9-b4c1-b8d9fbc0cc23:{}, 18a9c257-6a0c-3841-ba71-8cd529849fef:{}, 96489b79-80be-3e14-a701-66a0b9159450:{CommitLogPosition(segmentId=1720070435049, position=28)=CommitLogPosition(segmentId=1720070435049, position=85390)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,688 CommitLogReader.java:266 - Reading /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/commitlog/CommitLog-9-1720070435049.log (CL version 9, messaging version 14, compression null) INFO [node1_MutationStage-1] node1 2024-07-04 05:21:05,771 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:05,899 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:05,900 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:05,901 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@60f3bd5d DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:05,972 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:05,972 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:05,972 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:05,972 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:05,972 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:05,978 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:39958)->/127.0.0.1:7012-URGENT_MESSAGES-6de469be successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:05,979 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:39970)->/127.0.0.1:7012-URGENT_MESSAGES-eda367ee successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:05,991 CommitLogReader.java:257 - Finished reading /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/commitlog/CommitLog-9-1720070435049.log INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,000 ColumnFamilyStore.java:1060 - Enqueuing flush of system_auth.roles, Reason: STARTUP, Usage: 962B (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: STARTUP, Usage: 58.260KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: STARTUP, Usage: 3.054KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: STARTUP, Usage: 39.349KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,002 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: STARTUP, Usage: 11.258KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,002 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: STARTUP, Usage: 23.372KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,002 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: STARTUP, Usage: 14.991KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,003 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: STARTUP, Usage: 5.329KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,003 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: STARTUP, Usage: 15.152KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,003 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: STARTUP, Usage: 2.884KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,003 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: STARTUP, Usage: 3.562KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,005 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: STARTUP, Usage: 4.380KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,005 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: STARTUP, Usage: 2.161KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,005 ColumnFamilyStore.java:1060 - Enqueuing flush of system_distributed.parent_repair_history, Reason: STARTUP, Usage: 16.652KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,006 ColumnFamilyStore.java:1060 - Enqueuing flush of system_distributed.repair_history, Reason: STARTUP, Usage: 8.113KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:06,006 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: STARTUP, Usage: 12.210KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,028 Flushing.java:153 - Writing Memtable-roles@832410388(151B serialized bytes, 4 ops, 962B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,029 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db (83B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:06,034 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:39958)->/127.0.0.1:7012-URGENT_MESSAGES-7d77f39c messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:06,037 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:39986)->/127.0.0.1:7012-URGENT_MESSAGES-1896331c messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:06,041 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:39986)->/127.0.0.1:7012-URGENT_MESSAGES-ce12a2e3 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:06,048 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:39970)->/127.0.0.1:7012-URGENT_MESSAGES-0fb5d823 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,109 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa_txn_flush_36a6b410-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,113 CompactionManager.java:236 - Autocompaction on system_auth.roles is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,114 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db')] (1 sstables, 5.166KiB), biggest 5.166KiB, smallest 5.166KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,120 Flushing.java:153 - Writing Memtable-columns@978239304(12.513KiB serialized bytes, 72 ops, 58.260KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db (5.311KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,150 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_36b7f220-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,154 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,154 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db')] (1 sstables, 7.449KiB), biggest 7.449KiB, smallest 7.449KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,158 Flushing.java:153 - Writing Memtable-keyspaces@389287394(622B serialized bytes, 4 ops, 3.054KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,159 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db (461B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,194 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_36be0ca0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,216 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,216 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db')] (1 sstables, 5.471KiB), biggest 5.471KiB, smallest 5.471KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,228 Flushing.java:153 - Writing Memtable-tables@813251859(12.069KiB serialized bytes, 15 ops, 39.349KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,230 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db (6.854KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,293 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_36c78280-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,296 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,296 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db')] (1 sstables, 8.185KiB), biggest 8.185KiB, smallest 8.185KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,303 Flushing.java:153 - Writing Memtable-compaction_history@1839275323(2.242KiB serialized bytes, 8 ops, 11.258KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,305 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db (1.109KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,325 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa_txn_flush_36d3de90-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,327 CompactionManager.java:236 - Autocompaction on system.compaction_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,328 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db')] (1 sstables, 6.240KiB), biggest 6.240KiB, smallest 6.240KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,339 Flushing.java:153 - Writing Memtable-paxos@576346936(6.678KiB serialized bytes, 40 ops, 23.372KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,342 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db (5.427KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,349 UncommittedTableData.java:516 - flushing generation 0 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,390 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa_txn_flush_36d89980-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,393 CompactionManager.java:236 - Autocompaction on system.paxos is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,393 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db')] (1 sstables, 8.235KiB), biggest 8.235KiB, smallest 8.235KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,397 Flushing.java:153 - Writing Memtable-sstable_activity_v2@364255628(288B serialized bytes, 36 ops, 14.991KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,400 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db (1.577KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,441 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa_txn_flush_36e28490-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,443 CompactionManager.java:236 - Autocompaction on system.sstable_activity_v2 is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,443 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db')] (1 sstables, 6.998KiB), biggest 6.998KiB, smallest 6.998KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,457 Flushing.java:153 - Writing Memtable-peers_v2@1818115980(951B serialized bytes, 22 ops, 5.329KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,458 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db (342B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) DEBUG [node3_BatchlogTasks:1] node3 2024-07-04 05:21:06,471 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint DEBUG [node2_BatchlogTasks:1] node2 2024-07-04 05:21:06,532 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,533 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa_txn_flush_36ea4cc0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,539 CompactionManager.java:236 - Autocompaction on system.peers_v2 is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,539 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db')] (1 sstables, 5.774KiB), biggest 5.774KiB, smallest 5.774KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,551 Flushing.java:153 - Writing Memtable-sstable_activity@158576633(288B serialized bytes, 36 ops, 15.152KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,554 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db (1.676KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,658 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa_txn_flush_36f8cbb0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,661 CompactionManager.java:236 - Autocompaction on system.sstable_activity is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,661 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db')] (1 sstables, 7.100KiB), biggest 7.100KiB, smallest 7.100KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,696 Flushing.java:153 - Writing Memtable-repairs@2030085748(475B serialized bytes, 1 ops, 2.884KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,697 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db (178B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,738 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa_txn_flush_370b6950-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,741 CompactionManager.java:236 - Autocompaction on system.repairs is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,741 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db')] (1 sstables, 5.824KiB), biggest 5.824KiB, smallest 5.824KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,750 Flushing.java:153 - Writing Memtable-local_metadata_log@1549773473(1.681KiB serialized bytes, 3 ops, 3.562KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,751 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (1.485KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,786 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_37179e50-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,807 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,807 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.903KiB), biggest 5.903KiB, smallest 5.903KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,823 Flushing.java:153 - Writing Memtable-peers@1105222905(795B serialized bytes, 22 ops, 4.380KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,824 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db (297B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,895 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa_txn_flush_3721b070-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,898 CompactionManager.java:236 - Autocompaction on system.peers is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,898 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db')] (1 sstables, 5.560KiB), biggest 5.560KiB, smallest 5.560KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,905 Flushing.java:153 - Writing Memtable-local@1442332507(462B serialized bytes, 8 ops, 2.161KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,905 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (182B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,924 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_372f9320-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,927 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,927 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 5.884KiB), biggest 5.884KiB, smallest 5.884KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,934 Flushing.java:153 - Writing Memtable-parent_repair_history@699859094(2.832KiB serialized bytes, 8 ops, 16.652KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,935 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db (1.346KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,956 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa_txn_flush_3733fff0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,958 CompactionManager.java:236 - Autocompaction on system_distributed.parent_repair_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,959 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db')] (1 sstables, 6.191KiB), biggest 6.191KiB, smallest 6.191KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,966 Flushing.java:153 - Writing Memtable-repair_history@136097187(1.570KiB serialized bytes, 8 ops, 8.113KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:06,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db (617B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,993 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa_txn_flush_3738e1f0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,998 CompactionManager.java:236 - Autocompaction on system_distributed.repair_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:06,998 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db')] (1 sstables, 6.178KiB), biggest 6.178KiB, smallest 6.178KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:07,015 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1264070605(4.060KiB serialized bytes, 13 ops, 12.210KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:07,017 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db (3.225KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:07,076 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa_txn_flush_373efc70-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:07,097 CompactionManager.java:236 - Autocompaction on system_cluster_metadata.distributed_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:07,097 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db')] (1 sstables, 7.057KiB), biggest 7.057KiB, smallest 7.057KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,097 CommitLog.java:207 - Log replay complete, 214 replayed mutations INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,101 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,101 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,101 StorageService.java:704 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,102 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) DEBUG [node4_BatchlogTasks:1] node4 2024-07-04 05:21:07,110 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,139 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes WARN 05:21:07 Using stored Gossip Generation 1720070467 as it is greater than current system time 1720070467. See CASSANDRA-3654 if you experience problems WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,364 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070467 as it is greater than current system time 1720070467. See CASSANDRA-3654 if you experience problems INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,374 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 564B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:07,385 Flushing.java:153 - Writing Memtable-local@1607389978(53B serialized bytes, 1 ops, 564B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:07,385 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=61727) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:07,433 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_377834e0-39c5-11ef-a069-5f0d330fc2b0.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:07,435 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:07,436 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,436 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,437 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070465, version = 25, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), RPC_ADDRESS=Value(127.0.0.1,19), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,453 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,454 Gossiper.java:511 - Convicting /127.0.0.2:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,454 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,460 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,462 Gossiper.java:511 - Convicting /127.0.0.3:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,462 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,464 FailureDetector.java:389 - Forcing conviction of /127.0.0.4:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,467 Gossiper.java:511 - Convicting /127.0.0.4:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,467 Gossiper.java:1154 - InetAddress /127.0.0.4:7012 is now DOWN INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:07,468 Gossiper.java:1940 - Waiting for gossip to settle... INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:07,884 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:52296)->/127.0.0.4:7012-URGENT_MESSAGES-9c2721db messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:07,885 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:43566)->/127.0.0.3:7012-URGENT_MESSAGES-e836e400 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:07,887 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:52296)->/127.0.0.4:7012-URGENT_MESSAGES-9b170a72 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:07,888 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:43566)->/127.0.0.3:7012-URGENT_MESSAGES-76604e92 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:07,889 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node4_GossipStage:1] node4 2024-07-04 05:21:07,890 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node4_GossipStage:1] node4 2024-07-04 05:21:07,890 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:07,890 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node3_GossipStage:1] node3 2024-07-04 05:21:07,890 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node3_GossipStage:1] node3 2024-07-04 05:21:07,891 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:07,912 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:07,913 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:07,913 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,913 Gossiper.java:1090 - Clearing interval times for /127.0.0.4:7012 due to generation change INFO [node3_GossipStage:1] node3 2024-07-04 05:21:07,913 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,913 Gossiper.java:1090 - Clearing interval times for /127.0.0.2:7012 due to generation change DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,913 Gossiper.java:1090 - Clearing interval times for /127.0.0.3:7012 due to generation change INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:07,914 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:51968)->/127.0.0.2:7012-URGENT_MESSAGES-45cd1fa1 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,915 Gossiper.java:1197 - Node /127.0.0.2:7012 has restarted, now UP INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:07,915 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:51968)->/127.0.0.2:7012-URGENT_MESSAGES-c96cb066 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,916 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:07,916 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node2_GossipStage:1] node2 2024-07-04 05:21:07,917 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node2_GossipStage:1] node2 2024-07-04 05:21:07,917 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,924 Gossiper.java:1197 - Node /127.0.0.3:7012 has restarted, now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,924 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,931 Gossiper.java:1197 - Node /127.0.0.4:7012 has restarted, now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,932 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:07,939 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:07,939 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:07,945 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:07,946 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,946 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,946 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,949 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:07,950 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP WARN 05:21:08 Not marking nodes down due to local pause of 5632410978ns > 5000000000ns WARN [node1_GossipTasks:1] node1 2024-07-04 05:21:08,443 FailureDetector.java:355 - Not marking nodes down due to local pause of 5632410978ns > 5000000000ns DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:08,443 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:08,443 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:08,770 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070465, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 62, AppStateMap = {LOAD=Value(105726.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 62, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 62, AppStateMap = {STATUS_WITH_PORT=Value(NORMAL,40,37), DC=Value(dc0,29), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,36), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,35), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,33), TOKENS=Value(40,34), NET_VERSION=Value(14,8), SSTABLE_VERSIONS=Value(big-oa,10), LOAD=Value(125807.0,46), RACK=Value(rack0,30)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,070 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070465, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 63, AppStateMap = {LOAD=Value(105726.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 63, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 62, AppStateMap = {STATUS_WITH_PORT=Value(NORMAL,40,37), DC=Value(dc0,29), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,36), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,35), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,33), TOKENS=Value(40,34), NET_VERSION=Value(14,8), SSTABLE_VERSIONS=Value(big-oa,10), LOAD=Value(125807.0,46), RACK=Value(rack0,30)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,371 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070465, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 63, AppStateMap = {LOAD=Value(105726.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 63, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 62, AppStateMap = {STATUS_WITH_PORT=Value(NORMAL,40,37), DC=Value(dc0,29), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,36), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,35), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,33), TOKENS=Value(40,34), NET_VERSION=Value(14,8), SSTABLE_VERSIONS=Value(big-oa,10), LOAD=Value(125807.0,46), RACK=Value(rack0,30)}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,371 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,375 Startup.java:400 - NORMAL DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,386 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,386 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,395 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,401 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881667379 bytes available, checking if we can write 792 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,401 CompactionTask.java:167 - Compacting (38ac9630-39c5-11ef-a069-5f0d330fc2b0) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,406 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,411 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:09,440 SnapshotManager.java:125 - Adding snapshots: . DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:09,445 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:09,445 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:09,445 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,462 CompactionTask.java:258 - Compacted (38ac9630-39c5-11ef-a069-5f0d330fc2b0) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-5-big,] to level=0. 794B to 271B (~34% of original) in 56ms. Read Throughput = 13.750KiB/s, Write Throughput = 4.693KiB/s, Row Throughput = ~6/s. 6 total partitions merged to 3. Partition merge counts were {2:3, }. Time spent writing keys = 27ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,463 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,465 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,465 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,467 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881655706 bytes available, checking if we can write 497 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,467 CompactionTask.java:167 - Compacting (38b76ba0-39c5-11ef-a069-5f0d330fc2b0) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,468 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,470 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,473 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:09,545 Commit.java:366 - Received commit request Commit{transformation=PrepareMove{nodeId=NodeId{id=2}, tokens=[25], streamData=true}, lastKnown=Epoch{epoch=13}} from /127.0.0.3:7012 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,551 CompactionTask.java:258 - Compacted (38b76ba0-39c5-11ef-a069-5f0d330fc2b0) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big,] to level=0. 497B to 231B (~46% of original) in 82ms. Read Throughput = 5.854KiB/s, Write Throughput = 2.721KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 28ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,552 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,552 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,552 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,552 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,552 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,552 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,553 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881702400 bytes available, checking if we can write 1003 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,553 CompactionTask.java:167 - Compacting (38c4b210-39c5-11ef-a069-5f0d330fc2b0) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,554 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,556 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,559 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,561 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,564 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,591 CompactionTask.java:258 - Compacted (38c4b210-39c5-11ef-a069-5f0d330fc2b0) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big,] to level=0. 1003B to 358B (~35% of original) in 36ms. Read Throughput = 27.167KiB/s, Write Throughput = 9.697KiB/s, Row Throughput = ~16/s. 19 total partitions merged to 8. Partition merge counts were {1:2, 2:1, 3:5, }. Time spent writing keys = 12ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,592 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,594 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,597 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,598 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:09,605 AbstractLocalProcessor.java:98 - Committed PrepareMove{nodeId=NodeId{id=2}, tokens=[25], streamData=true}. New epoch is Epoch{epoch=14} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:09,605 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=14} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:09,607 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 756B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:09,630 Flushing.java:153 - Writing Memtable-local_metadata_log@1324145605(114B serialized bytes, 1 ops, 756B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:09,631 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=67396) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:09,646 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,646 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,646 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:09,646 LocalLog.java:492 - Enacted EXECUTED {PrepareMove{nodeId=NodeId{id=2}, tokens=[25], streamData=true}}. New tail is Epoch{epoch=14} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:09,647 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:21:09,648 LegacyStateListener.java:133 - Node /127.0.0.3:7012 state MOVING, tokens [30] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:09,649 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} to /127.0.0.2:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:09,650 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:09,650 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=14}, logState=LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}}} to sender /127.0.0.3:7012 DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,651 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:09,652 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:09,652 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:09,652 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:09,652 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:09,653 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(MOVING,25,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:09,675 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 754B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:09,676 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:09,704 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:09,706 Flushing.java:153 - Writing Memtable-local_metadata_log@1176011078(114B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,706 Flushing.java:153 - Writing Memtable-local_metadata_log@1260286550(114B serialized bytes, 1 ops, 754B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,707 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=86498) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:09,707 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=86866) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:09,709 Flushing.java:153 - Writing Memtable-local_metadata_log@1830986780(114B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:09,709 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=89672) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:09,779 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:09,779 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,779 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:09,779 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:09,779 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,779 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,779 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),52), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1238)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:09,779 LocalLog.java:492 - Enacted PrepareMove{nodeId=NodeId{id=2}, tokens=[25], streamData=true}. New tail is Epoch{epoch=14} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:09,779 LocalLog.java:492 - Enacted PrepareMove{nodeId=NodeId{id=2}, tokens=[25], streamData=true}. New tail is Epoch{epoch=14} DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,780 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881803571 bytes available, checking if we can write 2137 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,780 CompactionTask.java:167 - Compacting (38e72e30-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:09,780 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:09,780 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:21:09,781 LegacyStateListener.java:133 - Node /127.0.0.3:7012 state MOVING, tokens [30] INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:09,783 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 722B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,784 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,784 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,784 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),52), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1239)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,785 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881795789 bytes available, checking if we can write 2138 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,786 CompactionTask.java:167 - Compacting (38e81890-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:09,786 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(MOVING,25,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,787 Move.java:193 - Moving /127.0.0.3:7012 from [30] to [25]. DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:09,787 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:09,787 LocalLog.java:492 - Enacted PrepareMove{nodeId=NodeId{id=2}, tokens=[25], streamData=true}. New tail is Epoch{epoch=14} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:09,789 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:21:09,789 LegacyStateListener.java:133 - Node /127.0.0.3:7012 state MOVING, tokens [30] INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,809 Flushing.java:153 - Writing Memtable-local@1969454746(89B serialized bytes, 4 ops, 722B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db (41B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=86580) DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:09,813 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(MOVING,25,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:09,789 Commit.java:366 - Received commit request Commit{transformation=StartMove{id=NodeId{id=2}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}}}}, lastKnown=Epoch{epoch=14}} from /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:09,819 AbstractLocalProcessor.java:98 - Committed StartMove{id=NodeId{id=2}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}}}}. New epoch is Epoch{epoch=15} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:09,819 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=15} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:09,821 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.290KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:09,826 Flushing.java:153 - Writing Memtable-local_metadata_log@602932750(679B serialized bytes, 1 ops, 1.290KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:09,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (612B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=71131) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,842 CompactionTask.java:258 - Compacted (38e72e30-39c5-11ef-b92b-69af062a2179) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.087KiB to 1.813KiB (~86% of original) in 61ms. Read Throughput = 34.160KiB/s, Write Throughput = 29.684KiB/s, Row Throughput = ~28/s. 14 total partitions merged to 14. Partition merge counts were {1:14, }. Time spent writing keys = 31ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:09,843 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,843 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,843 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:09,845 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:09,847 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:09,849 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:09,852 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db')] (1 sstables, 5.044KiB), biggest 5.044KiB, smallest 5.044KiB DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:21:09,853 LegacyStateListener.java:133 - Node /127.0.0.3:7012 state MOVING, tokens [30] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:09,853 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 77, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,67), DC=Value(dc0,68), RACK=Value(rack0,69), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,70), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,71), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,72), TOKENS=Value(30,73), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,74), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,75), STATUS_WITH_PORT=Value(MOVING,25,76), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,855 CompactionTask.java:258 - Compacted (38e81890-39c5-11ef-bf85-f712d21df3f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.088KiB to 1.814KiB (~86% of original) in 68ms. Read Throughput = 30.529KiB/s, Write Throughput = 26.531KiB/s, Row Throughput = ~28/s. 14 total partitions merged to 14. Partition merge counts were {1:14, }. Time spent writing keys = 34ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:09,855 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,856 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,856 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:09,858 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:09,860 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:09,863 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:09,867 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.313KiB), biggest 5.313KiB, smallest 5.313KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,867 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,868 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,868 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),1846), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),260), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),832), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),52)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:09,868 LocalLog.java:492 - Enacted EXECUTED {StartMove{id=NodeId{id=2}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}}}}}. New tail is Epoch{epoch=15} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,869 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881916416 bytes available, checking if we can write 2990 bytes DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:09,869 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,869 CompactionTask.java:167 - Compacting (38f4c2c0-39c5-11ef-a069-5f0d330fc2b0) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:09,870 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} to /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:09,870 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:09,870 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=15}, logState=LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}}} to sender /127.0.0.3:7012 INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:09,872 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} from /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,872 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:09,872 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:09,872 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} from /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:09,872 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=15} DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:09,872 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:09,892 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=14}} from /127.0.0.4:7012: start = Epoch{epoch=14}, current = Epoch{epoch=15} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:09,893 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.293KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:09,893 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.288KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:09,893 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.293KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:09,897 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:09,898 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:09,904 Flushing.java:153 - Writing Memtable-local_metadata_log@491022907(679B serialized bytes, 1 ops, 1.293KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,904 Flushing.java:153 - Writing Memtable-local_metadata_log@2087122411(679B serialized bytes, 1 ops, 1.288KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:09,904 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db (612B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=88059) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,904 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (612B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=88300) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:09,914 Flushing.java:153 - Writing Memtable-local_metadata_log@865691098(679B serialized bytes, 1 ops, 1.293KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:09,914 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (612B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=91907) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,950 CompactionTask.java:258 - Compacted (38f4c2c0-39c5-11ef-a069-5f0d330fc2b0) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big,] to level=0. 2.920KiB to 2.007KiB (~68% of original) in 79ms. Read Throughput = 36.829KiB/s, Write Throughput = 25.312KiB/s, Row Throughput = ~30/s. 18 total partitions merged to 15. Partition merge counts were {1:12, 2:3, }. Time spent writing keys = 37ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,950 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,950 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:09,950 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,952 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:09,953 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.311KiB), biggest 5.311KiB, smallest 5.311KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,953 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:09,953 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.310KiB), biggest 5.310KiB, smallest 5.310KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,953 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:09,953 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:09,953 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:09,953 LocalLog.java:492 - Enacted StartMove{id=NodeId{id=2}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}}}}}. New tail is Epoch{epoch=15} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:09,953 LocalLog.java:492 - Enacted StartMove{id=NodeId{id=2}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}}}}}. New tail is Epoch{epoch=15} INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,954 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:09,955 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db')] (1 sstables, 5.313KiB), biggest 5.313KiB, smallest 5.313KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:09,955 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:09,955 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:09,955 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:09,956 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:09,955 LocalLog.java:492 - Enacted StartMove{id=NodeId{id=2}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}}}}}. New tail is Epoch{epoch=15} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:09,957 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:09,958 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:09,962 ProgressBarrier.java:538 - Received watermark response from /127.0.0.4:7012 with epoch Epoch{epoch=15} DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:09,962 ProgressBarrier.java:538 - Received watermark response from /127.0.0.2:7012 with epoch Epoch{epoch=15} DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:09,962 ProgressBarrier.java:538 - Received watermark response from /127.0.0.1:7012 with epoch Epoch{epoch=15} INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:09,963 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:43570)->/127.0.0.3:7012-URGENT_MESSAGES-33995225 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:09,963 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:43570)->/127.0.0.3:7012-URGENT_MESSAGES-486fcc11 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:09,963 ProgressBarrier.java:538 - Received watermark response from /127.0.0.3:7012 with epoch Epoch{epoch=15} INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,964 ProgressBarrier.java:237 - Collected acknowledgements from [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012] of nodes for a progress barrier for epoch Epoch{epoch=15} at EACH_QUORUM INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,964 Move.java:208 - fetching new ranges and streaming old ranges INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,970 Move.java:229 - Stream source: Full(/127.0.0.3:7012,(25,30]) destination: Full(/127.0.0.4:7012,(25,30]) DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,971 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,972 Move.java:229 - Stream source: Full(/127.0.0.3:7012,(25,30]) destination: Full(/127.0.0.2:7012,(25,30]) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:09,972 ColumnFamilyStore.java:1060 - Enqueuing flush of system_distributed.repair_history, Reason: STREAMING, Usage: 8.111KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,976 Flushing.java:153 - Writing Memtable-repair_history@2003696744(1.570KiB serialized bytes, 8 ops, 8.111KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:09,977 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db (617B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=88300) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:10,028 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db')] (1 sstables, 6.178KiB), biggest 6.178KiB, smallest 6.178KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:10,028 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:10,029 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,029 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,029 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,029 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,029 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,029 Move.java:229 - Stream source: Full(/127.0.0.3:7012,(25,30]) destination: Full(/127.0.0.1:7012,(25,30]) DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,029 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,030 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,030 Move.java:229 - Stream source: Full(/127.0.0.3:7012,(25,30]) destination: Full(/127.0.0.1:7012,(25,30]) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,030 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: STREAMING, Usage: 8.027KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:10,043 Flushing.java:153 - Writing Memtable-x@1339665425(580B serialized bytes, 20 ops, 8.027KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:10,044 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db (237B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=88300) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:10,098 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db')] (1 sstables, 5.273KiB), biggest 5.273KiB, smallest 5.273KiB DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,099 CassandraStreamManager.java:129 - ViewFilter for 2/3 sstables INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,109 Move.java:229 - Stream source: Full(/127.0.0.3:7012,(25,30]) destination: Transient(/127.0.0.2:7012,(25,30]) DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,110 CassandraStreamManager.java:129 - ViewFilter for 2/3 sstables INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,111 StreamResultFuture.java:98 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Executing streaming plan for Relocation INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,111 StreamSession.java:396 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Starting streaming to 127.0.0.1:7012 DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,111 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,115 StreamingMultiplexedChannel.java:473 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: e1aa4267] Scheduling keep-alive task with 300s period. DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,115 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:40002 channel.id e1aa4267 INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:10,116 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:40002)->/127.0.0.1:7012-STREAMING-b4a6fe62 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,117 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,118 StreamCoordinator.java:268 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179, ID#0] Beginning stream session with /127.0.0.1:7012 INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,118 StreamSession.java:396 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Starting streaming to 127.0.0.2:7012 DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,118 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:10,122 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:51972)->/127.0.0.2:7012-STREAMING-cff3ee28 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,122 StreamingMultiplexedChannel.java:473 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: ba3722ab] Scheduling keep-alive task with 300s period. DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,122 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:51972 channel.id ba3722ab INFO [node2_Stream-Deserializer-/127.0.0.3:7012-cff3ee28] node2 2024-07-04 05:21:10,123 StreamResultFuture.java:123 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 ID#0] Creating new streaming plan for Relocation from /127.0.0.3:7012 channel.remote /127.0.0.1:51972 channel.local /127.0.0.2:7012 channel.id cff3ee28 INFO [node2_Stream-Deserializer-/127.0.0.3:7012-cff3ee28] node2 2024-07-04 05:21:10,124 StreamResultFuture.java:131 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179, ID#0] Received streaming plan for Relocation from /127.0.0.3:7012 channel.remote /127.0.0.1:51972 channel.local /127.0.0.2:7012 channel.id cff3ee28 DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cff3ee28] node2 2024-07-04 05:21:10,124 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: cff3ee28] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 390368c0-39c5-11ef-b92b-69af062a2179, session index = 0 INFO [node1_Stream-Deserializer-/127.0.0.3:7012-b4a6fe62] node1 2024-07-04 05:21:10,125 StreamResultFuture.java:123 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 ID#0] Creating new streaming plan for Relocation from /127.0.0.3:7012 channel.remote /127.0.0.1:40002 channel.local /127.0.0.1:7012 channel.id b4a6fe62 DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,125 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,127 StreamCoordinator.java:268 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,127 StreamSession.java:389 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Session does not have any tasks. DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,127 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,127 StreamResultFuture.java:201 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.4:7012 is complete DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cff3ee28] node2 2024-07-04 05:21:10,127 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: cff3ee28] Received Prepare SYN (0 requests, 1 files} DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cff3ee28] node2 2024-07-04 05:21:10,127 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,128 StreamSession.java:564 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Will close attached inbound {} and outbound {} channels INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,128 StreamCoordinator.java:268 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179, ID#0] Beginning stream session with /127.0.0.4:7012 INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:10,130 StreamResultFuture.java:187 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 1 files(197B), sending 0 files(0B) DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,131 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: ba3722ab] Received Prepare SYNACK ( 0 files} INFO [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,131 StreamResultFuture.java:187 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 0 files(0B), sending 1 files(197B) DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,131 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,131 StreamingMultiplexedChannel.java:220 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #0, repairedAt: 0, pendingRepair: null, sendByFollower: false), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db}} DEBUG [node3_NettyStreaming-Outbound-/127.0.0.2.7012:1] node3 2024-07-04 05:21:10,133 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.2:7012 as initiator DEBUG [node3_NettyStreaming-Outbound-/127.0.0.2.7012:1] node3 2024-07-04 05:21:10,135 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:51986 channel.id 4a111428 INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:10,136 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:51986)->/127.0.0.2:7012-STREAMING-741ab09b streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted INFO [node1_Stream-Deserializer-/127.0.0.3:7012-b4a6fe62] node1 2024-07-04 05:21:10,136 StreamResultFuture.java:131 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179, ID#0] Received streaming plan for Relocation from /127.0.0.3:7012 channel.remote /127.0.0.1:40002 channel.local /127.0.0.1:7012 channel.id b4a6fe62 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b4a6fe62] node1 2024-07-04 05:21:10,137 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: b4a6fe62] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 390368c0-39c5-11ef-b92b-69af062a2179, session index = 0 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b4a6fe62] node1 2024-07-04 05:21:10,138 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: b4a6fe62] Received Prepare SYN (0 requests, 2 files} DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b4a6fe62] node1 2024-07-04 05:21:10,138 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from INITIALIZED to PREPARING DEBUG [node3_NettyStreaming-Outbound-/127.0.0.2.7012:1] node3 2024-07-04 05:21:10,139 CassandraCompressedStreamWriter.java:62 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Start streaming file /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db to /127.0.0.2:7012, repairedAt = 0, totalSize = 197 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.2.7012:1] node3 2024-07-04 05:21:10,139 CassandraCompressedStreamWriter.java:80 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Writing section 0 with length 197 to stream. DEBUG [node3_NettyStreaming-Outbound-/127.0.0.2.7012:1] node3 2024-07-04 05:21:10,142 CassandraCompressedStreamWriter.java:101 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db to /127.0.0.2:7012, bytesTransferred = 197B, totalSize = 197B INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:10,143 StreamResultFuture.java:187 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 2 files(303B), sending 0 files(0B) DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-741ab09b] node2 2024-07-04 05:21:10,146 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-741ab09b] node2 2024-07-04 05:21:10,148 CassandraCompressedStreamReader.java:68 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Start receiving file #0 from /127.0.0.3:7012, repairedAt = 0, size = 197, ks = 'tr', pendingRepair = 'null', table = 'x'. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,152 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: e1aa4267] Received Prepare SYNACK ( 0 files} INFO [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,152 StreamResultFuture.java:187 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 ID#0] Prepare completed. Receiving 0 files(0B), sending 2 files(303B) DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,152 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,152 StreamingMultiplexedChannel.java:220 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #0, repairedAt: 0, pendingRepair: null, sendByFollower: false), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db}} DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,153 StreamingMultiplexedChannel.java:220 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #1, repairedAt: 1720070456212, pendingRepair: null, sendByFollower: false), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db}} DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:10,153 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:10,155 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:40014 channel.id 7188e3e5 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:10,155 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:10,156 CassandraCompressedStreamWriter.java:62 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Start streaming file /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db to /127.0.0.1:7012, repairedAt = 0, totalSize = 197 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:10,156 CassandraCompressedStreamWriter.java:80 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Writing section 0 with length 197 to stream. INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:10,156 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:40014)->/127.0.0.1:7012-STREAMING-2344ddba streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:10,156 CassandraCompressedStreamWriter.java:101 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db to /127.0.0.1:7012, bytesTransferred = 197B, totalSize = 197B INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:10,158 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:40030)->/127.0.0.1:7012-STREAMING-663cc0a3 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:10,158 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:40030 channel.id 26f2a74a DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:10,160 CassandraCompressedStreamWriter.java:62 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Start streaming file /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db to /127.0.0.1:7012, repairedAt = 1720070456212, totalSize = 106 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:10,160 CassandraCompressedStreamWriter.java:80 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Writing section 0 with length 106 to stream. DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:10,161 CassandraCompressedStreamWriter.java:101 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db to /127.0.0.1:7012, bytesTransferred = 106B, totalSize = 106B DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2344ddba] node1 2024-07-04 05:21:10,161 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-663cc0a3] node1 2024-07-04 05:21:10,161 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-663cc0a3] node1 2024-07-04 05:21:10,163 CassandraCompressedStreamReader.java:68 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Start receiving file #1 from /127.0.0.3:7012, repairedAt = 1720070456212, size = 106, ks = 'tr', pendingRepair = 'null', table = 'x'. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2344ddba] node1 2024-07-04 05:21:10,163 CassandraCompressedStreamReader.java:68 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Start receiving file #0 from /127.0.0.3:7012, repairedAt = 0, size = 197, ks = 'tr', pendingRepair = 'null', table = 'x'. INFO [node2_Stream-Deserializer-/127.0.0.3:7012-741ab09b] node2 2024-07-04 05:21:10,164 CassandraCompressedStreamReader.java:107 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Finished receiving file #0 from /127.0.0.3:7012 readBytes = 197B, totalSize = 197B DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-741ab09b] node2 2024-07-04 05:21:10,164 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: 741ab09b] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #0, repairedAt: 0, pendingRepair: null, sendByFollower: false), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-741ab09b] node2 2024-07-04 05:21:10,165 StreamReceiveTask.java:87 - received 1 of 1 total files, 197 of total bytes 197 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,165 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: ba3722ab] Received Received (1b255f4d-ef25-40a6-0000-00000000000c, #0) DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,166 StreamTransferTask.java:93 - received sequenceNumber 0, remaining files [] DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,166 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from STREAMING to WAIT_COMPLETE INFO [node1_Stream-Deserializer-/127.0.0.3:7012-2344ddba] node1 2024-07-04 05:21:10,175 CassandraCompressedStreamReader.java:107 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Finished receiving file #0 from /127.0.0.3:7012 readBytes = 197B, totalSize = 197B DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2344ddba] node1 2024-07-04 05:21:10,175 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: 2344ddba] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #0, repairedAt: 0, pendingRepair: null, sendByFollower: false), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2344ddba] node1 2024-07-04 05:21:10,177 StreamReceiveTask.java:87 - received 1 of 2 total files, 197 of total bytes 197 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,177 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: e1aa4267] Received Received (1b255f4d-ef25-40a6-0000-00000000000c, #0) DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,177 StreamTransferTask.java:93 - received sequenceNumber 0, remaining files [1] INFO [node1_Stream-Deserializer-/127.0.0.3:7012-663cc0a3] node1 2024-07-04 05:21:10,181 CassandraCompressedStreamReader.java:107 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Finished receiving file #1 from /127.0.0.3:7012 readBytes = 106B, totalSize = 106B DEBUG [node2_StreamReceiveTask:1] node2 2024-07-04 05:21:10,190 CassandraStreamReceiver.java:257 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Received 1 sstables from /127.0.0.3:7012 ([BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db')]) DEBUG [node2_StreamReceiveTask:1] node2 2024-07-04 05:21:10,191 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,193 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: ba3722ab] Received Complete DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:10,193 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from COMPLETE to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,193 StreamSession.java:1128 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] handling Complete message, state = WAIT_COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:10,193 StreamResultFuture.java:201 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.3:7012 is complete DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,193 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,193 StreamResultFuture.java:201 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.2:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:10,193 StreamResultFuture.java:260 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] All sessions completed DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,193 StreamSession.java:564 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Will close attached inbound {ba3722ab=org.apache.cassandra.streaming.async.NettyStreamingChannel@145884a0} and outbound {ba3722ab=org.apache.cassandra.streaming.async.NettyStreamingChannel@145884a0, 4a111428=org.apache.cassandra.streaming.async.NettyStreamingChannel@7c7a0497} channels DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,193 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-ba3722ab] node3 2024-07-04 05:21:10,193 StreamSession.java:712 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-741ab09b] node2 2024-07-04 05:21:10,194 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-741ab09b] node2 2024-07-04 05:21:10,194 StreamSession.java:712 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-663cc0a3] node1 2024-07-04 05:21:10,195 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: 663cc0a3] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #1, repairedAt: 1720070456212, pendingRepair: null, sendByFollower: false), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,195 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: e1aa4267] Received Received (1b255f4d-ef25-40a6-0000-00000000000c, #1) DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,195 StreamTransferTask.java:93 - received sequenceNumber 1, remaining files [] DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,195 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-663cc0a3] node1 2024-07-04 05:21:10,195 StreamReceiveTask.java:87 - received 2 of 2 total files, 303 of total bytes 106 DEBUG [Streaming-EventLoop-4-2] node3 2024-07-04 05:21:10,196 StreamingMultiplexedChannel.java:514 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:10,197 StreamingMultiplexedChannel.java:514 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cff3ee28] node2 2024-07-04 05:21:10,197 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-cff3ee28] node2 2024-07-04 05:21:10,197 StreamSession.java:712 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [node1_StreamReceiveTask:1] node1 2024-07-04 05:21:10,254 CassandraStreamReceiver.java:257 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Received 2 sstables from /127.0.0.3:7012 ([BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db')]) DEBUG [node1_StreamReceiveTask:1] node1 2024-07-04 05:21:10,255 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,256 StreamDeserializingTask.java:132 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179 channel: e1aa4267] Received Complete DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,256 StreamSession.java:1128 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] handling Complete message, state = WAIT_COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,256 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,256 StreamResultFuture.java:201 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.1:7012 is complete DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:10,256 StreamSession.java:596 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Changing session state from COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,256 StreamResultFuture.java:260 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] All sessions completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:10,256 StreamResultFuture.java:201 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Session with /127.0.0.3:7012 is complete DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:10,257 StreamSession.java:564 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Will close attached inbound {e1aa4267=org.apache.cassandra.streaming.async.NettyStreamingChannel@32c42bb} and outbound {e1aa4267=org.apache.cassandra.streaming.async.NettyStreamingChannel@32c42bb, 7188e3e5=org.apache.cassandra.streaming.async.NettyStreamingChannel@57cde06c, 26f2a74a=org.apache.cassandra.streaming.async.NettyStreamingChannel@34a18e7f} channels DEBUG [Streaming-EventLoop-4-1] node3 2024-07-04 05:21:10,257 StreamingMultiplexedChannel.java:514 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,257 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-e1aa4267] node3 2024-07-04 05:21:10,257 StreamSession.java:712 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,258 StorageService.java:3291 - skipping paxos repair for move. skip_paxos_repair_on_topology_change is set INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:10,258 StreamResultFuture.java:260 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] All sessions completed DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:10,262 StreamingMultiplexedChannel.java:514 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Closing stream connection channels on /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,264 Commit.java:366 - Received commit request Commit{transformation=MidMove{id=NodeId{id=2}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}}}}, lastKnown=Epoch{epoch=15}} from /127.0.0.3:7012 DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,265 TestProcessor.java:76 - Test processor is paused, waiting... DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b4a6fe62] node1 2024-07-04 05:21:10,269 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2344ddba] node1 2024-07-04 05:21:10,269 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2344ddba] node1 2024-07-04 05:21:10,269 StreamSession.java:712 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b4a6fe62] node1 2024-07-04 05:21:10,269 StreamSession.java:712 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-663cc0a3] node1 2024-07-04 05:21:10,270 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-663cc0a3] node1 2024-07-04 05:21:10,270 StreamSession.java:712 - [Stream #390368c0-39c5-11ef-b92b-69af062a2179] Socket closed after session completed with state COMPLETE DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,282 TestChangeListener.java:82 - Requesting pause before enacting Epoch{epoch=16} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,285 TestProcessor.java:82 - Resumed test processor... INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,295 AbstractLocalProcessor.java:98 - Committed MidMove{id=NodeId{id=2}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}}}}. New epoch is Epoch{epoch=16} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,295 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=16} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:10,296 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.388KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:10,304 Flushing.java:153 - Writing Memtable-local_metadata_log@702313466(779B serialized bytes, 1 ops, 1.388KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:10,305 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=75816) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:10,361 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.334KiB), biggest 5.334KiB, smallest 5.334KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,365 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,365 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:10,365 TestChangeListener.java:58 - Epoch matches pre-commit predicate, pausing DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:10,365 TestChangeListener.java:109 - Log follower is paused, waiting... DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:10,445 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:10,446 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:10,446 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,489 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,490 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,490 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,493 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,494 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,494 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,494 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,494 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,495 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,496 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,497 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,497 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,497 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,497 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,497 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,497 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,497 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,498 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,498 CompactionManager.java:441 - Starting Cleanup for system_auth.roles DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,498 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db') ([cassandra, cassandra]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,498 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,498 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,498 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,498 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,499 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,499 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,500 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,501 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,501 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,501 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,30], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,501 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,501 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,501 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db') ([3030f4b039c511ef94623bb8c7522e1d, 31013d0039c511efb980e34c7a70c3a6]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,30], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,30], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,502 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,503 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,503 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,503 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,503 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db') ([trx, trx]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,503 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,30], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,503 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,503 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,504 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,504 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,505 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,505 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,505 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (25,30], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,505 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,505 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,505 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,506 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,506 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (25,30], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,506 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,506 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,506 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,507 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,507 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,508 CompactionManager.java:441 - Starting Cleanup for tr.x DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,508 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') ([26, 30]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,508 CompactionManager.java:681 - Skipping cleanup for 1/4 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (25,30], (,10], (30,40]], transient ranges: [(20,25]]) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,514 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db') INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,537 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db. 63B to 63B (~100% of original) for 5 keys. Time: 23ms. INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:10,537 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-6-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,537 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,559 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db. 107B to 107B (~100% of original) for 10 keys. Time: 22ms. INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,560 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db') INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:10,561 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:10,653 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-9-big-Data.db. 200B to 200B (~100% of original) for 20 keys. Time: 93ms. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,653 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,653 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:10,654 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,684 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,685 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,685 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,687 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,687 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,687 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,687 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,687 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,688 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,688 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,688 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,688 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,688 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,689 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,689 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,689 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,689 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,690 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,690 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,690 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,690 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,690 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,690 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,690 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,691 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,692 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,693 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,693 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,694 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,694 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,694 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (25,30], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (25,30], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,695 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (25,30], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (25,30], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,696 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,697 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,697 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,697 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,697 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,698 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,698 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,698 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,701 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,701 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,701 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,701 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,701 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,701 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,702 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,702 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,703 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,703 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,703 CompactionManager.java:681 - Skipping cleanup for 0/3 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: [(25,30], (30,40]]) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:10,706 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:10,727 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db. 45B to 45B (~100% of original) for 3 keys. Time: 22ms. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:10,728 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:10,729 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-5-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:10,749 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 21ms. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:10,751 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db') INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:10,751 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:10,822 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db. 200B to 200B (~100% of original) for 20 keys. Time: 72ms. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,823 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:10,823 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:10,833 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,848 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,849 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,849 StorageService.java:2564 - Starting Cleanup on system_auth.[] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,850 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,851 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,851 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,851 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,851 StorageService.java:2564 - Starting Cleanup on system_distributed.[] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,852 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,852 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,852 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,852 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,852 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,853 StorageService.java:2564 - Starting Cleanup on system_traces.[] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,853 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,853 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,853 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,853 StorageService.java:2564 - Starting Cleanup on tr.[] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,854 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:10,854 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,892 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,893 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,893 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,896 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,896 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,896 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,897 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,897 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,897 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,897 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,897 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,897 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,898 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,898 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,898 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,898 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,898 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,898 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,899 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,899 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,899 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,899 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,899 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,899 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,900 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,901 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,901 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,901 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,901 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,901 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,901 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,903 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,904 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,904 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,904 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,904 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,904 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,904 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,905 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,906 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,908 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(20,25], (25,30], (10,20], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,909 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(20,25], (25,30], (10,20], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,910 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,910 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,910 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,910 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,910 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(20,25], (25,30], (10,20], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,910 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,911 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,911 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,911 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,911 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(20,25], (25,30], (10,20], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,911 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,911 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,911 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,912 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,912 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,912 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,912 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(20,25], (25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,912 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,913 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,913 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,913 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,913 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(20,25], (25,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,913 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,913 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,913 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,914 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,914 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,915 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,915 CompactionManager.java:681 - Skipping cleanup for 0/2 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(20,25], (25,30], (30,40]], transient ranges: [(10,20]]) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:10,918 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db') INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:10,961 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db. 107B to 107B (~100% of original) for 10 keys. Time: 44ms. INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:10,962 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:10,966 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-2-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:10,985 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 23ms. INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,986 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:10,986 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:10,988 TestChangeListener.java:116 - Unpausing log follower DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:10,989 TestChangeListener.java:111 - Resumed log follower... INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:10,989 LocalLog.java:492 - Enacted EXECUTED {MidMove{id=NodeId{id=2}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}}}}}. New tail is Epoch{epoch=16} INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:10,990 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-4-big DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:10,991 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,991 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} to /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,991 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:10,992 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=16}, logState=LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}}} to sender /127.0.0.3:7012 INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:10,994 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:10,994 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:10,996 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:10,997 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.391KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:10,996 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:11,000 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,001 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.386KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,007 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.391KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,011 Flushing.java:153 - Writing Memtable-local_metadata_log@564169950(779B serialized bytes, 1 ops, 1.386KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,011 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=89086) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:11,012 Flushing.java:153 - Writing Memtable-local_metadata_log@66917635(779B serialized bytes, 1 ops, 1.391KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:11,012 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=89682) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:11,014 Flushing.java:153 - Writing Memtable-local_metadata_log@2026457516(779B serialized bytes, 1 ops, 1.391KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:11,014 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=93675) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:11,099 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,099 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,099 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,099 LocalLog.java:492 - Enacted MidMove{id=NodeId{id=2}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}}}}. New tail is Epoch{epoch=16} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,101 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_OptionalTasks:1] node4 2024-07-04 05:21:11,103 PeerLogFetcher.java:91 - Fetching log from /127.0.0.3:7012, at least Epoch{epoch=16} INFO [node2_OptionalTasks:1] node2 2024-07-04 05:21:11,104 PeerLogFetcher.java:91 - Fetching log from /127.0.0.3:7012, at least Epoch{epoch=16} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:11,104 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db')] (1 sstables, 5.335KiB), biggest 5.335KiB, smallest 5.335KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,104 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,105 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:11,104 ProgressBarrier.java:538 - Received watermark response from /127.0.0.1:7012 with epoch Epoch{epoch=16} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,105 LocalLog.java:492 - Enacted MidMove{id=NodeId{id=2}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}}}}. New tail is Epoch{epoch=16} INFO [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:11,105 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=15}} from /127.0.0.4:7012: start = Epoch{epoch=15}, current = Epoch{epoch=16} DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:11,106 ProgressBarrier.java:538 - Received watermark response from /127.0.0.3:7012 with epoch Epoch{epoch=16} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,106 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:11,108 ProgressBarrier.java:538 - Received watermark response from /127.0.0.2:7012 with epoch Epoch{epoch=16} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:11,109 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.340KiB), biggest 5.340KiB, smallest 5.340KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,109 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,109 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,109 LocalLog.java:492 - Enacted MidMove{id=NodeId{id=2}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Transient(/127.0.0.1:7012,(25,30])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30])]}}, writes=Delta{removals={}, additions={}}}}}}. New tail is Epoch{epoch=16} DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,110 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),1831), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),259), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),52), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),288)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,111 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,111 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881107046 bytes available, checking if we can write 2430 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,111 CompactionTask.java:167 - Compacting (39b24660-39c5-11ef-b980-e34c7a70c3a6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, ] DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:11,111 ProgressBarrier.java:538 - Received watermark response from /127.0.0.4:7012 with epoch Epoch{epoch=16} INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,112 ProgressBarrier.java:237 - Collected acknowledgements from [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012] of nodes for a progress barrier for epoch Epoch{epoch=16} at EACH_QUORUM INFO [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:11,112 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:11,112 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=15}} from /127.0.0.2:7012: start = Epoch{epoch=15}, current = Epoch{epoch=16} INFO [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:11,115 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:11,115 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,116 LocalLog.java:523 - An already appended entry Epoch{epoch=16} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=16} INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,118 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 696B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:11,123 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,123 LocalLog.java:523 - An already appended entry Epoch{epoch=16} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=16} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,124 Flushing.java:153 - Writing Memtable-local@1780673708(63B serialized bytes, 1 ops, 696B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,125 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=89163) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:11,148 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,151 CompactionTask.java:258 - Compacted (39b24660-39c5-11ef-b980-e34c7a70c3a6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big,] to level=0. 2.373KiB to 2.122KiB (~89% of original) in 39ms. Read Throughput = 60.239KiB/s, Write Throughput = 53.868KiB/s, Row Throughput = ~32/s. 16 total partitions merged to 16. Partition merge counts were {1:16, }. Time spent writing keys = 13ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,152 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,152 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:11,152 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:11,152 Commit.java:366 - Received commit request Commit{transformation=FinishMove{id=NodeId{id=2}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}}}}, lastKnown=Epoch{epoch=16}} from /127.0.0.3:7012 INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:11,154 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:11,157 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:11,159 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:11,161 AbstractLocalProcessor.java:98 - Committed FinishMove{id=NodeId{id=2}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}}}}. New epoch is Epoch{epoch=17} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:11,162 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=17} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:11,165 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.873KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:11,172 Flushing.java:153 - Writing Memtable-local_metadata_log@10695640(2.246KiB serialized bytes, 1 ops, 2.873KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:11,172 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db (2.181KiB) for commitlog position CommitLogPosition(segmentId=1720070462106, position=85963) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:11,187 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db')] (1 sstables, 5.572KiB), biggest 5.572KiB, smallest 5.572KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,187 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,188 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:11,188 LocalLog.java:492 - Enacted EXECUTED {FinishMove{id=NodeId{id=2}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}}}}}. New tail is Epoch{epoch=17} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:11,190 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},MOVE)] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:11,190 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} to /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:11,191 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(25,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,25,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:11,191 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:11,192 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=17}, logState=LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}}} to sender /127.0.0.3:7012 INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:11,194 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:11,194 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:11,195 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:11,195 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,196 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,199 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.876KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,215 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.876KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,215 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.871KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:11,229 Flushing.java:153 - Writing Memtable-local_metadata_log@1034542682(2.246KiB serialized bytes, 1 ops, 2.876KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:11,230 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (2.181KiB) for commitlog position CommitLogPosition(segmentId=1720070443576, position=95982) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:11,240 Flushing.java:153 - Writing Memtable-local_metadata_log@174204299(2.246KiB serialized bytes, 1 ops, 2.876KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,239 Flushing.java:153 - Writing Memtable-local_metadata_log@1916064572(2.246KiB serialized bytes, 1 ops, 2.871KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:11,240 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (2.181KiB) for commitlog position CommitLogPosition(segmentId=1720070443560, position=93023) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,240 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (2.181KiB) for commitlog position CommitLogPosition(segmentId=1720070443540, position=91470) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:11,315 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:11,315 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.519KiB), biggest 5.519KiB, smallest 5.519KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:11,315 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.540KiB), biggest 5.540KiB, smallest 5.540KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),1858), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),470), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),257), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),284)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,315 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),1857), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),492), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),256), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),283)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,316 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617880986419 bytes available, checking if we can write 2869 bytes INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,315 LocalLog.java:492 - Enacted FinishMove{id=NodeId{id=2}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}}}}. New tail is Epoch{epoch=17} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,315 LocalLog.java:492 - Enacted FinishMove{id=NodeId{id=2}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}}}}. New tail is Epoch{epoch=17} INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,316 CompactionTask.java:167 - Compacting (39d18e30-39c5-11ef-bf85-f712d21df3f6) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,316 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617880982528 bytes available, checking if we can write 2888 bytes INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,315 LocalLog.java:492 - Enacted FinishMove{id=NodeId{id=2}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,30]), Full(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30]), Full(/127.0.0.3:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(25,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,30]), Transient(/127.0.0.2:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.2:7012=[Transient(/127.0.0.2:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,30]), Full(/127.0.0.1:7012,(30,40])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(25,30])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,30]), Full(/127.0.0.4:7012,(30,40])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(25,40])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(25,40])]}}}}}}. New tail is Epoch{epoch=17} INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,317 CompactionTask.java:167 - Compacting (39d18e30-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,318 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},MOVE)] DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,318 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},MOVE)] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,318 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},MOVE)] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:11,319 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,67), DC=Value(dc0,68), RACK=Value(rack0,69), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,70), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,72), TOKENS=Value(25,73), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,74), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,75), STATUS_WITH_PORT=Value(NORMAL,25,76), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:11,319 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 0, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,67), DC=Value(dc0,68), RACK=Value(rack0,69), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,70), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,72), TOKENS=Value(25,73), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,74), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,75), STATUS_WITH_PORT=Value(NORMAL,25,76), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:11,322 Commit.java:366 - Received commit request Commit{transformation=PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}, lastKnown=Epoch{epoch=17}} from /127.0.0.3:7012 INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:11,323 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 562B (0%) on-heap, 0B (0%) off-heap INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:11,325 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:11,329 AbstractLocalProcessor.java:98 - Committed PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New epoch is Epoch{epoch=18} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:11,329 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=18} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:11,330 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 796B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,332 Flushing.java:153 - Writing Memtable-local@1888440399(53B serialized bytes, 1 ops, 562B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,332 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=91552) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:11,336 Flushing.java:153 - Writing Memtable-local_metadata_log@674882298(154B serialized bytes, 1 ops, 796B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:11,337 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070462106, position=87594) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:11,367 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,368 CompactionTask.java:258 - Compacted (39d18e30-39c5-11ef-b92b-69af062a2179) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big,] to level=0. 2.820KiB to 2.453KiB (~86% of original) in 49ms. Read Throughput = 56.901KiB/s, Write Throughput = 49.493KiB/s, Row Throughput = ~34/s. 17 total partitions merged to 17. Partition merge counts were {1:17, }. Time spent writing keys = 16ms INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,368 CompactionTask.java:258 - Compacted (39d18e30-39c5-11ef-bf85-f712d21df3f6) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big,] to level=0. 2.802KiB to 2.420KiB (~86% of original) in 49ms. Read Throughput = 56.134KiB/s, Write Throughput = 48.484KiB/s, Row Throughput = ~34/s. 17 total partitions merged to 17. Partition merge counts were {1:17, }. Time spent writing keys = 16ms DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,368 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,368 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,368 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:11,368 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,369 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617880881357 bytes available, checking if we can write 331 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,369 CompactionTask.java:167 - Compacting (39d9a480-39c5-11ef-b92b-69af062a2179) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, ] INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:11,369 SecondaryIndexManager.java:947 - Executing pre-join post-bootstrap tasks for: CFS(Keyspace='tr', ColumnFamily='x') INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:11,370 LegacyStateListener.java:108 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,370 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:11,370 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big WARN 05:21:11 Using stored Gossip Generation 1720070472 as it is greater than current system time 1720070471. See CASSANDRA-3654 if you experience problems WARN [node3_OptionalTasks:1] node3 2024-07-04 05:21:11,371 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070472 as it is greater than current system time 1720070471. See CASSANDRA-3654 if you experience problems DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:11,372 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db')] (1 sstables, 5.149KiB), biggest 5.149KiB, smallest 5.149KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,372 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,372 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:11,372 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,372 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:11,372 LocalLog.java:492 - Enacted EXECUTED {PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}}. New tail is Epoch{epoch=18} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,373 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db'),92), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db'),282), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db'),526), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db'),2055)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:11,373 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 562B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:11,373 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:11,373 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} to /127.0.0.2:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:11,373 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:11,373 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=18}, logState=LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}}} to sender /127.0.0.3:7012 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,373 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881025331 bytes available, checking if we can write 2955 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,374 CompactionTask.java:167 - Compacting (39da67d0-39c5-11ef-a069-5f0d330fc2b0) [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db:level=0, ] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,374 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:11,375 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:11,375 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:11,375 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:11,376 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:11,377 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,377 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,378 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,379 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,379 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,380 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 794B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,380 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 799B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,381 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 799B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,393 Flushing.java:153 - Writing Memtable-local@1433203964(53B serialized bytes, 1 ops, 562B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,393 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=92480) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:11,403 Flushing.java:153 - Writing Memtable-local_metadata_log@1163104183(154B serialized bytes, 1 ops, 799B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:11,403 Flushing.java:153 - Writing Memtable-local_metadata_log@150116144(154B serialized bytes, 1 ops, 799B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:11,404 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070443576, position=97683) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:11,404 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070443560, position=93690) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,430 CompactionTask.java:258 - Compacted (39da67d0-39c5-11ef-a069-5f0d330fc2b0) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big,] to level=0. 2.886KiB to 2.439KiB (~84% of original) in 55ms. Read Throughput = 52.189KiB/s, Write Throughput = 44.118KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 22ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,430 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,430 CompactionTask.java:258 - Compacted (39d9a480-39c5-11ef-b92b-69af062a2179) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big,] to level=0. 331B to 236B (~71% of original) in 59ms. Read Throughput = 5.397KiB/s, Write Throughput = 3.848KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 24ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,430 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,430 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:11,430 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,430 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,431 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:11,432 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,432 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:11,434 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,435 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:11,437 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,437 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,438 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:11,438 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:11,438 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.149KiB), biggest 5.149KiB, smallest 5.149KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,438 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,438 LocalLog.java:492 - Enacted PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New tail is Epoch{epoch=18} DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:11,439 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070448, version = 91, AppStateMap = {LOAD=Value(100042.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,81), DC=Value(dc0,82), RACK=Value(rack0,83), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,84), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,85), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,86), TOKENS=Value(25,87), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,88), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,89), STATUS_WITH_PORT=Value(NORMAL,25,90), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:11,439 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:11,440 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db')] (1 sstables, 5.149KiB), biggest 5.149KiB, smallest 5.149KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,440 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,440 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,440 LocalLog.java:492 - Enacted PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New tail is Epoch{epoch=18} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:11,441 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,445 Flushing.java:153 - Writing Memtable-local_metadata_log@676734321(154B serialized bytes, 1 ops, 794B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:11,445 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070443540, position=92828) DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:11,446 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:11,446 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:11,446 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node1_GossipStage:1] node1 2024-07-04 05:21:11,447 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:11,495 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.149KiB), biggest 5.149KiB, smallest 5.149KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,495 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,495 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,495 LocalLog.java:492 - Enacted PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New tail is Epoch{epoch=18} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:11,496 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,498 SingleNodeSequences.java:165 - Successfully moved to new token 25 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,525 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,526 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,526 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,527 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,528 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,529 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,530 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,531 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,531 CompactionManager.java:441 - Starting Cleanup for system_auth.roles DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,531 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db') ([cassandra, cassandra]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,531 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,531 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,531 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,531 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,532 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,532 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,532 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,532 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,40], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db') ([3030f4b039c511ef94623bb8c7522e1d, 31013d0039c511efb980e34c7a70c3a6]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,40], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,533 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,40], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db') ([trx, trx]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (25,40], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,534 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,535 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,535 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,535 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,535 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,535 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,535 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (25,40], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,535 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,536 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,536 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,536 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,536 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (25,40], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,536 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,536 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,536 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,537 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,537 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,537 CompactionManager.java:441 - Starting Cleanup for tr.x DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,537 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') ([26, 30]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,537 CompactionManager.java:681 - Skipping cleanup for 1/4 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (25,40], (,10]], transient ranges: [(20,25]]) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,538 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db') INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,586 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-10-big-Data.db. 63B to 63B (~100% of original) for 5 keys. Time: 48ms. INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,586 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db') INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:11,587 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-7-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,607 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-11-big-Data.db. 107B to 107B (~100% of original) for 10 keys. Time: 21ms. INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,608 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-9-big-Data.db') INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:11,609 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-8-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:11,631 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-12-big-Data.db. 200B to 200B (~100% of original) for 20 keys. Time: 23ms. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,631 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:11,632 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:11,633 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-9-big INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,649 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,649 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,649 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,650 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,650 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,650 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,650 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,650 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,650 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,650 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,651 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,652 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,653 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,654 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,654 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,654 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,654 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,654 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (25,40], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,654 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (25,40], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (25,40], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,655 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (25,40], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,656 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,656 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,656 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,656 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,656 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,657 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,658 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,658 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,658 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,658 CompactionManager.java:681 - Skipping cleanup for 0/3 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: [(25,40]]) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,659 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db') INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,678 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-9-big-Data.db. 45B to 45B (~100% of original) for 3 keys. Time: 19ms. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,678 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db') INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:11,679 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-6-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,729 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-10-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 50ms. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,730 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db') INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:11,730 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-7-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:11,784 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-11-big-Data.db. 200B to 200B (~100% of original) for 20 keys. Time: 54ms. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,784 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:11,784 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:11,785 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-8-big INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,796 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,797 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,797 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,798 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,798 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,798 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,799 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,800 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(20,25]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,801 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,802 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,802 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,802 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,802 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,802 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,802 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (,10], (10,20]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,802 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data0/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db') ([trx, trx]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (,10], (10,20]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (,10], (10,20]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,803 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (20,25], (,10], (10,20]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,804 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(20,25], (10,20]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(20,25], (10,20]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,805 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,806 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,806 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,806 CompactionManager.java:681 - Skipping cleanup for 0/3 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(20,25], (10,20]], transient ranges: [(40,], (,10]]) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,808 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,825 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db. 106B to 61B (~57% of original) for 5 keys. Time: 17ms. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,825 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db') INFO [node4_GossipStage:1] node4 2024-07-04 05:21:11,826 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node1_GossipStage:1] node1 2024-07-04 05:21:11,826 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,827 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,848 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 23ms. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,849 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,850 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:11,867 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db. 197B to 171B (~86% of original) for 17 keys. Time: 18ms. INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,867 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:11,867 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:11,869 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big INFO [node2_GossipStage:1] node2 2024-07-04 05:21:11,869 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,884 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,885 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,886 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,887 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,888 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(20,25], (25,40], (10,20]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(20,25], (25,40], (10,20]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,889 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(20,25], (25,40], (10,20]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(20,25], (25,40], (10,20]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,890 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(20,25], (25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(20,25], (25,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,891 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,892 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,892 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,892 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,892 CompactionManager.java:681 - Skipping cleanup for 0/2 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(20,25], (25,40]], transient ranges: [(10,20]]) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,893 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,943 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db. 107B to 107B (~100% of original) for 10 keys. Time: 50ms. INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,943 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db') INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:11,945 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-5-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:11,982 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 39ms. INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,982 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:11,983 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:11,984 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests4439668254666235180/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-6-big INFO [main] <main> 2024-07-04 05:21:12,077 AbstractCluster.java:1090 - Closing cluster b5ecc9ef-c122-43ba-98d3-269cd1bf9853 INFO [node2_isolatedExecutor:4] node2 2024-07-04 05:21:12,081 Gossiper.java:1808 - Announcing shutdown INFO [node3_isolatedExecutor:4] node3 2024-07-04 05:21:12,081 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:21:12,082 Gossiper.java:1808 - Announcing shutdown INFO [node4_isolatedExecutor:4] node4 2024-07-04 05:21:12,082 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:21:12,082 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node3_isolatedExecutor:4] node3 2024-07-04 05:21:12,082 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node2_isolatedExecutor:4] node2 2024-07-04 05:21:12,082 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown INFO [node4_isolatedExecutor:4] node4 2024-07-04 05:21:12,082 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,083 Gossiper.java:1154 - InetAddress /127.0.0.4:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:21:12,083 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:21:12,083 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:12,083 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:12,083 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:12,084 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node4_GossipStage:1] node4 2024-07-04 05:21:12,084 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:21:12,084 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.3:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:12,084 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,084 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.4:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:12,084 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:12,084 Gossiper.java:576 - Marked /127.0.0.3:7012 as shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,084 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,084 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.3:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:12,084 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,084 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,084 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:12,084 Gossiper.java:576 - Marked /127.0.0.3:7012 as shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,084 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:12,084 FailureDetector.java:389 - Forcing conviction of /127.0.0.4:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 Gossiper.java:576 - Marked /127.0.0.4:7012 as shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 Gossiper.java:1154 - InetAddress /127.0.0.4:7012 is now DOWN INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.4:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 FailureDetector.java:389 - Forcing conviction of /127.0.0.4:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:12,085 Gossiper.java:576 - Marked /127.0.0.4:7012 as shutdown DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:12,085 Gossiper.java:576 - Marked /127.0.0.3:7012 as shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,085 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,086 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:12,086 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,086 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,086 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:12,086 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,086 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:12,086 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:12,086 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:12,086 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:12,087 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:36446)->/127.0.0.2:7012-URGENT_MESSAGES-83e9c4d9 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:12,087 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:36446)->/127.0.0.2:7012-URGENT_MESSAGES-bb8eb7ed successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,087 Gossiper.java:1154 - InetAddress /127.0.0.4:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,087 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.4:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:12,088 FailureDetector.java:389 - Forcing conviction of /127.0.0.4:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:12,088 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:12,088 Gossiper.java:576 - Marked /127.0.0.4:7012 as shutdown DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:12,448 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:12,448 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:12,448 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:12,451 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:36706)->/127.0.0.4:7012-URGENT_MESSAGES-de540e45 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:12,451 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:36706)->/127.0.0.4:7012-URGENT_MESSAGES-98bbae6c successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_GossipStage:1] node4 2024-07-04 05:21:12,457 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:12,828 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:36462)->/127.0.0.2:7012-URGENT_MESSAGES-6897ea65 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:12,828 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:36462)->/127.0.0.2:7012-URGENT_MESSAGES-573badf6 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:12,829 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:34196)->/127.0.0.1:7012-URGENT_MESSAGES-242304ea successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:12,829 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:34196)->/127.0.0.1:7012-URGENT_MESSAGES-7ef847ae messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:12,834 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:54626)->/127.0.0.3:7012-URGENT_MESSAGES-0c8b2abb messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:12,834 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:54626)->/127.0.0.3:7012-URGENT_MESSAGES-06b9fd8e successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:12,835 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:54632)->/127.0.0.3:7012-URGENT_MESSAGES-52ec6696 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:12,835 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:54632)->/127.0.0.3:7012-URGENT_MESSAGES-f4afc915 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:12,873 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:34208)->/127.0.0.1:7012-URGENT_MESSAGES-d48358c4 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:12,873 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:34208)->/127.0.0.1:7012-URGENT_MESSAGES-6dbf774e successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:12,876 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:36714)->/127.0.0.4:7012-URGENT_MESSAGES-f857887d messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:12,876 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:36714)->/127.0.0.4:7012-URGENT_MESSAGES-f34df355 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:12,880 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:36474)->/127.0.0.2:7012-URGENT_MESSAGES-ed161f2e messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:12,880 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:36474)->/127.0.0.2:7012-URGENT_MESSAGES-2d7aa08b successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_isolatedExecutor:4] node3 2024-07-04 05:21:14,086 HintsService.java:234 - Paused hints dispatch INFO [node2_isolatedExecutor:4] node2 2024-07-04 05:21:14,087 HintsService.java:234 - Paused hints dispatch INFO [node4_isolatedExecutor:4] node4 2024-07-04 05:21:14,092 HintsService.java:234 - Paused hints dispatch INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:21:14,092 HintsService.java:234 - Paused hints dispatch DEBUG [node3_isolatedExecutor:10] node3 2024-07-04 05:21:14,102 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node3_isolatedExecutor:10] node3 2024-07-04 05:21:14,102 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node2_isolatedExecutor:10] node2 2024-07-04 05:21:14,102 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node2_isolatedExecutor:10] node2 2024-07-04 05:21:14,103 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node4_isolatedExecutor:6] node4 2024-07-04 05:21:14,114 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node4_isolatedExecutor:6] node4 2024-07-04 05:21:14,115 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node1_isolatedExecutor:4] node1 2024-07-04 05:21:14,139 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:21:14,139 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node3_COMMIT-LOG-WRITER] node3 2024-07-04 05:21:16,137 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_COMMIT-LOG-WRITER] node2 2024-07-04 05:21:16,137 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_COMMIT-LOG-WRITER] node4 2024-07-04 05:21:16,139 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:16,151 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. Node id topology: node 1: dc = dc0, rack = rack0 node 2: dc = dc0, rack = rack0 node 3: dc = dc0, rack = rack0 node 4: dc = dc0, rack = rack0 Configured node count: 4, nodeIdTopology size: 4 DEBUG [main] node1 2024-07-04 05:21:16,577 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-07-04 05:21:16,580 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-07-04 05:21:16,581 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node1 2024-07-04 05:21:16,581 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-07-04 05:21:16,581 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node1 2024-07-04 05:21:16,582 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-07-04 05:21:16,582 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node1 2024-07-04 05:21:16,582 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node1 2024-07-04 05:21:16,582 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-07-04 05:21:16,583 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-07-04 05:21:16,584 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-07-04 05:21:16,584 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node1 2024-07-04 05:21:16,584 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node1 2024-07-04 05:21:16,584 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-07-04 05:21:16,584 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-07-04 05:21:16,585 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node1 2024-07-04 05:21:16,585 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-07-04 05:21:16,585 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-07-04 05:21:16,586 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node2 2024-07-04 05:21:16,828 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node2 2024-07-04 05:21:16,832 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node2 2024-07-04 05:21:16,833 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node2 2024-07-04 05:21:16,833 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node2 2024-07-04 05:21:16,834 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node2 2024-07-04 05:21:16,834 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node2 2024-07-04 05:21:16,834 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node2 2024-07-04 05:21:16,835 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node2 2024-07-04 05:21:16,835 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node2 2024-07-04 05:21:16,836 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node2 2024-07-04 05:21:16,836 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node2 2024-07-04 05:21:16,836 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node2 2024-07-04 05:21:16,837 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node2 2024-07-04 05:21:16,837 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node2 2024-07-04 05:21:16,837 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node2 2024-07-04 05:21:16,838 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node2 2024-07-04 05:21:16,838 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node2 2024-07-04 05:21:16,839 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node2 2024-07-04 05:21:16,839 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node3 2024-07-04 05:21:17,136 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node3 2024-07-04 05:21:17,139 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node3 2024-07-04 05:21:17,140 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node3 2024-07-04 05:21:17,140 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node3 2024-07-04 05:21:17,140 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node3 2024-07-04 05:21:17,140 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node3 2024-07-04 05:21:17,141 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node3 2024-07-04 05:21:17,141 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node3 2024-07-04 05:21:17,141 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node3 2024-07-04 05:21:17,142 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node3 2024-07-04 05:21:17,142 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node3 2024-07-04 05:21:17,142 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node3 2024-07-04 05:21:17,142 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node3 2024-07-04 05:21:17,142 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node3 2024-07-04 05:21:17,143 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node3 2024-07-04 05:21:17,143 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node3 2024-07-04 05:21:17,143 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node3 2024-07-04 05:21:17,144 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node3 2024-07-04 05:21:17,144 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node4 2024-07-04 05:21:17,333 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node4 2024-07-04 05:21:17,336 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node4 2024-07-04 05:21:17,336 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node4 2024-07-04 05:21:17,337 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node4 2024-07-04 05:21:17,337 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node4 2024-07-04 05:21:17,337 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node4 2024-07-04 05:21:17,337 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node4 2024-07-04 05:21:17,338 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node4 2024-07-04 05:21:17,338 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node4 2024-07-04 05:21:17,338 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node4 2024-07-04 05:21:17,339 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node4 2024-07-04 05:21:17,339 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node4 2024-07-04 05:21:17,339 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node4 2024-07-04 05:21:17,339 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node4 2024-07-04 05:21:17,339 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node4 2024-07-04 05:21:17,340 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node4 2024-07-04 05:21:17,340 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node4 2024-07-04 05:21:17,340 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node4 2024-07-04 05:21:17,340 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,422 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,423 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,423 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,423 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,423 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,423 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,426 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,427 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,480 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,487 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,507 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,507 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,507 CassandraDaemon.java:613 - Heap size: 752.000MiB/1.000GiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,507 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,507 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 247577288(241774K) committed = 248512512(242688K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,507 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 32209920(31455K) committed = 32243712(31488K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,507 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 32478840(31717K) committed = 32899072(32128K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,508 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 166896056(162984K) committed = 268435456(262144K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,508 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 375304192(366508K) committed = 654311424(638976K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,508 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 16777216(16384K) committed = 16777216(16384K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,508 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 8727808(8523K) committed = 8781824(8576K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,508 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,508 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,520 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,521 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node1_ScheduledTasks:1] node1 2024-07-04 05:21:17,580 StorageService.java:294 - Overriding RING_DELAY to 15000ms WARN 05:21:17 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,689 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:17 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,693 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:17 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,693 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,703 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,703 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,708 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,711 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,711 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,711 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,712 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,717 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,720 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,720 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,720 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,720 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,721 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,721 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,721 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,721 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,722 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,722 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,722 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,722 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,722 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,722 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:21:17 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,723 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:17 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,723 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,724 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,727 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,730 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,730 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,730 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,730 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,731 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/hints DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,839 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:17,839 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,006 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,008 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,079 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,085 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,091 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node1_SecondaryIndexManagement:1] node1 2024-07-04 05:21:18,098 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,102 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,106 ColumnFamilyStore.java:508 - Initializing system.local INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,109 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,113 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,117 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,120 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,124 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,127 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,130 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,134 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,137 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,140 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,143 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,146 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,149 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,152 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,155 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,160 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,163 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,167 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,170 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,170 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,171 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,173 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,191 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,267 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,271 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,285 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,288 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,291 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,293 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,296 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,298 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,300 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,303 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,305 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,309 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,309 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,310 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,310 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,317 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,317 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,317 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,318 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,318 Startup.java:97 - Initializing as first CMS node in a new cluster DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,364 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,364 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,364 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,364 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,368 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6413232568390994545325.so DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,370 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,370 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,371 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,372 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,372 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,374 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,378 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,388 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,391 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,391 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,439 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,442 StorageService.java:494 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,444 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,453 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,453 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,453 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,458 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,458 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,463 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,464 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,464 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:18,491 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,496 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.577KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,559 Flushing.java:153 - Writing Memtable-columns@1929138830(735B serialized bytes, 4 ops, 3.577KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,561 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,654 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,661 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,662 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,662 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,670 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_3e1a0d50-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,688 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,688 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,690 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.007KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,696 Flushing.java:153 - Writing Memtable-tables@1038120321(868B serialized bytes, 1 ops, 3.007KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,697 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,743 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_3e370b30-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,745 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,745 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,746 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 790B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,758 Flushing.java:153 - Writing Memtable-keyspaces@415980889(151B serialized bytes, 1 ops, 790B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,759 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,799 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_3e3f6fa0-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,810 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,810 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,824 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:18,829 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=1} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:18,843 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 754B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,858 Flushing.java:153 - Writing Memtable-local_metadata_log@188184955(110B serialized bytes, 1 ops, 754B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:18,859 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (41B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=1686) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,893 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_3e4e3cb0-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,895 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:18,896 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.084KiB), biggest 5.084KiB, smallest 5.084KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:18,896 LocalLog.java:492 - Enacted PreInitialize{addr=/127.0.0.1:7012}. New tail is Epoch{epoch=1} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:18,905 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,085 AbstractLocalProcessor.java:98 - Committed Initialize{baseState = Epoch{epoch=1}}. New epoch is Epoch{epoch=2} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,085 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=2} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,090 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.038KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,105 Flushing.java:153 - Writing Memtable-local_metadata_log@1991922722(1.409KiB serialized bytes, 1 ops, 2.038KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,106 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070477531, position=8779) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,147 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_3e73ed20-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,149 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,150 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,153 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,165 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,170 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,181 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,185 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,189 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,193 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,197 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,201 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,202 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,202 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,206 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,206 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,207 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,210 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,214 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,219 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,223 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,273 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.690KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,291 Flushing.java:153 - Writing Memtable-columns@1212705545(11.795KiB serialized bytes, 68 ops, 54.690KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,295 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070477531, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,339 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_3e8fd990-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,346 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,347 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,347 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.350KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,352 Flushing.java:153 - Writing Memtable-tables@179029708(11.222KiB serialized bytes, 14 ops, 36.350KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,353 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070477531, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,373 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_3e9b2430-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,376 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,376 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,376 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.290KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,381 Flushing.java:153 - Writing Memtable-keyspaces@988256835(471B serialized bytes, 3 ops, 2.290KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,381 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,402 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_3e9fb810-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,404 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,404 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,404 LocalLog.java:492 - Enacted EXECUTED {Initialize{baseState = Epoch{epoch=1}}}. New tail is Epoch{epoch=2} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:19,409 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,413 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.1:7012), nic: lo, encryption: unencrypted DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,434 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,435 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,441 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,445 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,446 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,463 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,464 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,464 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,474 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,474 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,474 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,487 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,487 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,487 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,487 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,488 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,550 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,584 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,584 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,585 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,588 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,589 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,589 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,592 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,592 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,592 StorageService.java:704 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,592 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,595 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,715 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.116KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,720 Flushing.java:153 - Writing Memtable-local@509137529(462B serialized bytes, 4 ops, 2.116KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:19,721 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (216B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=66061) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,744 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_3ed34b30-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,747 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:19,747 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.882KiB), biggest 5.882KiB, smallest 5.882KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,747 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,750 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,750 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.1:7012 because it is not a member in token metadata INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:19,751 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,052 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,353 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,653 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,653 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,692 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=3} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,693 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=3} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:21,694 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,705 Flushing.java:153 - Writing Memtable-local_metadata_log@365159064(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,706 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=67241) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,763 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_40016af0-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,766 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,766 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:21,766 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=3} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:21,768 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,768 Register.java:122 - Registering with endpoint /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,770 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,777 Flushing.java:153 - Writing Memtable-local@1091226442(89B serialized bytes, 2 ops, 694B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,778 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=67407) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,800 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_400d03b0-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,803 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,803 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 5.042KiB), biggest 5.042KiB, smallest 5.042KiB DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:21:21,804 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.1:7012 because it is not a member in token metadata INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,805 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000001, (Note: This should happen exactly once per node) DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:21,813 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,813 BootStrapper.java:256 - tokens manually specified as [10] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,850 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=4} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,852 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=4} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:21,858 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,874 Flushing.java:153 - Writing Memtable-local_metadata_log@1203332266(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,875 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=68373) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,910 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_401a4a20-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,914 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,914 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:21,914 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=4} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:21,916 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:21,930 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 571B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,938 Flushing.java:153 - Writing Memtable-local@531283262(58B serialized bytes, 1 ops, 571B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:21,939 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=68456) INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:21,944 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 700B (0%) on-heap, 0B (0%) off-heap INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:21,990 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_402546a0-39c5-11ef-9520-1f8a75ee0971.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:22,005 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:22,005 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:22,006 Startup.java:400 - NORMAL DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:22,014 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:22,015 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,021 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,023 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:22,023 Flushing.java:153 - Writing Memtable-local@368532337(63B serialized bytes, 1 ops, 700B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:22,024 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=68533) DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,024 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),41), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:22,026 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,031 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881706291 bytes available, checking if we can write 919 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,031 CompactionTask.java:167 - Compacting (4033eca0-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:22,032 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:22,038 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:22,047 SnapshotManager.java:125 - Adding snapshots: . DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:22,053 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB WARN 05:21:22 Using stored Gossip Generation 1720070482 as it is greater than current system time 1720070482. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:22,058 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070482 as it is greater than current system time 1720070482. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:22,059 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:22,068 Flushing.java:153 - Writing Memtable-local@36737566(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:22,069 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=68615) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,099 CompactionTask.java:258 - Compacted (4033eca0-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big,] to level=0. 919B to 867B (~94% of original) in 59ms. Read Throughput = 15.023KiB/s, Write Throughput = 14.173KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 32ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,102 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,103 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617881437798 bytes available, checking if we can write 295 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,103 CompactionTask.java:167 - Compacting (403f1030-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,105 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,107 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,108 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,109 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,109 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,109 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,109 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,109 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,111 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,112 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,112 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,112 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,112 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,113 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,113 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,113 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,115 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,115 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,122 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,125 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,126 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,127 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,127 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,127 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,127 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,130 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,130 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:22,141 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB WARN 05:21:22 Using stored Gossip Generation 1720070483 as it is greater than current system time 1720070482. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:22,149 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070483 as it is greater than current system time 1720070482. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:22,150 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,161 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:22,164 Flushing.java:153 - Writing Memtable-local@236989126(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:22,165 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=69727) INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,168 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,170 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,171 CompactionTask.java:258 - Compacted (403f1030-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big,] to level=0. 295B to 224B (~75% of original) in 63ms. Read Throughput = 4.540KiB/s, Write Throughput = 3.447KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 17ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,173 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:22,173 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,174 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,172 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,179 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,179 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:22,181 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,184 SSLFactory.java:264 - Initializing hot reloading SSLContext DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,186 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,195 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,195 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,195 CassandraDaemon.java:613 - Heap size: 752.000MiB/1.000GiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 282285560(275669K) committed = 283246592(276608K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 35401088(34571K) committed = 35454976(34624K) max = 122912768(120032K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 36870920(36006K) committed = 37289984(36416K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 251658240(245760K) committed = 369098752(360448K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 375304192(366508K) committed = 654311424(638976K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 16777216(16384K) committed = 16777216(16384K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,196 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 9497600(9275K) committed = 9502720(9280K) max = 122916864(120036K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,197 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,197 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,205 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,205 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,205 CassandraDaemon.java:613 - Heap size: 752.000MiB/1.000GiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,205 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,205 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 282844840(276215K) committed = 283836416(277184K) max = -1(-1K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 35430784(34600K) committed = 35454976(34624K) max = 122912768(120032K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 36944256(36078K) committed = 37421056(36544K) max = 1073741824(1048576K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 251658240(245760K) committed = 369098752(360448K) max = -1(-1K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 375304192(366508K) committed = 654311424(638976K) max = 1073741824(1048576K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 16777216(16384K) committed = 16777216(16384K) max = -1(-1K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 9499904(9277K) committed = 9502720(9280K) max = 122916864(120036K) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,206 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,206 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,206 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,206 CassandraDaemon.java:613 - Heap size: 752.000MiB/1.000GiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 282890328(276260K) committed = 283836416(277184K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 35434240(34603K) committed = 35454976(34624K) max = 122912768(120032K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 36948080(36082K) committed = 37421056(36544K) max = 1073741824(1048576K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 251658240(245760K) committed = 369098752(360448K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 375304192(366508K) committed = 654311424(638976K) max = 1073741824(1048576K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 16777216(16384K) committed = 16777216(16384K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 9503616(9280K) committed = 9568256(9344K) max = 122916864(120036K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,207 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,208 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,210 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,211 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,216 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,217 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,221 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,222 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:22,230 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:22,231 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_ScheduledTasks:1] node3 2024-07-04 05:21:22,268 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node2_ScheduledTasks:1] node2 2024-07-04 05:21:22,279 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node4_ScheduledTasks:1] node4 2024-07-04 05:21:22,283 StorageService.java:294 - Overriding RING_DELAY to 15000ms WARN 05:21:22 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,384 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:22 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,389 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:22 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,390 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN 05:21:22 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,391 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:22 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:22 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,395 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,395 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:22 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,396 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN 05:21:22 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,400 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:22 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,401 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,402 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,403 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,406 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,406 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,408 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,411 FileUtil.java:74 - Reading file /proc/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,411 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,411 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,412 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,412 FileUtil.java:74 - Reading file /proc/version DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,413 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,414 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,414 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,414 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,414 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,414 FileUtil.java:74 - Reading file /proc/version DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,417 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,419 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,419 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,421 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,421 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,421 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,421 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,422 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,422 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,422 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,422 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,422 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,423 FileUtil.java:74 - Reading file /proc/version DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,423 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,423 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,423 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,423 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,423 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,424 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,424 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,424 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,424 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,424 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,424 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,424 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,424 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,425 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,425 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,425 FileUtil.java:74 - Reading file /proc/self/stat WARN 05:21:22 Cassandra server running in degraded mode. Swap should be disabled. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,425 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:22 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,425 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,426 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,426 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,426 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,426 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,426 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,427 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,427 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,427 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2. WARN 05:21:22 Cassandra server running in degraded mode. Swap should be disabled. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,427 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:22 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,427 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,429 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data2. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,429 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,429 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,430 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,430 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,430 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,430 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,430 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,431 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,431 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,431 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,431 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,432 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,432 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,432 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,432 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,432 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0 WARN 05:21:22 Cassandra server running in degraded mode. Swap should be disabled. WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,432 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:22 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,433 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,434 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,434 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data1 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,434 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,435 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/commitlog DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,435 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/saved_caches DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,435 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/hints DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,436 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,436 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data2 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,436 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/commitlog DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,436 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/saved_caches DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,436 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/hints DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,437 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,440 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data1 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,440 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,440 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/commitlog DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,440 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/saved_caches DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,440 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/hints DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,569 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,569 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,569 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,569 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,619 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,619 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,825 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,829 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,835 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,841 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,856 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,860 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,937 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,943 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,946 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,946 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,950 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,952 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,952 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,958 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,959 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node2_SecondaryIndexManagement:1] node2 2024-07-04 05:21:22,961 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,965 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node4_SecondaryIndexManagement:1] node4 2024-07-04 05:21:22,967 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node3_SecondaryIndexManagement:1] node3 2024-07-04 05:21:22,968 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,970 ColumnFamilyStore.java:508 - Initializing system.local INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,970 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,972 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,974 ColumnFamilyStore.java:508 - Initializing system.local INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,975 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,977 ColumnFamilyStore.java:508 - Initializing system.local INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,978 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,981 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,982 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,982 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,985 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,986 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,987 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,989 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,990 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,992 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,993 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:22,996 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:22,996 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:22,997 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,000 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,001 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,003 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,004 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,005 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,007 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,008 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,011 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,011 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,013 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,015 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,015 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,018 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,019 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,020 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,022 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,023 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,025 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,026 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,028 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,029 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,030 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,033 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,033 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,035 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,037 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,037 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,039 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,041 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,041 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,043 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,046 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,046 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,048 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,050 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,050 ColumnFamilyStore.java:508 - Initializing system.built_views DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,050 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,051 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,055 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,055 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,059 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,060 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,060 ColumnFamilyStore.java:508 - Initializing system.repairs DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,061 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,061 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,064 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,065 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,068 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,069 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,069 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,074 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,081 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,091 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,100 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,210 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,215 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,220 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,228 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,230 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,234 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,235 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,240 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,240 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,246 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,248 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,250 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,251 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,252 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,255 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,256 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,257 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,259 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,261 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,264 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,262 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,266 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,268 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,268 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,270 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,272 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,275 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,275 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,275 CassandraDaemon.java:514 - opening keyspace system DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,276 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,276 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,280 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,283 ColumnFamilyStore.java:508 - Initializing system_schema.views DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,285 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,285 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,286 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,286 Startup.java:108 - Initializing for discovery INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,287 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,288 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,289 CassandraDaemon.java:514 - opening keyspace system DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,290 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,291 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,292 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,296 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,298 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,299 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,300 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,300 Startup.java:108 - Initializing for discovery INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,300 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,307 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,308 CassandraDaemon.java:514 - opening keyspace system DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,309 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,309 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,318 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,318 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,319 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,320 Startup.java:108 - Initializing for discovery DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,362 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,362 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,362 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,362 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,366 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_643775141476763971656.so DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,369 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,369 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,370 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,371 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,371 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,374 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,376 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,377 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,377 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,377 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,379 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,382 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6413441948215607867562.so DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,385 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,385 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,386 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,387 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,387 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,389 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,389 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,389 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,390 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,391 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,393 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,395 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_648985987688808991393.so DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,397 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node4_Messaging-EventLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,398 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,398 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,398 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,398 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,399 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,400 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,400 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,404 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,410 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,415 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,419 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node2_Messaging-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,420 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,426 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,430 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node3_Messaging-EventLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,430 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,470 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,474 StorageService.java:494 - Initializing storage service mbean INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,475 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,488 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,488 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,488 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,522 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,523 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,524 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,527 StorageService.java:494 - Initializing storage service mbean INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,529 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,530 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,529 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,530 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,530 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,532 StorageService.java:494 - Initializing storage service mbean INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,534 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,542 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,543 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,543 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,543 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,543 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,544 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,549 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,549 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,549 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,549 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node4_COMMIT-LOG-WRITER] node4 2024-07-04 05:21:23,554 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,554 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,555 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,555 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,556 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,557 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,557 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,558 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.576KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_COMMIT-LOG-WRITER] node2 2024-07-04 05:21:23,581 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,586 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.576KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_COMMIT-LOG-WRITER] node3 2024-07-04 05:21:23,590 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,595 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.578KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:23,615 Flushing.java:153 - Writing Memtable-columns@884377814(735B serialized bytes, 4 ops, 3.576KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:23,620 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=1479) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:23,638 Flushing.java:153 - Writing Memtable-columns@1203166229(735B serialized bytes, 4 ops, 3.576KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:23,641 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=1479) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:23,659 Flushing.java:153 - Writing Memtable-columns@1009178732(735B serialized bytes, 4 ops, 3.578KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:23,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=1479) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,697 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,701 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,702 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,703 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,720 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,726 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,726 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,727 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,727 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_411e9ac0-39c5-11ef-a91a-654b51ec069b.log INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,740 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,746 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,747 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_4122e080-39c5-11ef-be06-a3f8887dcaed.log INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,747 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,747 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,748 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,748 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,750 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.006KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:23,763 Flushing.java:153 - Writing Memtable-tables@275484428(868B serialized bytes, 1 ops, 3.006KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:23,764 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=1479) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,764 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,764 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,766 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.006KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,779 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_41244010-39c5-11ef-99a4-a939d1f9f39c.log INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:23,779 Flushing.java:153 - Writing Memtable-tables@1762261533(868B serialized bytes, 1 ops, 3.006KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:23,780 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=1479) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,795 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,796 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,797 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.008KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,802 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_413d6d60-39c5-11ef-be06-a3f8887dcaed.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:23,802 Flushing.java:153 - Writing Memtable-tables@713245257(868B serialized bytes, 1 ops, 3.008KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:23,803 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=1479) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,804 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,804 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,804 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 789B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:23,808 Flushing.java:153 - Writing Memtable-keyspaces@146817988(151B serialized bytes, 1 ops, 789B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:23,809 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=1479) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,819 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_413afc60-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,822 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,822 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,822 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 789B (0%) on-heap, 0B (0%) off-heap INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,825 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_41422850-39c5-11ef-99a4-a939d1f9f39c.log INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:23,827 Flushing.java:153 - Writing Memtable-keyspaces@1417387396(151B serialized bytes, 1 ops, 789B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:23,827 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=1479) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,829 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,829 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,829 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 791B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,833 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_414360d0-39c5-11ef-be06-a3f8887dcaed.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:23,833 Flushing.java:153 - Writing Memtable-keyspaces@1089006817(151B serialized bytes, 1 ops, 791B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:23,834 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=1479) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,843 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:23,843 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,860 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,866 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.2:7012), nic: null, encryption: unencrypted DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,880 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,880 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,883 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,886 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,886 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,887 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_41461ff0-39c5-11ef-a91a-654b51ec069b.log DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,898 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:23,898 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,898 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,899 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,899 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,899 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,905 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,905 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,905 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,914 Startup.java:205 - Discovering other nodes in the system DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,915 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,915 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_41470a50-39c5-11ef-99a4-a939d1f9f39c.log INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:23,916 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@64576b8c) to /127.0.0.1:7012 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,917 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.4:7012), nic: null, encryption: unencrypted DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,920 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:23,920 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,935 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,935 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,938 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,940 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,943 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,944 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,944 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.3:7012), nic: null, encryption: unencrypted DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,960 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,960 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,960 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,960 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,960 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,960 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,961 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,961 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,961 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,961 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,961 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,961 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,962 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,962 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,962 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@621fa697 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,962 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,963 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,964 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,964 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,964 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,965 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:23,965 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,967 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,968 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,969 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,969 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,969 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,969 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,969 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@fa15e1d DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,971 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,972 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,980 Startup.java:205 - Discovering other nodes in the system DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,980 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:23,981 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@5d67aaf2) to /127.0.0.1:7012 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,986 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,986 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,986 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,986 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,986 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,988 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,988 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,988 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,988 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,988 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,988 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,988 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,989 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,989 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,989 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,989 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,989 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,997 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,997 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:23,997 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:23,999 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:57782)->/127.0.0.1:7012-URGENT_MESSAGES-a65eab30 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:24,001 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:57782)->/127.0.0.1:7012-URGENT_MESSAGES-beac3dea successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:24,005 Discovery.java:182 - Responding to discovery request from /127.0.0.2:7012: [/127.0.0.1:7012] DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:24,007 Startup.java:205 - Discovering other nodes in the system DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:24,008 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:24,009 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@243dc176) to /127.0.0.1:7012 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,031 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,031 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,032 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@6e7e14c7 INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:24,033 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:56520)->/127.0.0.2:7012-URGENT_MESSAGES-7ae947ca successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,034 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,034 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,034 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,034 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,034 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:24,036 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:57788)->/127.0.0.1:7012-URGENT_MESSAGES-b17760a2 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:24,037 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:56520)->/127.0.0.2:7012-URGENT_MESSAGES-206fc8be messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:24,040 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:24,052 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:57788)->/127.0.0.1:7012-URGENT_MESSAGES-9e835819 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:24,054 Discovery.java:182 - Responding to discovery request from /127.0.0.4:7012: [/127.0.0.1:7012] DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,057 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,057 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,058 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@2284c8d1 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,061 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,061 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,061 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,061 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,061 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:24,064 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:57792)->/127.0.0.1:7012-URGENT_MESSAGES-3913f44c messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:24,065 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:49370)->/127.0.0.4:7012-URGENT_MESSAGES-f02d631a successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:24,075 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:49370)->/127.0.0.4:7012-URGENT_MESSAGES-afcc8f16 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:24,075 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:24,083 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:24,094 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:57792)->/127.0.0.1:7012-URGENT_MESSAGES-170b3c31 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:24,096 Discovery.java:182 - Responding to discovery request from /127.0.0.3:7012: [/127.0.0.1:7012] INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:24,102 FetchCMSLog.java:119 - Responding to /127.0.0.4:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:24,102 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:24,102 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,107 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 746B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,114 Flushing.java:153 - Writing Memtable-local_metadata_log@1667172456(103B serialized bytes, 1 ops, 746B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,115 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=1679) INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:24,124 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:39976)->/127.0.0.3:7012-URGENT_MESSAGES-547dc469 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:24,124 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:24,125 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,128 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 746B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,130 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_417175b0-39c5-11ef-be06-a3f8887dcaed.log INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,132 Flushing.java:153 - Writing Memtable-local_metadata_log@1630480293(103B serialized bytes, 1 ops, 746B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,133 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=1679) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,134 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,134 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,134 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,134 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:24,135 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:39976)->/127.0.0.3:7012-URGENT_MESSAGES-26277ad6 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:24,139 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,151 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_4174aa00-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,153 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,153 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,154 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,154 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:24,156 FetchCMSLog.java:119 - Responding to /127.0.0.3:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,161 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.037KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,167 Flushing.java:153 - Writing Memtable-local_metadata_log@1933010167(1.409KiB serialized bytes, 1 ops, 2.037KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,168 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070482232, position=3129) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,172 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.037KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,177 Flushing.java:153 - Writing Memtable-local_metadata_log@314219988(1.409KiB serialized bytes, 1 ops, 2.037KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,178 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070482227, position=3129) INFO [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:24,178 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:24,178 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,182 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 748B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,191 Flushing.java:153 - Writing Memtable-local_metadata_log@236648286(103B serialized bytes, 1 ops, 748B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,192 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=1679) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,198 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_417b87d0-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,203 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,203 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,209 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,214 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,219 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,227 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,231 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,237 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,238 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_417ce760-39c5-11ef-99a4-a939d1f9f39c.log INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,242 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,247 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,249 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,249 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,249 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_4179b310-39c5-11ef-be06-a3f8887dcaed.log INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,249 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,250 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,256 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,257 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,257 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,258 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,258 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,261 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,262 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,262 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,266 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,269 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,272 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,273 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.039KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,279 Flushing.java:153 - Writing Memtable-local_metadata_log@899808569(1.409KiB serialized bytes, 1 ops, 2.039KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,279 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,280 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070482224, position=3129) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,281 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,285 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,286 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,291 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,296 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,301 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,303 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_418aca10-39c5-11ef-99a4-a939d1f9f39c.log INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,306 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,306 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,306 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,310 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,314 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,315 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,315 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,316 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,318 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,319 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,319 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,319 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,323 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,328 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,331 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,331 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.688KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,334 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,336 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,339 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,340 Flushing.java:153 - Writing Memtable-columns@1592091488(11.795KiB serialized bytes, 68 ops, 54.688KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,340 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,344 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,347 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070482227, position=16149) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,348 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,353 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,359 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,360 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,360 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,364 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,365 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,365 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,369 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,373 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,379 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,383 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.688KiB (1%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,397 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_4193cac0-39c5-11ef-a91a-654b51ec069b.log INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,402 Flushing.java:153 - Writing Memtable-columns@1439211934(11.795KiB serialized bytes, 68 ops, 54.688KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,410 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070482232, position=16149) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,413 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,414 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,414 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.347KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,432 Flushing.java:153 - Writing Memtable-tables@1450852997(11.222KiB serialized bytes, 14 ops, 36.347KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,433 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.693KiB (1%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,434 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070482227, position=16149) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,437 Flushing.java:153 - Writing Memtable-columns@92299470(11.795KiB serialized bytes, 68 ops, 54.693KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,447 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070482224, position=16149) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,456 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_419ccb70-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,459 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,460 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,462 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.347KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,463 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_41a074f0-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,466 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,466 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,466 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.287KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,468 Flushing.java:153 - Writing Memtable-tables@1595676288(11.222KiB serialized bytes, 14 ops, 36.347KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,528 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_41a33410-39c5-11ef-99a4-a939d1f9f39c.log INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,530 Flushing.java:153 - Writing Memtable-keyspaces@1324373472(471B serialized bytes, 3 ops, 2.287KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,531 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=16149) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,531 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070482232, position=16149) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,532 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,532 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,533 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.353KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,538 Flushing.java:153 - Writing Memtable-tables@42474363(11.222KiB serialized bytes, 14 ops, 36.353KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,541 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070482224, position=16149) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,580 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_41a86430-39c5-11ef-a91a-654b51ec069b.log INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,592 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_41a7a0e0-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,593 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,593 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,595 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,598 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,598 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,598 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,601 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.287KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,617 Flushing.java:153 - Writing Memtable-keyspaces@1151027523(471B serialized bytes, 3 ops, 2.287KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,617 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=16149) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,619 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,634 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_41b27650-39c5-11ef-99a4-a939d1f9f39c.log INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,636 Flushing.java:153 - Writing Memtable-local_metadata_log@140649943(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,636 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=16414) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,645 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,645 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,645 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.293KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,652 Flushing.java:153 - Writing Memtable-keyspaces@1534180467(471B serialized bytes, 3 ops, 2.293KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,653 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=16149) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,666 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_41bcd690-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,669 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,669 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,670 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,678 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,682 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,691 Flushing.java:153 - Writing Memtable-local_metadata_log@205757947(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,691 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=16414) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,692 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_41bf95b0-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,695 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,695 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,695 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,696 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,697 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_41c3b460-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,699 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,699 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,701 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:24,712 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,713 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:21:24,713 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,716 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,721 Flushing.java:153 - Writing Memtable-local_metadata_log@1627638289(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,721 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=16414) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,727 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_41c9cee0-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,729 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,729 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,730 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,730 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,731 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,735 Flushing.java:153 - Writing Memtable-local_metadata_log@2112469464(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:24,736 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=16535) DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:24,740 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:21:24,741 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,742 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_41ce62c0-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,747 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,747 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,748 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,749 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,764 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:24,776 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:21:24,778 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,784 Flushing.java:153 - Writing Memtable-local_metadata_log@479660476(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:24,785 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=16535) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,786 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,797 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_41d085a0-39c5-11ef-a91a-654b51ec069b.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,798 Flushing.java:153 - Writing Memtable-local_metadata_log@1728270575(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:24,798 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=16535) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,818 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:24,818 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,819 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:24,820 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:24,823 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,838 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_41d5b5c0-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,841 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:24,842 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,842 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:24,845 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,845 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_41d91120-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:24,846 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,847 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:24,848 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,849 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:24,852 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:24,854 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,825 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,825 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,825 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,825 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,826 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,848 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,848 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,848 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,848 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,849 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,855 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,855 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,856 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,856 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,857 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,871 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,897 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,904 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,906 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,906 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,908 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,908 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,910 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,910 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,910 StorageService.java:704 - CQL version: 3.4.8 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,910 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,913 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,920 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:25,930 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,946 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,954 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,955 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,956 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,956 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,958 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,958 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,959 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,960 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,960 StorageService.java:704 - CQL version: 3.4.8 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,960 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,963 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,965 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,965 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,967 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,967 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,969 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,969 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,969 StorageService.java:704 - CQL version: 3.4.8 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,969 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:25,983 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:25,993 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:26,018 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:26,024 Flushing.java:153 - Writing Memtable-local@2030285450(462B serialized bytes, 4 ops, 2.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:26,025 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=61213) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:26,040 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_42953530-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:26,042 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:26,042 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.884KiB), biggest 5.884KiB, smallest 5.884KiB DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:26,042 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:26,043 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:26,044 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:26,044 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:26,048 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:26,048 Gossiper.java:511 - Convicting /127.0.0.1:7012 with status NORMAL - alive true INFO [node4_GossipStage:1] node4 2024-07-04 05:21:26,048 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:21:26,048 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:26,049 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:26,050 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node4_GossipStage:1] node4 2024-07-04 05:21:26,051 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node4_GossipStage:1] node4 2024-07-04 05:21:26,053 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:26,056 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:57802)->/127.0.0.1:7012-URGENT_MESSAGES-225efb30 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:26,056 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:57802)->/127.0.0.1:7012-URGENT_MESSAGES-b1a83fee successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:26,061 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:26,061 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:21:26,064 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,065 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,065 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,065 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,066 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:26,066 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:26,087 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.117KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:26,093 Flushing.java:153 - Writing Memtable-local@621993143(462B serialized bytes, 4 ops, 2.117KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:26,093 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=61213) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:26,099 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:26,108 Flushing.java:153 - Writing Memtable-local@595637432(462B serialized bytes, 4 ops, 2.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:26,109 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=61213) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:26,136 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_429fbc80-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:26,141 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:26,141 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.884KiB), biggest 5.884KiB, smallest 5.884KiB DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:26,141 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:26,142 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:26,142 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:26,143 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:26,146 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,148 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,149 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,149 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:26,150 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:57808)->/127.0.0.1:7012-URGENT_MESSAGES-21a05208 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:26,150 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:57808)->/127.0.0.1:7012-URGENT_MESSAGES-b0b529e1 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:26,158 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,158 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:26,158 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,158 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,158 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,158 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,158 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,159 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:26,159 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:26,165 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_42a19140-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:26,176 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:26,176 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.884KiB), biggest 5.884KiB, smallest 5.884KiB DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:26,176 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:26,177 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:26,178 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:26,178 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:26,182 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:26,183 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node2_GossipStage:1] node2 2024-07-04 05:21:26,184 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:26,185 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:26,186 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:57810)->/127.0.0.1:7012-URGENT_MESSAGES-cfdf23c8 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:26,186 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:57810)->/127.0.0.1:7012-URGENT_MESSAGES-1ae063aa messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:26,191 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:26,192 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:26,192 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:21:26,192 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,192 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,192 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,192 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:26,193 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:26,193 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP WARN 05:21:26 Not marking nodes down due to local pause of 8666744741ns > 5000000000ns WARN [node1_GossipTasks:1] node1 2024-07-04 05:21:26,762 FailureDetector.java:355 - Not marking nodes down due to local pause of 8666744741ns > 5000000000ns DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:26,763 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:26,763 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,770 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,774 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,774 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,774 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,775 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,777 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,777 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,777 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:26,778 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:56524)->/127.0.0.2:7012-URGENT_MESSAGES-e3006469 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:26,778 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:56524)->/127.0.0.2:7012-URGENT_MESSAGES-aaf2e771 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:26,781 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:49378)->/127.0.0.4:7012-URGENT_MESSAGES-ce24af29 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:26,782 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:49378)->/127.0.0.4:7012-URGENT_MESSAGES-76af5bff messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:26,790 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:39982)->/127.0.0.3:7012-URGENT_MESSAGES-93dc242e successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:26,791 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:39982)->/127.0.0.3:7012-URGENT_MESSAGES-d4acf399 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:26,792 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:39986)->/127.0.0.3:7012-URGENT_MESSAGES-11a4dccb messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:26,792 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:39986)->/127.0.0.3:7012-URGENT_MESSAGES-b28971e1 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,793 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,793 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:26,794 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:26,795 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP INFO [node2_GossipStage:1] node2 2024-07-04 05:21:27,150 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,151 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,151 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,151 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata INFO [node2_GossipStage:1] node2 2024-07-04 05:21:27,151 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,154 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,154 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,155 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,155 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:27,155 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:27,158 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:49390)->/127.0.0.4:7012-URGENT_MESSAGES-0413dc10 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:27,158 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:49390)->/127.0.0.4:7012-URGENT_MESSAGES-e1141226 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:27,165 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:56526)->/127.0.0.2:7012-URGENT_MESSAGES-55791777 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:27,165 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:56526)->/127.0.0.2:7012-URGENT_MESSAGES-19b3e11c messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:27,166 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:27,167 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:27,349 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:27,458 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:27,492 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:27,650 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:27,759 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:27,764 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:27,764 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:27,764 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:27,793 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:27,950 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:27,951 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:27,983 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=4}} from /127.0.0.4:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:27,988 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=5} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:27,988 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=5} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:27,989 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,003 Flushing.java:153 - Writing Memtable-local_metadata_log@1151935857(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,003 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=71828) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:28,044 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,044 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,044 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,044 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=5} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,045 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,045 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=5}, logState=LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}}} to sender /127.0.0.4:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:28,046 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:21:28,046 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node4_GossipStage:1] node4 2024-07-04 05:21:28,047 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=5} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,048 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,050 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=4}} from /127.0.0.4:7012: start = Epoch{epoch=4}, current = Epoch{epoch=5} INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,054 Flushing.java:153 - Writing Memtable-local_metadata_log@890283807(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,054 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=61934) DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:28,055 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,060 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 45, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,060 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,067 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43cb1d20-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,070 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,070 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.139KiB), biggest 5.139KiB, smallest 5.139KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,070 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,071 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,071 Register.java:122 - Registering with endpoint /127.0.0.4:7012 INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,072 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 577B (0%) on-heap, 0B (0%) off-heap INFO [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,074 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 565B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,077 Flushing.java:153 - Writing Memtable-local@742744311(65B serialized bytes, 1 ops, 577B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,078 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62018) INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,089 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=4}} from /127.0.0.3:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,093 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070479, version = 44, AppStateMap = {LOAD=Value(62375.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 11, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,094 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,094 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=6} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,094 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=6} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,095 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,105 Flushing.java:153 - Writing Memtable-local_metadata_log@1797964358(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,105 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=73008) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,108 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_43ce9f90-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,110 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,110 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,110 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000002, (Note: This should happen exactly once per node) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,115 Flushing.java:153 - Writing Memtable-local@475147230(53B serialized bytes, 1 ops, 565B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,116 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62100) INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,118 BootStrapper.java:256 - tokens manually specified as [40] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,119 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=2}, tokens=[40], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=5}} from /127.0.0.4:7012 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,128 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:28,128 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,128 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,128 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=6} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,129 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:28,129 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:21:28,129 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,132 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,132 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=6}, logState=LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}}} to sender /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,133 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=4}} from /127.0.0.2:7012 INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:28,133 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:28,133 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,135 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,135 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,136 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,139 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=7} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,139 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=7} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,140 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node3_GossipStage:1] node3 2024-07-04 05:21:28,147 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=6} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,147 Flushing.java:153 - Writing Memtable-local_metadata_log@1935048258(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,147 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=61934) INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,148 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=4}} from /127.0.0.3:7012: start = Epoch{epoch=4}, current = Epoch{epoch=6} INFO [node4_GossipStage:1] node4 2024-07-04 05:21:28,149 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,149 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,149 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,149 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata INFO [node4_GossipStage:1] node4 2024-07-04 05:21:28,149 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,150 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,150 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,150 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,150 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:28,150 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,151 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:28,151 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,151 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=3: Epoch{epoch=5} -> Epoch{epoch=7}} INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,152 Flushing.java:153 - Writing Memtable-local_metadata_log@1837895007(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,152 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=74188) DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:28,152 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=3: Epoch{epoch=5} -> Epoch{epoch=7}} INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,156 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_43d444e0-39c5-11ef-a91a-654b51ec069b.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,174 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,174 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,174 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,175 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.4,6), RPC_ADDRESS=Value(127.0.0.4,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_GossipStage:1] node2 2024-07-04 05:21:28,181 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=6} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,182 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=4}} from /127.0.0.2:7012: start = Epoch{epoch=4}, current = Epoch{epoch=6} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,184 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=3: Epoch{epoch=5} -> Epoch{epoch=7}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:28,185 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=3: Epoch{epoch=5} -> Epoch{epoch=7}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,187 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,192 Flushing.java:153 - Writing Memtable-local_metadata_log@2015448380(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,192 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62274) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,197 Flushing.java:153 - Writing Memtable-local_metadata_log@1028595930(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,197 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=61934) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,219 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43d86390-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,222 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,222 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.139KiB), biggest 5.139KiB, smallest 5.139KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,223 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,223 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:28,224 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,224 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,224 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:28,224 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,224 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,224 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=7} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,224 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),867)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,224 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,225 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,225 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899936563 bytes available, checking if we can write 1161 bytes DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:28,225 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,225 CompactionTask.java:167 - Compacting (43e5d110-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, ] DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:21:28,226 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,226 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,228 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,228 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,228 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=7}, logState=LogState{baseState=none , entries=3: Epoch{epoch=5} -> Epoch{epoch=7}}} to sender /127.0.0.2:7012 INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:28,229 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} from /127.0.0.1:7012 INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,229 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43de08e0-39c5-11ef-a91a-654b51ec069b.log DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:28,229 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:28,229 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:28,229 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,230 Flushing.java:153 - Writing Memtable-local_metadata_log@209346939(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,230 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=62108) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,230 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=3: Epoch{epoch=5} -> Epoch{epoch=7}} INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,232 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43e004b0-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,232 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,233 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.154KiB), biggest 5.154KiB, smallest 5.154KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,233 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=6} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,233 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,234 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,234 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,235 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,235 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,236 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.139KiB), biggest 5.139KiB, smallest 5.139KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,236 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,236 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:28,237 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:21:28,237 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,238 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,239 Flushing.java:153 - Writing Memtable-local_metadata_log@1211708792(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,239 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62448) INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,245 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=2}, tokens=[40], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=8} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,246 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=8} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,246 Flushing.java:153 - Writing Memtable-local_metadata_log@770957005(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,246 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,247 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=62108) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,256 Flushing.java:153 - Writing Memtable-local_metadata_log@1660251186(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=75277) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,262 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43e5d110-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,269 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,269 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.139KiB), biggest 5.139KiB, smallest 5.139KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,269 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=6} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,270 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,271 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,272 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,273 CompactionTask.java:258 - Compacted (43e5d110-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.134KiB to 1011B (~87% of original) in 46ms. Read Throughput = 24.232KiB/s, Write Throughput = 21.102KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 10ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,274 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,274 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,274 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,275 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,277 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,278 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,288 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43e757b0-39c5-11ef-a91a-654b51ec069b.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,288 Flushing.java:153 - Writing Memtable-local_metadata_log@1896074291(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,289 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=62282) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,303 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43e7cce0-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,304 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,304 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,304 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=7} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,304 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,305 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,305 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,313 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,313 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.139KiB), biggest 5.139KiB, smallest 5.139KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,313 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=6} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,313 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:28,314 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:21:28,314 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,339 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 811B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:28,341 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,341 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,342 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,342 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=2}, tokens=[40], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=8} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,343 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:28,344 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,344 Flushing.java:153 - Writing Memtable-local_metadata_log@160299046(168B serialized bytes, 1 ops, 811B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,345 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=62282) INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,346 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,346 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} to /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,347 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=8}, logState=LogState{baseState=none , entries=3: Epoch{epoch=6} -> Epoch{epoch=8}}} to sender /127.0.0.4:7012 INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:28,347 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:28,347 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:28,347 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:28,347 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,348 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=3: Epoch{epoch=6} -> Epoch{epoch=8}} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,348 LocalLog.java:523 - An already appended entry Epoch{epoch=6} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=7} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,348 LocalLog.java:523 - An already appended entry Epoch{epoch=7} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=7} INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,352 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43ecfd00-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,354 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,354 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,355 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=7} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,355 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,362 Flushing.java:153 - Writing Memtable-local@1120354752(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,362 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=62364) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,366 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,374 Flushing.java:153 - Writing Memtable-local_metadata_log@1341957712(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,375 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62569) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,378 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,384 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43f73630-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,390 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,390 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,390 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=7} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,391 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,393 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_43f98020-39c5-11ef-99a4-a939d1f9f39c.log INFO [node2_OptionalTasks:1] node2 2024-07-04 05:21:28,394 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 565B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,395 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,395 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,395 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:28,396 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:28,396 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,396 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,407 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,408 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43fb7bf0-39c5-11ef-a91a-654b51ec069b.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,409 Flushing.java:153 - Writing Memtable-local_metadata_log@44274612(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,409 Flushing.java:153 - Writing Memtable-local@789489883(53B serialized bytes, 1 ops, 565B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,409 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=62485) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,410 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=62364) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,420 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,420 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,420 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,420 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,432 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 570B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,440 Flushing.java:153 - Writing Memtable-local@1123903658(92B serialized bytes, 2 ops, 820B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,441 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62729) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,486 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_43ff9aa0-39c5-11ef-be06-a3f8887dcaed.log INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,486 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_43ffc1b0-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,490 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,490 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,490 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,490 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,490 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:21:28,490 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:28,491 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,492 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,493 Register.java:122 - Registering with endpoint /127.0.0.3:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:28,493 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,494 Flushing.java:153 - Writing Memtable-local_metadata_log@1803748368(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,494 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 579B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,494 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=62485) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,497 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_44058e10-39c5-11ef-a91a-654b51ec069b.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,499 Flushing.java:153 - Writing Memtable-local@1561156386(65B serialized bytes, 1 ops, 579B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,499 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=62845) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,500 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,500 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.092KiB), biggest 5.092KiB, smallest 5.092KiB INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,501 Startup.java:400 - NORMAL WARN 05:21:28 Using stored Gossip Generation 1720070489 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems WARN [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,503 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070489 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems INFO [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,505 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 565B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,510 Flushing.java:153 - Writing Memtable-local@818386276(53B serialized bytes, 1 ops, 565B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,511 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62811) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,511 SnapshotManager.java:125 - Adding snapshots: . INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,511 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,513 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_440e40a0-39c5-11ef-be06-a3f8887dcaed.log INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,516 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,517 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,517 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,517 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,517 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,518 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,519 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,519 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_440edce0-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,520 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,520 Register.java:122 - Registering with endpoint /127.0.0.2:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:28,520 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,521 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 577B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,521 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,522 FetchCMSLog.java:119 - Responding to /127.0.0.4:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=8}}) with log delta: LogState{baseState=none , entries=0: []} INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,527 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,527 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899504640 bytes available, checking if we can write 1261 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,527 CompactionTask.java:167 - Compacting (441322a0-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,528 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,528 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,528 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000003, (Note: This should happen exactly once per node) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,531 BootStrapper.java:256 - tokens manually specified as [30] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,532 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=3}, tokens=[30], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=8}} from /127.0.0.3:7012 INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,534 Flushing.java:153 - Writing Memtable-local@1488304667(65B serialized bytes, 1 ops, 577B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,534 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=62845) DEBUG [node4_isolatedExecutor:2] node4 2024-07-04 05:21:28,536 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,554 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=3}, tokens=[30], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=9} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,554 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=9} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,555 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,561 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,565 Flushing.java:153 - Writing Memtable-local_metadata_log@1878675376(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,566 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=77788) WARN 05:21:28 Using stored Gossip Generation 1720070490 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems WARN [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,568 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070490 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems INFO [node4_OptionalTasks:1] node4 2024-07-04 05:21:28,569 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 565B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,584 Flushing.java:153 - Writing Memtable-local@836035825(53B serialized bytes, 1 ops, 565B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,584 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=62893) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,601 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_4412fb90-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,610 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,610 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,610 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000004, (Note: This should happen exactly once per node) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,613 BootStrapper.java:256 - tokens manually specified as [20] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,615 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=4}, tokens=[20], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=8}} from /127.0.0.2:7012 INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,625 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,626 CompactionTask.java:258 - Compacted (441322a0-39c5-11ef-a91a-654b51ec069b) 8 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.231KiB to 1.013KiB (~82% of original) in 92ms. Read Throughput = 13.278KiB/s, Write Throughput = 10.920KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 31ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,627 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899387904 bytes available, checking if we can write 326 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,627 CompactionTask.java:167 - Compacting (44230120-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,628 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:28,628 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,628 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,628 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,628 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=3}, tokens=[30], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=9} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,630 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,630 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,630 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,630 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:28,630 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:28,630 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=9}, logState=LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}}} to sender /127.0.0.3:7012 INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:28,631 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:28,631 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:28,631 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:28,632 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,632 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,633 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,635 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,635 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,636 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.4,6), RPC_ADDRESS=Value(127.0.0.4,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(40,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,35), STATUS_WITH_PORT=Value(NORMAL,40,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,637 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,640 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,642 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,649 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=4}, tokens=[20], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=10} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,649 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=10} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,650 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,652 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,653 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,655 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,658 Flushing.java:153 - Writing Memtable-local_metadata_log@1392482555(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:28,658 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=79261) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,660 CompactionTask.java:258 - Compacted (44230120-39c5-11ef-a91a-654b51ec069b) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 326B to 231B (~70% of original) in 31ms. Read Throughput = 10.148KiB/s, Write Throughput = 7.191KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 9ms INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,661 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,662 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,662 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,662 Flushing.java:153 - Writing Memtable-local_metadata_log@456133309(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,662 Flushing.java:153 - Writing Memtable-local_metadata_log@1050621411(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,662 Flushing.java:153 - Writing Memtable-local_metadata_log@847279844(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=63197) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,663 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=64800) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,663 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=63197) INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,664 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,665 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,667 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:28,669 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,713 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_44271fd0-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:28,715 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,715 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,715 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,715 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=4}, tokens=[20], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=10} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,716 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),1011), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,716 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_44276df0-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,716 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899621376 bytes available, checking if we can write 1170 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,717 CompactionTask.java:167 - Compacting (4430bcc0-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:28,717 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,717 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,717 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:28,717 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,717 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=9} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,719 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,719 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=9} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,719 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,719 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.4:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,719 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.3:7012 DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,719 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:28,720 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=10}, logState=LogState{baseState=none , entries=2: Epoch{epoch=9} -> Epoch{epoch=10}}} to sender /127.0.0.2:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:28,720 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,720 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:28,720 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:28,720 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:28,720 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:28,720 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,720 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,721 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=9} -> Epoch{epoch=10}} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,721 LocalLog.java:523 - An already appended entry Epoch{epoch=9} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=9} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,721 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,721 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,722 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,722 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=9} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,724 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,738 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 701B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,742 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,743 Flushing.java:153 - Writing Memtable-local@1253177397(63B serialized bytes, 1 ops, 701B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,744 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=63274) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,744 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,744 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,756 Flushing.java:153 - Writing Memtable-local_metadata_log@1678576283(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,756 Flushing.java:153 - Writing Memtable-local_metadata_log@849447241(115B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:28,756 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=66510) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,756 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=63825) DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:28,765 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:28,765 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:28,765 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node2_GossipStage:1] node2 2024-07-04 05:21:28,766 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=10} INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,766 CompactionTask.java:258 - Compacted (4430bcc0-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 1.143KiB to 1.059KiB (~92% of original) in 48ms. Read Throughput = 23.492KiB/s, Write Throughput = 21.765KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 13ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,767 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,767 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=9}} from /127.0.0.2:7012: start = Epoch{epoch=9}, current = Epoch{epoch=10} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:28,767 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,767 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,769 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,769 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:28,770 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,771 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:28,773 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,804 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_44341820-39c5-11ef-99a4-a939d1f9f39c.log INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,817 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_44352990-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,818 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,818 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB WARN 05:21:28 Using stored Gossip Generation 1720070489 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems WARN [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,822 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070489 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,823 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:28,823 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:28,823 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,823 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=10} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:28,823 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,823 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:28,826 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,830 Flushing.java:153 - Writing Memtable-local_metadata_log@1418849508(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,830 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,831 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,831 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=63395) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,831 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=10} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:28,833 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,845 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 570B (0%) on-heap, 0B (0%) off-heap INFO [node2_OptionalTasks:1] node2 2024-07-04 05:21:28,846 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 699B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,854 Flushing.java:153 - Writing Memtable-local@400372110(58B serialized bytes, 1 ops, 570B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,854 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=63908) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,869 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_44404d20-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,873 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,873 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,873 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=10} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:28,875 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,877 Flushing.java:153 - Writing Memtable-local@1676831007(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,877 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=63477) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,880 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 572B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,883 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_444492e0-39c5-11ef-be06-a3f8887dcaed.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,888 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,888 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,888 Startup.java:400 - NORMAL INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,892 Flushing.java:153 - Writing Memtable-local@1649222668(63B serialized bytes, 1 ops, 699B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,892 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=63985) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,895 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_4448b190-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,897 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,898 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,898 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,898 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,903 Flushing.java:153 - Writing Memtable-local@1391723731(58B serialized bytes, 1 ops, 572B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,903 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=63560) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,904 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap WARN 05:21:28 Using stored Gossip Generation 1720070490 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems WARN [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,904 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070490 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:28,904 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:28,905 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,905 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:28,907 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:28,908 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:28,909 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=10}}) with log delta: LogState{baseState=none , entries=0: []} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,914 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:28,914 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899426816 bytes available, checking if we can write 1367 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:28,915 CompactionTask.java:167 - Compacting (444e2fd0-39c5-11ef-be06-a3f8887dcaed) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:28,925 SnapshotManager.java:125 - Adding snapshots: . DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:28,941 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 5.024KiB), biggest 5.024KiB, smallest 5.024KiB WARN 05:21:28 Using stored Gossip Generation 1720070489 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-07-04 05:21:28,945 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070489 as it is greater than current system time 1720070488. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-07-04 05:21:28,946 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 565B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,962 Flushing.java:153 - Writing Memtable-local@632960395(53B serialized bytes, 1 ops, 565B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:28,963 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=64067) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,982 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_444c8220-39c5-11ef-99a4-a939d1f9f39c.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,993 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:28,993 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:28,994 Startup.java:400 - NORMAL INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,998 Flushing.java:153 - Writing Memtable-local@398536424(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:28,999 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=63642) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:29,006 SnapshotManager.java:125 - Adding snapshots: . INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:29,006 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:29,010 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,013 CompactionTask.java:258 - Compacted (444e2fd0-39c5-11ef-be06-a3f8887dcaed) 10 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big,] to level=0. 1.335KiB to 1.056KiB (~79% of original) in 93ms. Read Throughput = 14.341KiB/s, Write Throughput = 11.340KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 38ms INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:29,015 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,015 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899302298 bytes available, checking if we can write 346 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,015 CompactionTask.java:167 - Compacting (445e3560-39c5-11ef-be06-a3f8887dcaed) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,015 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,015 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:29,017 AuditLogManager.java:80 - Audit logging is disabled. INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,017 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,018 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables WARN 05:21:29 Using stored Gossip Generation 1720070490 as it is greater than current system time 1720070489. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-07-04 05:21:29,019 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070490 as it is greater than current system time 1720070489. See CASSANDRA-3654 if you experience problems DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,019 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,019 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node2_OptionalTasks:1] node2 2024-07-04 05:21:29,019 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 565B (0%) on-heap, 0B (0%) off-heap INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:29,045 FetchCMSLog.java:119 - Responding to /127.0.0.3:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=10}}) with log delta: LogState{baseState=none , entries=0: []} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,047 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,049 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:29,050 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:29,050 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:29,051 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:29,051 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,051 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899461837 bytes available, checking if we can write 1367 bytes INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,052 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,052 CompactionTask.java:167 - Compacting (445f1fc0-39c5-11ef-99a4-a939d1f9f39c) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] INFO [node1_GossipStage:1] node1 2024-07-04 05:21:29,053 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,053 Flushing.java:153 - Writing Memtable-local@695183989(53B serialized bytes, 1 ops, 565B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=65000) INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,055 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,057 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,059 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,062 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:29,063 SnapshotManager.java:125 - Adding snapshots: . INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:29,080 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:49400)->/127.0.0.4:7012-SMALL_MESSAGES-467cc7e4 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:29,080 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:56530)->/127.0.0.2:7012-SMALL_MESSAGES-e71f276b messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:29,080 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:40000)->/127.0.0.3:7012-SMALL_MESSAGES-bd95b8a2 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:29,081 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:49400)->/127.0.0.4:7012-SMALL_MESSAGES-8ff9ee5d successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:29,081 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:56530)->/127.0.0.2:7012-SMALL_MESSAGES-9fb8a040 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:29,082 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:40000)->/127.0.0.3:7012-SMALL_MESSAGES-589b4f80 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:29,089 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:57826)->/127.0.0.1:7012-SMALL_MESSAGES-4ac50690 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:29,089 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:57826)->/127.0.0.1:7012-SMALL_MESSAGES-57b594c8 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:29,090 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:57830)->/127.0.0.1:7012-SMALL_MESSAGES-d7279b34 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:29,090 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:57830)->/127.0.0.1:7012-SMALL_MESSAGES-54a7a0fc successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:29,097 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:57842)->/127.0.0.1:7012-SMALL_MESSAGES-9feb3021 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:29,097 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:57842)->/127.0.0.1:7012-SMALL_MESSAGES-4bcb1920 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:29,109 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:40016)->/127.0.0.3:7012-SMALL_MESSAGES-66070dc1 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:29,110 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:40016)->/127.0.0.3:7012-SMALL_MESSAGES-ed585371 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:29,110 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:56532)->/127.0.0.2:7012-SMALL_MESSAGES-cb1cc228 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:29,111 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:56532)->/127.0.0.2:7012-SMALL_MESSAGES-2746feb5 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:29,113 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:49416)->/127.0.0.4:7012-SMALL_MESSAGES-1144e8fc messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:29,113 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:49416)->/127.0.0.4:7012-SMALL_MESSAGES-bf10bd6c successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:29,114 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:49420)->/127.0.0.4:7012-SMALL_MESSAGES-555bc48f messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:29,114 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:49420)->/127.0.0.4:7012-SMALL_MESSAGES-526fd754 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:29,116 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:56544)->/127.0.0.2:7012-SMALL_MESSAGES-b70dab0f messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:29,116 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:56544)->/127.0.0.2:7012-SMALL_MESSAGES-57f27621 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:29,118 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:40024)->/127.0.0.3:7012-SMALL_MESSAGES-88278604 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:29,118 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:40024)->/127.0.0.3:7012-SMALL_MESSAGES-a40f3e74 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:29,121 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:29,122 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,128 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,130 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,133 CompactionTask.java:258 - Compacted (445e3560-39c5-11ef-be06-a3f8887dcaed) 6 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big,] to level=0. 346B to 225B (~65% of original) in 110ms. Read Throughput = 3.066KiB/s, Write Throughput = 1.994KiB/s, Row Throughput = ~2/s. 6 total partitions merged to 1. Partition merge counts were {6:1, }. Time spent writing keys = 39ms DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,135 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,135 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,135 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,137 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,139 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:29,141 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node3_GossipStage:1] node3 2024-07-04 05:21:29,149 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,151 CompactionTask.java:258 - Compacted (445f1fc0-39c5-11ef-99a4-a939d1f9f39c) 10 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big,] to level=0. 1.335KiB to 1.055KiB (~79% of original) in 90ms. Read Throughput = 14.701KiB/s, Write Throughput = 11.615KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 42ms DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,152 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899734221 bytes available, checking if we can write 374 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,152 CompactionTask.java:167 - Compacting (44731cf0-39c5-11ef-99a4-a939d1f9f39c) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node3_GossipStage:1] node3 2024-07-04 05:21:29,153 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL INFO [node2_GossipStage:1] node2 2024-07-04 05:21:29,154 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node1_GossipStage:1] node1 2024-07-04 05:21:29,158 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,159 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,162 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,165 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,167 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,169 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,170 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,172 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,174 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,175 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,177 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node2_GossipStage:1] node2 2024-07-04 05:21:29,180 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,187 CompactionTask.java:258 - Compacted (44731cf0-39c5-11ef-99a4-a939d1f9f39c) 7 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big,] to level=0. 374B to 224B (~59% of original) in 34ms. Read Throughput = 10.705KiB/s, Write Throughput = 6.411KiB/s, Row Throughput = ~2/s. 7 total partitions merged to 1. Partition merge counts were {7:1, }. Time spent writing keys = 11ms DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,189 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,189 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,210 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,212 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,213 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,215 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,217 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,219 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:29,221 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,228 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:29,284 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:29,290 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node4_isolatedExecutor:2] node4 2024-07-04 05:21:29,307 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,327 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (distributed_test_keyspace) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,330 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,337 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New epoch is Epoch{epoch=11} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,337 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=11} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,338 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 919B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,350 Flushing.java:153 - Writing Memtable-local_metadata_log@1595183374(275B serialized bytes, 1 ops, 919B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,350 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84702) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,389 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:29,389 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:29,389 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.122KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,394 Flushing.java:153 - Writing Memtable-column_masks@373940770(10.483KiB serialized bytes, 253 ops, 68.122KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,398 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,413 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.452KiB), biggest 8.452KiB, smallest 8.452KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,414 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.303KiB (2%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,417 Flushing.java:153 - Writing Memtable-columns@737388692(43.473KiB serialized bytes, 253 ops, 198.303KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,423 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,438 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,438 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.354KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,442 Flushing.java:153 - Writing Memtable-dropped_columns@98948433(135B serialized bytes, 3 ops, 1.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,443 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,458 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,458 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,462 Flushing.java:153 - Writing Memtable-triggers@2114103298(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,462 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,476 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,477 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,486 Flushing.java:153 - Writing Memtable-types@654511378(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,486 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,538 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,539 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,552 Flushing.java:153 - Writing Memtable-functions@285390446(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,552 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,603 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,603 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,616 Flushing.java:153 - Writing Memtable-aggregates@979809858(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,616 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,638 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,638 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.356KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,642 Flushing.java:153 - Writing Memtable-indexes@1364155316(213B serialized bytes, 3 ops, 1.356KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,642 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,657 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,657 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.695KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,661 Flushing.java:153 - Writing Memtable-tables@1847310098(28.593KiB serialized bytes, 38 ops, 90.695KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,662 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,678 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,678 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,682 Flushing.java:153 - Writing Memtable-views@1781456249(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,682 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,695 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,696 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.331KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,699 Flushing.java:153 - Writing Memtable-keyspaces@1702208216(415B serialized bytes, 5 ops, 2.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:29,700 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=84899) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:29,729 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.476KiB), biggest 5.476KiB, smallest 5.476KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,730 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}}. New tail is Epoch{epoch=11} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:29,735 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,735 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.4:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,736 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:29,736 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.2:7012 INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:29,738 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:29,738 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:29,739 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:29,739 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:29,739 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:29,739 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:29,741 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:29,741 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:29,742 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:29,745 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 918B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:29,745 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 920B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:29,748 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 918B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,759 Flushing.java:153 - Writing Memtable-local_metadata_log@1282151992(275B serialized bytes, 1 ops, 920B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,759 Flushing.java:153 - Writing Memtable-local_metadata_log@1044469452(275B serialized bytes, 1 ops, 918B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,759 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69082) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,759 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=67846) DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:29,765 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:29,765 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:29,765 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node4_GossipStage:1] node4 2024-07-04 05:21:29,766 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:29,767 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=10}} from /127.0.0.4:7012: start = Epoch{epoch=10}, current = Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:29,769 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} INFO [node4_GossipStage:1] node4 2024-07-04 05:21:29,769 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,769 Flushing.java:153 - Writing Memtable-local_metadata_log@1463861143(275B serialized bytes, 1 ops, 918B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,770 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=68929) DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:29,770 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:29,827 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,827 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:29,827 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,827 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:29,827 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.241KiB), biggest 5.241KiB, smallest 5.241KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,827 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:29,828 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:29,828 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,828 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,828 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),1037), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),187)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,829 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899730330 bytes available, checking if we can write 1330 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,829 CompactionTask.java:167 - Compacting (44da6a40-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:29,829 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.120KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:29,829 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.120KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:29,830 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.124KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,836 Flushing.java:153 - Writing Memtable-column_masks@1009136699(10.483KiB serialized bytes, 253 ops, 68.124KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,837 Flushing.java:153 - Writing Memtable-column_masks@1546034231(10.483KiB serialized bytes, 253 ops, 68.120KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,837 Flushing.java:153 - Writing Memtable-column_masks@673504921(10.483KiB serialized bytes, 253 ops, 68.120KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,842 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070482227, position=68775) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,842 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69126) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,844 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69279) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,863 CompactionTask.java:258 - Compacted (44da6a40-39c5-11ef-a91a-654b51ec069b) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 1.299KiB to 1.203KiB (~92% of original) in 32ms. Read Throughput = 39.432KiB/s, Write Throughput = 36.526KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 11ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,863 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:29,863 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:29,863 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:29,865 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:29,866 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:29,868 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:29,868 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.452KiB), biggest 8.452KiB, smallest 8.452KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:29,868 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.441KiB), biggest 8.441KiB, smallest 8.441KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:29,868 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.301KiB (2%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:29,868 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.301KiB (2%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:29,876 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.441KiB), biggest 8.441KiB, smallest 8.441KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:29,876 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.305KiB (2%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,887 Flushing.java:153 - Writing Memtable-columns@869948610(43.473KiB serialized bytes, 253 ops, 198.301KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,887 Flushing.java:153 - Writing Memtable-columns@675605589(43.473KiB serialized bytes, 253 ops, 198.301KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,895 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070482227, position=69816) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,897 Flushing.java:153 - Writing Memtable-columns@1309044208(43.473KiB serialized bytes, 253 ops, 198.305KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,899 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69126) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,906 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69279) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:29,956 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:29,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.353KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:29,959 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:29,959 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.353KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,960 Flushing.java:153 - Writing Memtable-dropped_columns@219111473(135B serialized bytes, 3 ops, 1.353KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,961 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=69816) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:29,962 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:29,962 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.356KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,964 Flushing.java:153 - Writing Memtable-dropped_columns@2083313450(135B serialized bytes, 3 ops, 1.353KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,964 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69126) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,968 Flushing.java:153 - Writing Memtable-dropped_columns@1353628854(135B serialized bytes, 3 ops, 1.356KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:29,969 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69279) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:29,989 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:29,989 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:29,992 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:29,992 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,993 Flushing.java:153 - Writing Memtable-triggers@961327210(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:29,994 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=69816) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:29,995 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:29,995 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,997 Flushing.java:153 - Writing Memtable-triggers@784491327(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:29,997 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69126) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,019 Flushing.java:153 - Writing Memtable-triggers@2086649165(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,019 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69279) INFO [node4_GossipStage:1] node4 2024-07-04 05:21:30,047 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,075 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,075 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,101 Flushing.java:153 - Writing Memtable-types@932344268(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,101 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70363) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,112 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,112 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,121 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,121 Flushing.java:153 - Writing Memtable-types@1181582836(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,121 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,121 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69311) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,130 Flushing.java:153 - Writing Memtable-types@1901451537(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,130 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69279) INFO [node3_GossipStage:1] node3 2024-07-04 05:21:30,149 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=11} INFO [node1_GossipStage:1] node1 2024-07-04 05:21:30,149 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:30,149 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=10}} from /127.0.0.3:7012: start = Epoch{epoch=10}, current = Epoch{epoch=11} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:30,152 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:30,153 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,153 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,154 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,158 Flushing.java:153 - Writing Memtable-functions@1456408496(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,159 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70363) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,160 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,160 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,165 Flushing.java:153 - Writing Memtable-functions@1229254440(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,165 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69311) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,168 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,168 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,175 Flushing.java:153 - Writing Memtable-functions@205603622(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,175 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69464) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,216 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,217 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,228 Flushing.java:153 - Writing Memtable-aggregates@540535728(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,229 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70363) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,247 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,248 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,266 Flushing.java:153 - Writing Memtable-aggregates@1405875373(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,267 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69311) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,272 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,272 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,287 Flushing.java:153 - Writing Memtable-aggregates@690951444(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,288 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69464) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,303 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,303 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.354KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,308 Flushing.java:153 - Writing Memtable-indexes@2091175996(213B serialized bytes, 3 ops, 1.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,309 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70363) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,310 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,310 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.354KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,318 Flushing.java:153 - Writing Memtable-indexes@1848491632(213B serialized bytes, 3 ops, 1.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,318 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69311) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,332 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,333 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.358KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,339 Flushing.java:153 - Writing Memtable-indexes@672882857(213B serialized bytes, 3 ops, 1.358KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,340 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69464) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,345 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,345 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.693KiB (1%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,350 Flushing.java:153 - Writing Memtable-tables@1478279797(28.593KiB serialized bytes, 38 ops, 90.693KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,352 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,352 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70363) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,352 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.693KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,362 Flushing.java:153 - Writing Memtable-tables@1145427044(28.593KiB serialized bytes, 38 ops, 90.693KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,363 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.862KiB) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69311) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,391 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.697KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,404 Flushing.java:153 - Writing Memtable-tables@2010753514(28.593KiB serialized bytes, 38 ops, 90.697KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,406 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69464) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,444 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,444 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,453 Flushing.java:153 - Writing Memtable-views@1992342593(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,454 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70363) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,455 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.194KiB), biggest 9.194KiB, smallest 9.194KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,456 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 723B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,460 Flushing.java:153 - Writing Memtable-views@706104939(16B serialized bytes, 2 ops, 723B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,460 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69311) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,474 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,474 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 727B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,483 Flushing.java:153 - Writing Memtable-views@1896320068(16B serialized bytes, 2 ops, 727B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,483 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69464) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,488 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,488 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.328KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,493 Flushing.java:153 - Writing Memtable-keyspaces@1773515586(415B serialized bytes, 5 ops, 2.328KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,494 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70363) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,495 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,495 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.328KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,502 Flushing.java:153 - Writing Memtable-keyspaces@645183768(415B serialized bytes, 5 ops, 2.328KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,503 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69311) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,522 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,522 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.334KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,530 Flushing.java:153 - Writing Memtable-keyspaces@542220485(415B serialized bytes, 5 ops, 2.334KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,531 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69464) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,535 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,535 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=11} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,535 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,553 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,553 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=11} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,560 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,591 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,591 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=11} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,597 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,598 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,598 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,598 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (tr) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,599 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,599 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,600 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,606 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New epoch is Epoch{epoch=12} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,606 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=12} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:30,606 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 869B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,619 Flushing.java:153 - Writing Memtable-local_metadata_log@1313658681(225B serialized bytes, 1 ops, 869B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,619 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=86945) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:30,662 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.220KiB), biggest 5.220KiB, smallest 5.220KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,662 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,662 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:30,664 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,668 Flushing.java:153 - Writing Memtable-keyspaces@2111593157(153B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,668 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=87115) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:30,702 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:30,702 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}}. New tail is Epoch{epoch=12} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,702 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911108198 bytes available, checking if we can write 615 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,702 CompactionTask.java:167 - Compacting (455fc6e0-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:30,706 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,706 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.4:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,706 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,707 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.2:7012 INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:30,707 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:30,707 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:30,707 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:30,707 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:30,708 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:30,708 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,710 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,710 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,710 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,710 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,710 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,710 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,711 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,711 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,711 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,716 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 868B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,716 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 868B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,717 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 870B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,722 Flushing.java:153 - Writing Memtable-local_metadata_log@860531576(225B serialized bytes, 1 ops, 868B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,722 Flushing.java:153 - Writing Memtable-local_metadata_log@1404867150(225B serialized bytes, 1 ops, 870B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,722 Flushing.java:153 - Writing Memtable-local_metadata_log@631856536(225B serialized bytes, 1 ops, 868B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,723 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69786) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,723 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69633) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,723 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=70685) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,741 CompactionTask.java:258 - Compacted (455fc6e0-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 360B (~58% of original) in 37ms. Read Throughput = 15.852KiB/s, Write Throughput = 9.279KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 7ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:30,742 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:30,744 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:30,745 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:30,747 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:30,766 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:30,766 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:21:30,766 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node4_GossipStage:1] node4 2024-07-04 05:21:30,767 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:30,767 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=11}} from /127.0.0.4:7012: start = Epoch{epoch=11}, current = Epoch{epoch=12} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:30,769 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:30,770 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,780 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.220KiB), biggest 5.220KiB, smallest 5.220KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:30,780 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,780 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db')] (1 sstables, 5.220KiB), biggest 5.220KiB, smallest 5.220KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:30,780 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:30,781 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:30,781 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,783 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 754B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,783 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 756B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:30,785 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,785 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db')] (1 sstables, 5.220KiB), biggest 5.220KiB, smallest 5.220KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:30,785 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,787 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 754B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,789 Flushing.java:153 - Writing Memtable-keyspaces@1771104042(153B serialized bytes, 1 ops, 756B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,789 Flushing.java:153 - Writing Memtable-keyspaces@234608654(153B serialized bytes, 1 ops, 754B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:30,790 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=69956) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:30,790 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=71040) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,800 Flushing.java:153 - Writing Memtable-keyspaces@1327844285(153B serialized bytes, 1 ops, 754B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:30,800 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=69803) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:30,854 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,854 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=12} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:30,854 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:30,854 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617910979789 bytes available, checking if we can write 615 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:30,855 CompactionTask.java:167 - Compacting (4576f860-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:30,855 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:30,855 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,856 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=12} DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:30,856 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617910979789 bytes available, checking if we can write 615 bytes DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:30,856 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617910979789 bytes available, checking if we can write 615 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:30,856 CompactionTask.java:167 - Compacting (45774680-39c5-11ef-99a4-a939d1f9f39c) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:30,856 CompactionTask.java:167 - Compacting (45774680-39c5-11ef-be06-a3f8887dcaed) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,856 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=12} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:30,861 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:30,862 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,863 Schema.java:287 - Submitting schema transformation CreateTableStatement (tr, x) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,870 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New epoch is Epoch{epoch=13} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:21:30,870 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=13} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:30,871 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.585KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,876 Flushing.java:153 - Writing Memtable-local_metadata_log@1627751698(979B serialized bytes, 1 ops, 1.585KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,876 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=92831) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:30,903 CompactionTask.java:258 - Compacted (4576f860-39c5-11ef-a91a-654b51ec069b) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 364B (~59% of original) in 46ms. Read Throughput = 12.861KiB/s, Write Throughput = 7.612KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 9ms INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:30,903 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:30,905 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:30,906 CompactionTask.java:258 - Compacted (45774680-39c5-11ef-be06-a3f8887dcaed) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 363B (~59% of original) in 48ms. Read Throughput = 12.304KiB/s, Write Throughput = 7.262KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 13ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:30,906 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:30,907 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:30,908 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:30,909 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:30,910 CompactionTask.java:258 - Compacted (45774680-39c5-11ef-99a4-a939d1f9f39c) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 364B (~59% of original) in 52ms. Read Throughput = 11.420KiB/s, Write Throughput = 6.759KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 20ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:30,910 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:30,910 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:30,912 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:30,912 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:30,914 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:30,916 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:30,950 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,950 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,950 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,950 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1084)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,951 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911248282 bytes available, checking if we can write 2118 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:30,951 CompactionTask.java:167 - Compacting (45859e60-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:30,952 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:30,962 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,973 Flushing.java:153 - Writing Memtable-column_masks@690915464(32B serialized bytes, 1 ops, 578B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:30,973 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=93915) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,044 CompactionTask.java:258 - Compacted (45859e60-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.068KiB to 1.786KiB (~86% of original) in 92ms. Read Throughput = 22.448KiB/s, Write Throughput = 19.385KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 19ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,044 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,044 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,045 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,046 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,048 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,051 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:31,061 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:31,061 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.138KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,076 Flushing.java:153 - Writing Memtable-columns@32728971(159B serialized bytes, 1 ops, 1.138KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,076 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=95142) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:31,099 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:31,100 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.894KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,100 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911252173 bytes available, checking if we can write 8318 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,100 CompactionTask.java:167 - Compacting (459c5ab0-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,103 Flushing.java:153 - Writing Memtable-tables@510009090(773B serialized bytes, 1 ops, 2.894KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,103 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=95142) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:31,152 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:31,153 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,165 Flushing.java:153 - Writing Memtable-keyspaces@1392915657(153B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,165 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=95327) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,191 CompactionTask.java:258 - Compacted (459c5ab0-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.909KiB (~97% of original) in 90ms. Read Throughput = 90.085KiB/s, Write Throughput = 87.713KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 26ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,191 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,192 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911182131 bytes available, checking if we can write 4687 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,192 CompactionTask.java:167 - Compacting (45aa6470-39c5-11ef-9520-1f8a75ee0971) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,193 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,194 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,196 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:31,230 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:31,230 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}}. New tail is Epoch{epoch=13} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:31,233 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:31,234 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.4:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:31,234 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:31,234 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.2:7012 INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:31,236 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:31,236 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:31,236 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:31,236 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:31,236 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:31,236 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,240 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.586KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,241 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.584KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,241 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.584KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:31,245 CompactionTask.java:258 - Compacted (45aa6470-39c5-11ef-9520-1f8a75ee0971) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.008KiB (~87% of original) in 51ms. Read Throughput = 88.166KiB/s, Write Throughput = 77.199KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,245 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,246 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,247 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:31,249 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,251 Flushing.java:153 - Writing Memtable-local_metadata_log@607658992(979B serialized bytes, 1 ops, 1.586KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,251 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=72608) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,256 Flushing.java:153 - Writing Memtable-local_metadata_log@2125090628(979B serialized bytes, 1 ops, 1.584KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,256 Flushing.java:153 - Writing Memtable-local_metadata_log@1473786148(979B serialized bytes, 1 ops, 1.584KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=73322) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,256 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=72455) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:31,312 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,312 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,312 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:31,312 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,312 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,313 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,313 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,313 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,313 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),1080), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),187)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,313 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),1081), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),187)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:31,312 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.726KiB), biggest 5.726KiB, smallest 5.726KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,313 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911263846 bytes available, checking if we can write 2114 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,313 CompactionTask.java:167 - Compacting (45bd0210-39c5-11ef-99a4-a939d1f9f39c) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, ] DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,313 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911263846 bytes available, checking if we can write 2115 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,314 CompactionTask.java:167 - Compacting (45bd0210-39c5-11ef-be06-a3f8887dcaed) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, ] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,315 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,315 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,316 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,325 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 577B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,327 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 579B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,327 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 577B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,337 Flushing.java:153 - Writing Memtable-column_masks@977390704(32B serialized bytes, 1 ops, 577B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,337 Flushing.java:153 - Writing Memtable-column_masks@163768378(32B serialized bytes, 1 ops, 579B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,338 Flushing.java:153 - Writing Memtable-column_masks@1424486078(32B serialized bytes, 1 ops, 577B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,338 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=74406) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,338 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=73539) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,338 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=73692) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,391 CompactionTask.java:258 - Compacted (45bd0210-39c5-11ef-99a4-a939d1f9f39c) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big,] to level=0. 2.064KiB to 1.781KiB (~86% of original) in 76ms. Read Throughput = 26.971KiB/s, Write Throughput = 23.271KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 19ms DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,391 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,391 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,391 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,392 CompactionTask.java:258 - Compacted (45bd0210-39c5-11ef-be06-a3f8887dcaed) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big,] to level=0. 2.065KiB to 1.782KiB (~86% of original) in 76ms. Read Throughput = 26.842KiB/s, Write Throughput = 23.162KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 15ms DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,392 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,392 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,392 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,394 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,394 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,395 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,397 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,397 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,399 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:31,406 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,407 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.137KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:31,408 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:31,408 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,409 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.139KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,409 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.137KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,412 Flushing.java:153 - Writing Memtable-columns@1555472683(159B serialized bytes, 1 ops, 1.137KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,412 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=74406) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,414 Flushing.java:153 - Writing Memtable-columns@1054549422(159B serialized bytes, 1 ops, 1.139KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,414 Flushing.java:153 - Writing Memtable-columns@1003306023(159B serialized bytes, 1 ops, 1.137KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,414 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=74726) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,414 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=74581) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:31,496 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:31,496 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:31,496 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,497 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.893KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,497 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.893KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,497 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.895KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,497 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911174349 bytes available, checking if we can write 8318 bytes DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,497 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911174349 bytes available, checking if we can write 8318 bytes DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,497 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911174349 bytes available, checking if we can write 8318 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,497 CompactionTask.java:167 - Compacting (45d8ee80-39c5-11ef-be06-a3f8887dcaed) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,497 CompactionTask.java:167 - Compacting (45d8ee80-39c5-11ef-99a4-a939d1f9f39c) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,497 CompactionTask.java:167 - Compacting (45d8ee80-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,504 Flushing.java:153 - Writing Memtable-tables@1590747200(773B serialized bytes, 1 ops, 2.893KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,505 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=74581) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,510 Flushing.java:153 - Writing Memtable-tables@257833243(773B serialized bytes, 1 ops, 2.893KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,510 Flushing.java:153 - Writing Memtable-tables@1352416488(773B serialized bytes, 1 ops, 2.895KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=74406) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,510 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=74726) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:31,576 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,577 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 754B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:31,583 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:31,583 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 754B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,583 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 756B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,584 Flushing.java:153 - Writing Memtable-keyspaces@1217899439(153B serialized bytes, 1 ops, 754B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,585 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=74581) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,587 CompactionTask.java:258 - Compacted (45d8ee80-39c5-11ef-99a4-a939d1f9f39c) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.951KiB (~97% of original) in 88ms. Read Throughput = 91.541KiB/s, Write Throughput = 89.604KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 46ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,587 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,588 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617910936986 bytes available, checking if we can write 4687 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,588 CompactionTask.java:167 - Compacting (45e6d130-39c5-11ef-99a4-a939d1f9f39c) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,589 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,591 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,593 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,594 CompactionTask.java:258 - Compacted (45d8ee80-39c5-11ef-a91a-654b51ec069b) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.938KiB (~97% of original) in 96ms. Read Throughput = 84.431KiB/s, Write Throughput = 82.513KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 55ms INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,594 CompactionTask.java:258 - Compacted (45d8ee80-39c5-11ef-be06-a3f8887dcaed) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.950KiB (~97% of original) in 96ms. Read Throughput = 84.297KiB/s, Write Throughput = 82.503KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 54ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,595 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,595 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,596 Flushing.java:153 - Writing Memtable-keyspaces@597858267(153B serialized bytes, 1 ops, 754B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,596 Flushing.java:153 - Writing Memtable-keyspaces@903783080(153B serialized bytes, 1 ops, 756B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,596 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911108198 bytes available, checking if we can write 4685 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,596 CompactionTask.java:167 - Compacting (45e809b0-39c5-11ef-be06-a3f8887dcaed) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:31,596 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=74406) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,596 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=74726) DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,597 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617911096525 bytes available, checking if we can write 4687 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,597 CompactionTask.java:167 - Compacting (45e809b0-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,597 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,597 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,599 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,599 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,601 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,602 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:31,658 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,658 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=13} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:31,661 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:31,666 CompactionTask.java:258 - Compacted (45e6d130-39c5-11ef-99a4-a939d1f9f39c) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.003KiB (~87% of original) in 76ms. Read Throughput = 59.450KiB/s, Write Throughput = 51.991KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 18ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,666 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:31,668 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:31,668 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,668 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,668 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=13} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,668 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=13} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:31,668 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,670 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:31,672 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,672 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:31,672 CompactionTask.java:258 - Compacted (45e809b0-39c5-11ef-a91a-654b51ec069b) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.002KiB (~87% of original) in 72ms. Read Throughput = 62.943KiB/s, Write Throughput = 55.033KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 26ms INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,672 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:31,672 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:31,672 CompactionTask.java:258 - Compacted (45e809b0-39c5-11ef-be06-a3f8887dcaed) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.575KiB to 4.020KiB (~87% of original) in 74ms. Read Throughput = 61.644KiB/s, Write Throughput = 54.158KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 26ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,674 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,674 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,676 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,676 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:31,678 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:31,678 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node1_Repair-Task:1] node1 2024-07-04 05:21:31,899 RepairCoordinator.java:366 - Starting repair command #1 (46158250-39c5-11ef-9520-1f8a75ee0971), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:31,918 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(40,10]], parentRepairSession=46158250-39c5-11ef-9520-1f8a75ee0971, isIncremental=true, timestamp=1720070491908, isGlobal=true} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:31,918 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(40,10]], parentRepairSession=46158250-39c5-11ef-9520-1f8a75ee0971, isIncremental=true, timestamp=1720070491908, isGlobal=true} INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:21:31,928 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:21:31,928 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:31,931 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:57850)->/127.0.0.1:7012-SMALL_MESSAGES-5c2ff457 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:31,931 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:57850)->/127.0.0.1:7012-SMALL_MESSAGES-ee683931 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:31,935 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46158250-39c5-11ef-9520-1f8a75ee0971, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070491908, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070491, lastUpdate=1720070491} DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:31,937 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46158250-39c5-11ef-9520-1f8a75ee0971, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070491908, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070491, lastUpdate=1720070491} DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:31,935 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46158250-39c5-11ef-9520-1f8a75ee0971, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070491908, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070491, lastUpdate=1720070491} INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:31,939 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 11.455KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:31,939 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 12.129KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:31,939 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 8.125KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,948 Flushing.java:153 - Writing Memtable-x@594423325(870B serialized bytes, 30 ops, 12.129KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,948 Flushing.java:153 - Writing Memtable-x@725815057(580B serialized bytes, 20 ops, 8.125KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:31,949 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (234B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=78876) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:31,950 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (354B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=79098) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,952 Flushing.java:153 - Writing Memtable-x@238128361(870B serialized bytes, 30 ops, 11.455KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:31,954 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (354B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=100222) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:32,030 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.465KiB), biggest 5.465KiB, smallest 5.465KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:32,030 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.463KiB), biggest 5.463KiB, smallest 5.463KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:32,030 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.270KiB), biggest 5.270KiB, smallest 5.270KiB DEBUG [node3_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node3 2024-07-04 05:21:32,043 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node2_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node2 2024-07-04 05:21:32,043 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node1_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node1 2024-07-04 05:21:32,043 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node3_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node3 2024-07-04 05:21:32,044 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node2 2024-07-04 05:21:32,044 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node1 2024-07-04 05:21:32,044 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node3 2024-07-04 05:21:32,053 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node1 2024-07-04 05:21:32,054 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node3_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node3 2024-07-04 05:21:32,054 LocalSessions.java:863 - Prepare phase for incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971 completed DEBUG [node2_Repair-46158250-39c5-11ef-9520-1f8a75ee0971:1] node2 2024-07-04 05:21:32,054 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,056 CompactionManager.java:928 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] Starting anticompaction for tr.x on 1/1 sstables INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,056 CompactionManager.java:928 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] Starting anticompaction for tr.x on 1/1 sstables INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,056 CompactionManager.java:994 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (,10] INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,057 CompactionManager.java:994 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (40,] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,057 CompactionManager.java:994 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (,10] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,057 CompactionManager.java:994 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (40,] INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,057 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,057 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,058 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,058 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,178 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,178 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,178 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 46158250-39c5-11ef-9520-1f8a75ee0971. INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,179 CompactionManager.java:948 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] Completed anticompaction successfully DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,179 LocalSessions.java:863 - Prepare phase for incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971 completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:32,180 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,183 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,183 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,183 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 46158250-39c5-11ef-9520-1f8a75ee0971. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,184 CompactionManager.java:948 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971] Completed anticompaction successfully INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,185 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/tr/x-1b255f4def2540a6000000000000000c/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,185 LocalSessions.java:863 - Prepare phase for incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971 completed INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,189 CoordinatorSession.java:225 - Incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971 successfully prepared. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,190 CoordinatorSession.java:353 - Incremental repair 46158250-39c5-11ef-9520-1f8a75ee0971 prepare phase completed in 0 seconds INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,190 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.2:7012, /127.0.0.3:7012], transEndpoints=[/127.0.0.3:7012], ranges=[(40,10]], hasSkippedReplicas=false} INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,195 RepairSession.java:297 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] parentSessionId = 46158250-39c5-11ef-9520-1f8a75ee0971: new session: will sync /127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012 on range CommonRange{endpoints=[/127.0.0.2:7012, /127.0.0.3:7012], transEndpoints=[/127.0.0.3:7012], ranges=[(40,10]], hasSkippedReplicas=false} for tr.[x] INFO [node1_Repair#1:1] node1 2024-07-04 05:21:32,203 RepairJob.java:137 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] tr.x not running paxos repair INFO [node1_RepairJobTask:1] node1 2024-07-04 05:21:32,204 RepairJob.java:504 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Requesting merkle trees for x (to [/127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.1:7012]) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,208 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070492} org.apache.cassandra.repair.messages.ValidationRequest@6686315c DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,209 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070492} org.apache.cassandra.repair.messages.ValidationRequest@6686315c DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,209 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070492} org.apache.cassandra.repair.messages.ValidationRequest@6686315c DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,211 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46158250-39c5-11ef-9520-1f8a75ee0971, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070491908, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070491, lastUpdate=1720070492} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,212 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46158250-39c5-11ef-9520-1f8a75ee0971, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070491908, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070491, lastUpdate=1720070492} to REPAIRING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,213 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46158250-39c5-11ef-9520-1f8a75ee0971, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070491908, ranges=[(40,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070491, lastUpdate=1720070492} to REPAIRING INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:21:32,215 RepairMessage.java:259 - [#46158250-39c5-11ef-9520-1f8a75ee0971] VALIDATION_REQ received by /127.0.0.1:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:21:32,216 RepairMessage.java:259 - [#46158250-39c5-11ef-9520-1f8a75ee0971] VALIDATION_REQ received by /127.0.0.3:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:21:32,217 RepairMessage.java:259 - [#46158250-39c5-11ef-9520-1f8a75ee0971] VALIDATION_REQ received by /127.0.0.2:7012 INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,219 CassandraValidationIterator.java:215 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971], parentSessionId=46158250-39c5-11ef-9520-1f8a75ee0971: Performing validation compaction on 1 sstables in tr.x INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,219 CassandraValidationIterator.java:215 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971], parentSessionId=46158250-39c5-11ef-9520-1f8a75ee0971: Performing validation compaction on 0 sstables in tr.x INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,220 CassandraValidationIterator.java:215 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971], parentSessionId=46158250-39c5-11ef-9520-1f8a75ee0971: Performing validation compaction on 1 sstables in tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,233 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,236 Validator.java:158 - Prepared AEService trees of size 1 for [repair #46437020-39c5-11ef-9520-1f8a75ee0971 on tr/x, [(40,10]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,237 Validator.java:229 - Validated 0 partitions for 46437020-39c5-11ef-9520-1f8a75ee0971. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,237 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,237 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,238 Validator.java:231 - Validated 0 partitions for 46437020-39c5-11ef-9520-1f8a75ee0971. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,238 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,238 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,238 Validator.java:257 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Sending completed merkle tree to /127.0.0.1:7012 for tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,238 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 19 msec, for [repair #46437020-39c5-11ef-9520-1f8a75ee0971 on tr/x, [(40,10]]] WARN 05:21:32 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:32,241 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,241 RepairSession.java:242 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,243 Validator.java:158 - Prepared AEService trees of size 127 for [repair #46437020-39c5-11ef-9520-1f8a75ee0971 on tr/x, [(40,10]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,244 Validator.java:158 - Prepared AEService trees of size 127 for [repair #46437020-39c5-11ef-9520-1f8a75ee0971 on tr/x, [(40,10]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,250 Validator.java:229 - Validated 20 partitions for 46437020-39c5-11ef-9520-1f8a75ee0971. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,250 Validator.java:229 - Validated 20 partitions for 46437020-39c5-11ef-9520-1f8a75ee0971. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,251 EstimatedHistogram.java:337 - [0..0]: 123 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,251 EstimatedHistogram.java:337 - [1..1]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,251 EstimatedHistogram.java:337 - [2..2]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,251 EstimatedHistogram.java:337 - [3..3]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,251 EstimatedHistogram.java:337 - [0..0]: 123 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [4..9]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [1..1]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,252 Validator.java:231 - Validated 20 partitions for 46437020-39c5-11ef-9520-1f8a75ee0971. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [2..2]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [3..3]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [4..9]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 Validator.java:231 - Validated 20 partitions for 46437020-39c5-11ef-9520-1f8a75ee0971. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [0..8]: 123 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [9..57]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [58..106]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [107..155]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [0..8]: 123 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [156..441]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [9..57]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [58..106]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [107..155]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,252 EstimatedHistogram.java:337 - [156..441]: 2 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,252 Validator.java:257 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Sending completed merkle tree to /127.0.0.1:7012 for tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,253 ValidationManager.java:152 - Validation of 20 partitions (~234B) finished in 33 msec, for [repair #46437020-39c5-11ef-9520-1f8a75ee0971 on tr/x, [(40,10]]] INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,253 Validator.java:262 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Local completed merkle tree for /127.0.0.1:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:32,253 ValidationManager.java:152 - Validation of 20 partitions (~234B) finished in 35 msec, for [repair #46437020-39c5-11ef-9520-1f8a75ee0971 on tr/x, [(40,10]]] INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,253 RepairSession.java:242 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Received merkle tree for x from /127.0.0.1:7012 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,256 RepairSession.java:242 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Received merkle tree for x from /127.0.0.2:7012 INFO [node1_RepairJobTask:3] node1 2024-07-04 05:21:32,258 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 46158250-39c5-11ef-9520-1f8a75ee0971 (took: 1ms) INFO [node1_RepairJobTask:3] node1 2024-07-04 05:21:32,259 SyncTask.java:93 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Endpoints /127.0.0.2:7012 and /127.0.0.3:7012 have 1 range(s) out of sync for x INFO [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,259 SyncTask.java:93 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Endpoints /127.0.0.1:7012 and /127.0.0.3:7012 have 1 range(s) out of sync for x INFO [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,259 LocalSyncTask.java:118 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Performing streaming repair of 1 ranges with /127.0.0.3:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,261 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.1:7012, src=/127.0.0.2:7012, dst=/127.0.0.3:7012, ranges=[(40,10]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@d9d6e34 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,266 StreamingRepairTask.java:84 - [streaming task #46437020-39c5-11ef-9520-1f8a75ee0971] Performing asymmetric streaming repair of 1 ranges with /127.0.0.3:7012 INFO [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,273 StreamResultFuture.java:98 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Executing streaming plan for Repair INFO [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,274 StreamSession.java:396 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Starting streaming to 127.0.0.3:7012 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,318 StreamingRepairTask.java:87 - [streaming task #46437020-39c5-11ef-9520-1f8a75ee0971] Stream plan created in 53ms DEBUG [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,322 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,323 StreamResultFuture.java:98 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Executing streaming plan for Repair INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,323 StreamSession.java:396 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Starting streaming to 127.0.0.3:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,328 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:32,329 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:54398)->/127.0.0.3:7012-STREAMING-392fff74 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,334 StreamingMultiplexedChannel.java:473 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 channel: b3f28679] Scheduling keep-alive task with 300s period. INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:32,335 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:54406)->/127.0.0.3:7012-STREAMING-4aa041f0 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,336 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:54398 channel.id b3f28679 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,341 StreamingMultiplexedChannel.java:473 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed channel: dc196e9d] Scheduling keep-alive task with 300s period. DEBUG [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,341 StreamSession.java:596 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Changing session state from INITIALIZED to PREPARING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,341 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:54406 channel.id dc196e9d INFO [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,342 StreamCoordinator.java:268 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971, ID#0] Beginning stream session with /127.0.0.3:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,344 StreamSession.java:596 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Changing session state from INITIALIZED to PREPARING INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,344 StreamCoordinator.java:268 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed, ID#0] Beginning stream session with /127.0.0.3:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:21:32,345 RepairMessage.java:259 - [#46158250-39c5-11ef-9520-1f8a75ee0971] SYNC_REQ received by /127.0.0.2:7012 INFO [node3_Stream-Deserializer-/127.0.0.1:7012-392fff74] node3 2024-07-04 05:21:32,349 StreamResultFuture.java:123 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 ID#0] Creating new streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:54398 channel.local /127.0.0.3:7012 channel.id 392fff74 INFO [node3_Stream-Deserializer-/127.0.0.1:7012-392fff74] node3 2024-07-04 05:21:32,358 StreamResultFuture.java:131 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971, ID#0] Received streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:54398 channel.local /127.0.0.3:7012 channel.id 392fff74 INFO [node3_Stream-Deserializer-/127.0.0.2:7012-4aa041f0] node3 2024-07-04 05:21:32,358 StreamResultFuture.java:123 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed ID#0] Creating new streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:54406 channel.local /127.0.0.3:7012 channel.id 4aa041f0 INFO [node3_Stream-Deserializer-/127.0.0.2:7012-4aa041f0] node3 2024-07-04 05:21:32,359 StreamResultFuture.java:131 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed, ID#0] Received streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:54406 channel.local /127.0.0.3:7012 channel.id 4aa041f0 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-4aa041f0] node3 2024-07-04 05:21:32,359 StreamDeserializingTask.java:132 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed channel: 4aa041f0] Received StreamInitMessage: from = /127.0.0.2:7012, planId = 464e93b0-39c5-11ef-be06-a3f8887dcaed, session index = 0 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-392fff74] node3 2024-07-04 05:21:32,359 StreamDeserializingTask.java:132 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 channel: 392fff74] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 464d8240-39c5-11ef-9520-1f8a75ee0971, session index = 0 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-4aa041f0] node3 2024-07-04 05:21:32,360 StreamDeserializingTask.java:132 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed channel: 4aa041f0] Received Prepare SYN (1 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-392fff74] node3 2024-07-04 05:21:32,360 StreamDeserializingTask.java:132 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 channel: 392fff74] Received Prepare SYN (1 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-4aa041f0] node3 2024-07-04 05:21:32,360 StreamSession.java:596 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Changing session state from INITIALIZED to PREPARING DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-392fff74] node3 2024-07-04 05:21:32,360 StreamSession.java:596 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Changing session state from INITIALIZED to PREPARING DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,363 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,364 StreamResultFuture.java:187 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,370 StreamSession.java:596 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Changing session state from PREPARING to COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,370 StreamDeserializingTask.java:132 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed channel: dc196e9d] Received Prepare SYNACK ( 0 files} INFO [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,371 StreamResultFuture.java:187 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,371 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,372 StreamResultFuture.java:187 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,372 StreamSession.java:596 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Changing session state from PREPARING to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,372 StreamDeserializingTask.java:132 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 channel: b3f28679] Received Prepare SYNACK ( 0 files} DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,372 StreamSession.java:596 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Changing session state from COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,372 StreamResultFuture.java:201 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Session with /127.0.0.2:7012 is complete INFO [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,373 StreamResultFuture.java:187 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,374 StreamResultFuture.java:260 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] All sessions completed DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,374 StreamSession.java:596 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Changing session state from PREPARING to STREAMING DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,374 StreamSession.java:596 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Changing session state from COMPLETE to COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,374 StreamSession.java:596 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Changing session state from STREAMING to WAIT_COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,374 StreamResultFuture.java:201 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Session with /127.0.0.1:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,375 StreamResultFuture.java:260 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] All sessions completed DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,375 StreamDeserializingTask.java:132 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed channel: dc196e9d] Received Complete DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,375 StreamSession.java:1128 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] handling Complete message, state = WAIT_COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,375 StreamSession.java:596 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,375 StreamResultFuture.java:201 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Session with /127.0.0.3:7012 is complete DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,376 StreamSession.java:596 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Changing session state from PREPARING to STREAMING DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,376 StreamSession.java:596 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,376 StreamDeserializingTask.java:132 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971 channel: b3f28679] Received Complete DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,376 StreamSession.java:1128 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] handling Complete message, state = WAIT_COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,376 StreamResultFuture.java:260 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] All sessions completed DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:32,377 StreamSession.java:596 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:32,377 StreamResultFuture.java:201 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Session with /127.0.0.3:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,377 StreamingRepairTask.java:121 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] streaming task succeed, returning response to /127.0.0.1:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:32,378 StreamResultFuture.java:260 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] All sessions completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:32,379 LocalSyncTask.java:168 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Sync complete using session 46437020-39c5-11ef-9520-1f8a75ee0971 between /127.0.0.1:7012 and /127.0.0.3:7012 on x DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,379 StreamSession.java:564 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Will close attached inbound {dc196e9d=org.apache.cassandra.streaming.async.NettyStreamingChannel@622ccb8e} and outbound {dc196e9d=org.apache.cassandra.streaming.async.NettyStreamingChannel@622ccb8e} channels DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:32,379 StreamSession.java:564 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Will close attached inbound {b3f28679=org.apache.cassandra.streaming.async.NettyStreamingChannel@26b3f317} and outbound {b3f28679=org.apache.cassandra.streaming.async.NettyStreamingChannel@26b3f317} channels DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,380 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-dc196e9d] node2 2024-07-04 05:21:32,380 StreamSession.java:712 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-1] node1 2024-07-04 05:21:32,380 StreamingMultiplexedChannel.java:514 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Closing stream connection channels on /127.0.0.3:7012 DEBUG [Streaming-EventLoop-4-1] node2 2024-07-04 05:21:32,380 StreamingMultiplexedChannel.java:514 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:32,381 StreamingMultiplexedChannel.java:514 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:32,381 StreamingMultiplexedChannel.java:514 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,381 RepairSession.java:263 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Repair completed between /127.0.0.2:7012 and /127.0.0.3:7012 on x INFO [node1_RepairJobTask:4] node1 2024-07-04 05:21:32,382 RepairJob.java:210 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] tr.x is fully synced DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,382 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-b3f28679] node1 2024-07-04 05:21:32,382 StreamSession.java:712 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Socket closed after session completed with state COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-4aa041f0] node3 2024-07-04 05:21:32,382 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-392fff74] node3 2024-07-04 05:21:32,382 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-4aa041f0] node3 2024-07-04 05:21:32,383 StreamSession.java:712 - [Stream #464e93b0-39c5-11ef-be06-a3f8887dcaed] Socket closed after session completed with state COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-392fff74] node3 2024-07-04 05:21:32,383 StreamSession.java:712 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Socket closed after session completed with state COMPLETE INFO [node1_RepairJobTask:3] node1 2024-07-04 05:21:32,385 RepairSession.java:355 - [repair #46437020-39c5-11ef-9520-1f8a75ee0971] Session completed successfully INFO [node1_RepairJobTask:3] node1 2024-07-04 05:21:32,386 RepairCoordinator.java:191 - Repair session 46437020-39c5-11ef-9520-1f8a75ee0971 for range [(40,10]] finished DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:21:32,386 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=46437020-39c5-11ef-9520-1f8a75ee0971, keyspace='tr', ranges=[(40,10]], repairJobResults=[org.apache.cassandra.repair.RepairResult@830bbf1], skippedReplicas=false}] INFO [node1_RepairJobTask:3] node1 2024-07-04 05:21:32,388 CoordinatorSession.java:242 - Proposing finalization of repair session 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:21:32,390 StreamSession.java:1379 - [Stream #464d8240-39c5-11ef-9520-1f8a75ee0971] Stream session with peer /127.0.0.3:7012 is already in a final state on abort. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,391 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.231KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,392 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.230KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,392 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.232KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:32,405 Flushing.java:153 - Writing Memtable-repairs@342125979(475B serialized bytes, 4 ops, 3.231KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:32,405 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=102187) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:32,415 Flushing.java:153 - Writing Memtable-repairs@1280489858(475B serialized bytes, 4 ops, 3.232KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:32,415 Flushing.java:153 - Writing Memtable-repairs@1896874579(475B serialized bytes, 4 ops, 3.230KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:32,415 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=80511) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:32,415 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=81248) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:32,486 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:32,487 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:32,487 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.832KiB), biggest 5.832KiB, smallest 5.832KiB DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,487 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971, responded with FinalizePromise DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,487 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971, responded with FinalizePromise DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,487 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971, responded with FinalizePromise INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,488 CoordinatorSession.java:278 - Finalization proposal for repair session 46158250-39c5-11ef-9520-1f8a75ee0971 accepted by all participants. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,488 CoordinatorSession.java:373 - Incremental repair 46158250-39c5-11ef-9520-1f8a75ee0971 finalization phase completed in 0 seconds INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,488 CoordinatorSession.java:287 - Committing finalization of repair session 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,489 CoordinatorSessions.java:97 - Removing completed session 46158250-39c5-11ef-9520-1f8a75ee0971 with state FINALIZED INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,489 CoordinatorSession.java:294 - Incremental repair session 46158250-39c5-11ef-9520-1f8a75ee0971 completed DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,489 CoordinatorSession.java:376 - Incremental repair 46158250-39c5-11ef-9520-1f8a75ee0971 phase completed in 0 seconds INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,493 RepairCoordinator.java:250 - [repair #46158250-39c5-11ef-9520-1f8a75ee0971]Repair command #1 finished in 0 seconds DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,494 LocalSessions.java:1010 - Finalized local repair session 46158250-39c5-11ef-9520-1f8a75ee0971 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,494 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070491908 and session id = 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,497 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 46158250-39c5-11ef-9520-1f8a75ee0971 on tr.x DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,497 LocalSessions.java:1010 - Finalized local repair session 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,498 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:32,499 LocalSessions.java:1010 - Finalized local repair session 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,499 RepairMessageVerbHandler.java:290 - cleaning up repair INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,499 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070491908 and session id = 46158250-39c5-11ef-9520-1f8a75ee0971 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:32,501 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 46158250-39c5-11ef-9520-1f8a75ee0971 on tr.x INFO [node2_Repair-Task:1] node2 2024-07-04 05:21:32,597 RepairCoordinator.java:366 - Starting repair command #1 (46807920-39c5-11ef-be06-a3f8887dcaed), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,608 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(10,20]], parentRepairSession=46807920-39c5-11ef-be06-a3f8887dcaed, isIncremental=true, timestamp=1720070492607, isGlobal=true} DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,613 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(10,20]], parentRepairSession=46807920-39c5-11ef-be06-a3f8887dcaed, isIncremental=true, timestamp=1720070492607, isGlobal=true} INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:21:32,621 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:21:32,621 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,623 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46807920-39c5-11ef-be06-a3f8887dcaed, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070492607, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070492, lastUpdate=1720070492} INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:32,624 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:60488)->/127.0.0.2:7012-SMALL_MESSAGES-e2c169da successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:32,624 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:60488)->/127.0.0.2:7012-SMALL_MESSAGES-bbb4a5ec messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node3 2024-07-04 05:21:32,625 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node3_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node3 2024-07-04 05:21:32,625 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node3 2024-07-04 05:21:32,625 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,626 CompactionManager.java:928 - [repair #46807920-39c5-11ef-be06-a3f8887dcaed] Starting anticompaction for tr.x on 1/1 sstables DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,626 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46807920-39c5-11ef-be06-a3f8887dcaed, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070492607, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070492, lastUpdate=1720070492} INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,627 CompactionManager.java:994 - [repair #46807920-39c5-11ef-be06-a3f8887dcaed] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([11,30]) will be anticompacted on range (10,20] INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,627 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node2_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node2 2024-07-04 05:21:32,627 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node2_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node2 2024-07-04 05:21:32,627 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,627 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node2_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node2 2024-07-04 05:21:32,628 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,628 CompactionManager.java:928 - [repair #46807920-39c5-11ef-be06-a3f8887dcaed] Starting anticompaction for tr.x on 1/2 sstables INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,628 CompactionManager.java:987 - [repair #46807920-39c5-11ef-be06-a3f8887dcaed] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (10,20], mutating repairedAt instead of anticompacting DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,629 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46807920-39c5-11ef-be06-a3f8887dcaed, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070492607, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070492, lastUpdate=1720070492} DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,630 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 46807920-39c5-11ef-be06-a3f8887dcaed INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,630 CompactionManager.java:948 - [repair #46807920-39c5-11ef-be06-a3f8887dcaed] Completed anticompaction successfully DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,630 LocalSessions.java:863 - Prepare phase for incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed completed INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,631 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 8.086KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:32,639 Flushing.java:153 - Writing Memtable-x@389344659(580B serialized bytes, 20 ops, 8.086KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:32,641 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db (234B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=78683) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:32,676 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] (1 sstables, 5.267KiB), biggest 5.267KiB, smallest 5.267KiB DEBUG [node4_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node4 2024-07-04 05:21:32,677 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node4_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node4 2024-07-04 05:21:32,678 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node4 2024-07-04 05:21:32,678 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node4_Repair-46807920-39c5-11ef-be06-a3f8887dcaed:1] node4 2024-07-04 05:21:32,679 LocalSessions.java:863 - Prepare phase for incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed completed DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,731 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 46807920-39c5-11ef-be06-a3f8887dcaed INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,732 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 46807920-39c5-11ef-be06-a3f8887dcaed INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,732 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 46807920-39c5-11ef-be06-a3f8887dcaed. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,732 CompactionManager.java:948 - [repair #46807920-39c5-11ef-be06-a3f8887dcaed] Completed anticompaction successfully DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,733 LocalSessions.java:863 - Prepare phase for incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,734 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,735 CoordinatorSession.java:225 - Incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed successfully prepared. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,736 CoordinatorSession.java:353 - Incremental repair 46807920-39c5-11ef-be06-a3f8887dcaed prepare phase completed in 0 seconds INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,737 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.3:7012, /127.0.0.4:7012], transEndpoints=[/127.0.0.4:7012], ranges=[(10,20]], hasSkippedReplicas=false} INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,739 RepairSession.java:297 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] parentSessionId = 46807920-39c5-11ef-be06-a3f8887dcaed: new session: will sync /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012 on range CommonRange{endpoints=[/127.0.0.3:7012, /127.0.0.4:7012], transEndpoints=[/127.0.0.4:7012], ranges=[(10,20]], hasSkippedReplicas=false} for tr.[x] INFO [node2_Repair#1:1] node2 2024-07-04 05:21:32,746 RepairJob.java:137 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] tr.x not running paxos repair INFO [node2_RepairJobTask:1] node2 2024-07-04 05:21:32,747 RepairJob.java:504 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Requesting merkle trees for x (to [/127.0.0.3:7012, /127.0.0.4:7012, /127.0.0.2:7012]) DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,749 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070492} org.apache.cassandra.repair.messages.ValidationRequest@6686315c DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,749 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070492} org.apache.cassandra.repair.messages.ValidationRequest@6686315c DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,749 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46807920-39c5-11ef-be06-a3f8887dcaed, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070492607, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070492, lastUpdate=1720070492} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,749 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46807920-39c5-11ef-be06-a3f8887dcaed, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070492607, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070492, lastUpdate=1720070492} to REPAIRING DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,750 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070492} org.apache.cassandra.repair.messages.ValidationRequest@6686315c INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,752 CassandraValidationIterator.java:215 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed], parentSessionId=46807920-39c5-11ef-be06-a3f8887dcaed: Performing validation compaction on 1 sstables in tr.x INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:21:32,752 RepairMessage.java:259 - [#46807920-39c5-11ef-be06-a3f8887dcaed] VALIDATION_REQ received by /127.0.0.3:7012 INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,753 CassandraValidationIterator.java:215 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed], parentSessionId=46807920-39c5-11ef-be06-a3f8887dcaed: Performing validation compaction on 1 sstables in tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,754 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,754 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46807920-39c5-11ef-be06-a3f8887dcaed, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070492607, ranges=[(10,20]], participants=[/127.0.0.4:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070492, lastUpdate=1720070492} to REPAIRING DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,754 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:21:32,757 RepairMessage.java:259 - [#46807920-39c5-11ef-be06-a3f8887dcaed] VALIDATION_REQ received by /127.0.0.2:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,758 Validator.java:158 - Prepared AEService trees of size 127 for [repair #46967220-39c5-11ef-be06-a3f8887dcaed on tr/x, [(10,20]]] INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:21:32,759 RepairMessage.java:259 - [#46807920-39c5-11ef-be06-a3f8887dcaed] VALIDATION_REQ received by /127.0.0.4:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,760 Validator.java:229 - Validated 10 partitions for 46967220-39c5-11ef-be06-a3f8887dcaed. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,761 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,761 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,761 Validator.java:231 - Validated 10 partitions for 46967220-39c5-11ef-be06-a3f8887dcaed. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,761 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,761 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,761 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,762 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,762 EstimatedHistogram.java:337 - [65..196]: 2 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,762 Validator.java:158 - Prepared AEService trees of size 127 for [repair #46967220-39c5-11ef-be06-a3f8887dcaed on tr/x, [(10,20]]] INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,762 Validator.java:262 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Local completed merkle tree for /127.0.0.2:7012 for tr.x WARN 05:21:32 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,762 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,763 RepairSession.java:242 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Received merkle tree for x from /127.0.0.2:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:32,763 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 10 msec, for [repair #46967220-39c5-11ef-be06-a3f8887dcaed on tr/x, [(10,20]]] INFO [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,764 CassandraValidationIterator.java:215 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed], parentSessionId=46807920-39c5-11ef-be06-a3f8887dcaed: Performing validation compaction on 0 sstables in tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,767 Validator.java:229 - Validated 10 partitions for 46967220-39c5-11ef-be06-a3f8887dcaed. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,768 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,768 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,768 Validator.java:231 - Validated 10 partitions for 46967220-39c5-11ef-be06-a3f8887dcaed. Partition sizes are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,773 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,773 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,773 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,773 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,774 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,774 Validator.java:257 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Sending completed merkle tree to /127.0.0.2:7012 for tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:32,774 ValidationManager.java:152 - Validation of 10 partitions (~114B) finished in 22 msec, for [repair #46967220-39c5-11ef-be06-a3f8887dcaed on tr/x, [(10,20]]] DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,775 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,776 Validator.java:158 - Prepared AEService trees of size 1 for [repair #46967220-39c5-11ef-be06-a3f8887dcaed on tr/x, [(10,20]]] DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,777 Validator.java:229 - Validated 0 partitions for 46967220-39c5-11ef-be06-a3f8887dcaed. Partitions per leaf are: INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,777 RepairSession.java:242 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,778 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,778 Validator.java:231 - Validated 0 partitions for 46967220-39c5-11ef-be06-a3f8887dcaed. Partition sizes are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,778 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,778 Validator.java:257 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Sending completed merkle tree to /127.0.0.2:7012 for tr.x DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:32,778 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 16 msec, for [repair #46967220-39c5-11ef-be06-a3f8887dcaed on tr/x, [(10,20]]] INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,780 RepairSession.java:242 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Received merkle tree for x from /127.0.0.4:7012 INFO [node2_RepairJobTask:3] node2 2024-07-04 05:21:32,782 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 46807920-39c5-11ef-be06-a3f8887dcaed (took: 2ms) INFO [node2_RepairJobTask:3] node2 2024-07-04 05:21:32,782 SyncTask.java:93 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Endpoints /127.0.0.3:7012 and /127.0.0.4:7012 have 1 range(s) out of sync for x INFO [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,782 SyncTask.java:93 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Endpoints /127.0.0.2:7012 and /127.0.0.4:7012 have 1 range(s) out of sync for x INFO [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,782 LocalSyncTask.java:118 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Performing streaming repair of 1 ranges with /127.0.0.4:7012 INFO [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,783 StreamResultFuture.java:98 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Executing streaming plan for Repair INFO [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,783 StreamSession.java:396 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Starting streaming to 127.0.0.4:7012 DEBUG [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,783 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.4:7012 as initiator DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,784 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.2:7012, src=/127.0.0.3:7012, dst=/127.0.0.4:7012, ranges=[(10,20]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@7d7a04a4 DEBUG [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,786 StreamingMultiplexedChannel.java:473 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed channel: 83e2f150] Scheduling keep-alive task with 300s period. DEBUG [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,786 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:58996 channel.id 83e2f150 DEBUG [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,787 StreamSession.java:596 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Changing session state from INITIALIZED to PREPARING INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,787 StreamingRepairTask.java:84 - [streaming task #46967220-39c5-11ef-be06-a3f8887dcaed] Performing asymmetric streaming repair of 1 ranges with /127.0.0.4:7012 INFO [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,787 StreamCoordinator.java:268 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed, ID#0] Beginning stream session with /127.0.0.4:7012 INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:32,788 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:58996)->/127.0.0.4:7012-STREAMING-3bc5dc75 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,790 StreamingRepairTask.java:87 - [streaming task #46967220-39c5-11ef-be06-a3f8887dcaed] Stream plan created in 2ms INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,790 StreamResultFuture.java:98 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Executing streaming plan for Repair INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,790 StreamSession.java:396 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Starting streaming to 127.0.0.4:7012 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,791 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.4:7012 as initiator INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:32,794 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:59004)->/127.0.0.4:7012-STREAMING-c3de1c71 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,795 StreamingMultiplexedChannel.java:473 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c channel: 3c6d72e2] Scheduling keep-alive task with 300s period. INFO [node4_Stream-Deserializer-/127.0.0.2:7012-3bc5dc75] node4 2024-07-04 05:21:32,795 StreamResultFuture.java:123 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed ID#0] Creating new streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:58996 channel.local /127.0.0.4:7012 channel.id 3bc5dc75 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,795 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:59004 channel.id 3c6d72e2 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,796 StreamSession.java:596 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Changing session state from INITIALIZED to PREPARING INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,797 StreamCoordinator.java:268 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c, ID#0] Beginning stream session with /127.0.0.4:7012 INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:21:32,798 RepairMessage.java:259 - [#46807920-39c5-11ef-be06-a3f8887dcaed] SYNC_REQ received by /127.0.0.3:7012 INFO [node4_Stream-Deserializer-/127.0.0.2:7012-3bc5dc75] node4 2024-07-04 05:21:32,804 StreamResultFuture.java:131 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed, ID#0] Received streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:58996 channel.local /127.0.0.4:7012 channel.id 3bc5dc75 INFO [node4_Stream-Deserializer-/127.0.0.3:7012-c3de1c71] node4 2024-07-04 05:21:32,805 StreamResultFuture.java:123 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c ID#0] Creating new streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:59004 channel.local /127.0.0.4:7012 channel.id c3de1c71 INFO [node4_Stream-Deserializer-/127.0.0.3:7012-c3de1c71] node4 2024-07-04 05:21:32,805 StreamResultFuture.java:131 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c, ID#0] Received streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:59004 channel.local /127.0.0.4:7012 channel.id c3de1c71 DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-c3de1c71] node4 2024-07-04 05:21:32,805 StreamDeserializingTask.java:132 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c channel: c3de1c71] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 469e1340-39c5-11ef-99a4-a939d1f9f39c, session index = 0 DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3bc5dc75] node4 2024-07-04 05:21:32,805 StreamDeserializingTask.java:132 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed channel: 3bc5dc75] Received StreamInitMessage: from = /127.0.0.2:7012, planId = 469d28e0-39c5-11ef-be06-a3f8887dcaed, session index = 0 DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-c3de1c71] node4 2024-07-04 05:21:32,806 StreamDeserializingTask.java:132 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c channel: c3de1c71] Received Prepare SYN (1 requests, 0 files} DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3bc5dc75] node4 2024-07-04 05:21:32,806 StreamDeserializingTask.java:132 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed channel: 3bc5dc75] Received Prepare SYN (1 requests, 0 files} DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-c3de1c71] node4 2024-07-04 05:21:32,806 StreamSession.java:596 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Changing session state from INITIALIZED to PREPARING DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3bc5dc75] node4 2024-07-04 05:21:32,806 StreamSession.java:596 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Changing session state from INITIALIZED to PREPARING DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,809 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,810 StreamResultFuture.java:187 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,814 StreamSession.java:596 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,814 StreamDeserializingTask.java:132 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c channel: 3c6d72e2] Received Prepare SYNACK ( 0 files} INFO [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,814 StreamResultFuture.java:187 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,814 StreamSession.java:596 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,815 StreamSession.java:596 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,815 StreamDeserializingTask.java:132 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c channel: 3c6d72e2] Received Complete DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,815 StreamSession.java:1128 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] handling Complete message, state = WAIT_COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,815 StreamSession.java:596 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,815 StreamResultFuture.java:201 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Session with /127.0.0.4:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,815 StreamResultFuture.java:260 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] All sessions completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,815 StreamingRepairTask.java:121 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] streaming task succeed, returning response to /127.0.0.2:7012 DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,815 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,816 StreamResultFuture.java:187 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,816 StreamSession.java:596 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Changing session state from PREPARING to COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,816 StreamSession.java:596 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Changing session state from COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,816 StreamResultFuture.java:201 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Session with /127.0.0.3:7012 is complete DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,817 StreamDeserializingTask.java:132 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed channel: 83e2f150] Received Prepare SYNACK ( 0 files} INFO [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,817 StreamResultFuture.java:187 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,817 StreamSession.java:596 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Changing session state from PREPARING to STREAMING DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,817 StreamSession.java:596 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,817 StreamDeserializingTask.java:132 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed channel: 83e2f150] Received Complete DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,817 StreamSession.java:1128 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] handling Complete message, state = WAIT_COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,817 StreamSession.java:596 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,817 StreamResultFuture.java:201 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Session with /127.0.0.4:7012 is complete DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:32,817 StreamSession.java:564 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Will close attached inbound {3c6d72e2=org.apache.cassandra.streaming.async.NettyStreamingChannel@efec474} and outbound {3c6d72e2=org.apache.cassandra.streaming.async.NettyStreamingChannel@efec474} channels INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,817 StreamResultFuture.java:260 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] All sessions completed INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,817 StreamResultFuture.java:260 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] All sessions completed DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,818 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,818 LocalSyncTask.java:168 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Sync complete using session 46967220-39c5-11ef-be06-a3f8887dcaed between /127.0.0.2:7012 and /127.0.0.4:7012 on x DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-3c6d72e2] node3 2024-07-04 05:21:32,818 StreamSession.java:712 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Socket closed after session completed with state COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:32,818 StreamSession.java:564 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Will close attached inbound {83e2f150=org.apache.cassandra.streaming.async.NettyStreamingChannel@7e252048} and outbound {83e2f150=org.apache.cassandra.streaming.async.NettyStreamingChannel@7e252048} channels DEBUG [Streaming-EventLoop-4-1] node3 2024-07-04 05:21:32,818 StreamingMultiplexedChannel.java:514 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,818 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-83e2f150] node2 2024-07-04 05:21:32,818 StreamSession.java:712 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node2 2024-07-04 05:21:32,818 StreamingMultiplexedChannel.java:514 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,819 RepairSession.java:263 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Repair completed between /127.0.0.3:7012 and /127.0.0.4:7012 on x INFO [node2_RepairJobTask:4] node2 2024-07-04 05:21:32,819 RepairJob.java:210 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] tr.x is fully synced DEBUG [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:32,819 StreamingMultiplexedChannel.java:514 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:32,820 StreamingMultiplexedChannel.java:514 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,820 StreamSession.java:596 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Changing session state from COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,820 StreamResultFuture.java:201 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Session with /127.0.0.2:7012 is complete INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:32,820 StreamResultFuture.java:260 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] All sessions completed DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3bc5dc75] node4 2024-07-04 05:21:32,821 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-c3de1c71] node4 2024-07-04 05:21:32,821 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3bc5dc75] node4 2024-07-04 05:21:32,821 StreamSession.java:712 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Socket closed after session completed with state COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-c3de1c71] node4 2024-07-04 05:21:32,821 StreamSession.java:712 - [Stream #469e1340-39c5-11ef-99a4-a939d1f9f39c] Socket closed after session completed with state COMPLETE INFO [node2_RepairJobTask:3] node2 2024-07-04 05:21:32,822 RepairSession.java:355 - [repair #46967220-39c5-11ef-be06-a3f8887dcaed] Session completed successfully INFO [node2_RepairJobTask:3] node2 2024-07-04 05:21:32,823 RepairCoordinator.java:191 - Repair session 46967220-39c5-11ef-be06-a3f8887dcaed for range [(10,20]] finished DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:21:32,823 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=46967220-39c5-11ef-be06-a3f8887dcaed, keyspace='tr', ranges=[(10,20]], repairJobResults=[org.apache.cassandra.repair.RepairResult@c8d7f03], skippedReplicas=false}] INFO [node2_RepairJobTask:3] node2 2024-07-04 05:21:32,824 CoordinatorSession.java:242 - Proposing finalization of repair session 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:21:32,825 StreamSession.java:1379 - [Stream #469d28e0-39c5-11ef-be06-a3f8887dcaed] Stream session with peer /127.0.0.4:7012 is already in a final state on abort. INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,826 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,827 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,827 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.230KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:32,840 Flushing.java:153 - Writing Memtable-repairs@672874193(950B serialized bytes, 5 ops, 6.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:32,840 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=83943) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:32,845 Flushing.java:153 - Writing Memtable-repairs@2120395175(475B serialized bytes, 4 ops, 3.230KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:32,845 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=79700) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:32,845 Flushing.java:153 - Writing Memtable-repairs@2098771868(950B serialized bytes, 5 ops, 6.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:32,846 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=83351) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:32,902 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.938KiB), biggest 5.938KiB, smallest 5.938KiB DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,902 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed, responded with FinalizePromise DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:32,904 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.830KiB), biggest 5.830KiB, smallest 5.830KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:32,904 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.938KiB), biggest 5.938KiB, smallest 5.938KiB DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,904 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed, responded with FinalizePromise DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,905 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed, responded with FinalizePromise INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,905 CoordinatorSession.java:278 - Finalization proposal for repair session 46807920-39c5-11ef-be06-a3f8887dcaed accepted by all participants. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,906 CoordinatorSession.java:373 - Incremental repair 46807920-39c5-11ef-be06-a3f8887dcaed finalization phase completed in 0 seconds INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,906 CoordinatorSession.java:287 - Committing finalization of repair session 46807920-39c5-11ef-be06-a3f8887dcaed INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,906 CoordinatorSessions.java:97 - Removing completed session 46807920-39c5-11ef-be06-a3f8887dcaed with state FINALIZED INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,906 CoordinatorSession.java:294 - Incremental repair session 46807920-39c5-11ef-be06-a3f8887dcaed completed DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,906 CoordinatorSession.java:376 - Incremental repair 46807920-39c5-11ef-be06-a3f8887dcaed phase completed in 0 seconds INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,911 RepairCoordinator.java:250 - [repair #46807920-39c5-11ef-be06-a3f8887dcaed]Repair command #1 finished in 0 seconds DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,911 LocalSessions.java:1010 - Finalized local repair session 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:32,912 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:32,913 LocalSessions.java:1010 - Finalized local repair session 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,914 LocalSessions.java:1010 - Finalized local repair session 46807920-39c5-11ef-be06-a3f8887dcaed INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,914 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070492607 and session id = 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:32,914 RepairMessageVerbHandler.java:290 - cleaning up repair INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,914 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070492607 and session id = 46807920-39c5-11ef-be06-a3f8887dcaed DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:32,915 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 46807920-39c5-11ef-be06-a3f8887dcaed on tr.x DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:32,916 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 46807920-39c5-11ef-be06-a3f8887dcaed on tr.x INFO [node3_Repair-Task:1] node3 2024-07-04 05:21:33,031 RepairCoordinator.java:366 - Starting repair command #1 (46c2d950-39c5-11ef-99a4-a939d1f9f39c), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,044 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(20,30]], parentRepairSession=46c2d950-39c5-11ef-99a4-a939d1f9f39c, isIncremental=true, timestamp=1720070493042, isGlobal=true} DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,044 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(20,30]], parentRepairSession=46c2d950-39c5-11ef-99a4-a939d1f9f39c, isIncremental=true, timestamp=1720070493042, isGlobal=true} INFO [node3_RequestResponseStage-2] node3 2024-07-04 05:21:33,050 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node3_RequestResponseStage-2] node3 2024-07-04 05:21:33,051 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,054 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46c2d950-39c5-11ef-99a4-a939d1f9f39c, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493042, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070493, lastUpdate=1720070493} INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:33,054 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:54414)->/127.0.0.3:7012-SMALL_MESSAGES-48c8a9ba messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:33,055 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:54414)->/127.0.0.3:7012-SMALL_MESSAGES-d28e031a successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node4 2024-07-04 05:21:33,055 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node4_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node4 2024-07-04 05:21:33,055 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node4 2024-07-04 05:21:33,056 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,057 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46c2d950-39c5-11ef-99a4-a939d1f9f39c, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493042, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070493, lastUpdate=1720070493} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,057 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=46c2d950-39c5-11ef-99a4-a939d1f9f39c, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493042, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070493, lastUpdate=1720070493} INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,058 CompactionManager.java:928 - [repair #46c2d950-39c5-11ef-99a4-a939d1f9f39c] Starting anticompaction for tr.x on 1/1 sstables INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,058 CompactionManager.java:994 - [repair #46c2d950-39c5-11ef-99a4-a939d1f9f39c] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db') ([21,40]) will be anticompacted on range (20,30] INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,059 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node3_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node3 2024-07-04 05:21:33,059 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,059 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x for 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node3_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node3 2024-07-04 05:21:33,060 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node3 2024-07-04 05:21:33,060 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:33,060 CompactionManager.java:928 - [repair #46c2d950-39c5-11ef-99a4-a939d1f9f39c] Starting anticompaction for tr.x on 1/2 sstables INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:33,060 CompactionManager.java:987 - [repair #46c2d950-39c5-11ef-99a4-a939d1f9f39c] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (20,30], mutating repairedAt instead of anticompacting DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:33,062 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:33,063 CompactionManager.java:948 - [repair #46c2d950-39c5-11ef-99a4-a939d1f9f39c] Completed anticompaction successfully DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:33,063 LocalSessions.java:863 - Prepare phase for incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c completed DEBUG [node1_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node1 2024-07-04 05:21:33,064 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node1_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node1 2024-07-04 05:21:33,064 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node1 2024-07-04 05:21:33,065 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_Repair-46c2d950-39c5-11ef-99a4-a939d1f9f39c:1] node1 2024-07-04 05:21:33,065 LocalSessions.java:863 - Prepare phase for incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c completed DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,141 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,141 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] for 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,141 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 46c2d950-39c5-11ef-99a4-a939d1f9f39c. INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,142 CompactionManager.java:948 - [repair #46c2d950-39c5-11ef-99a4-a939d1f9f39c] Completed anticompaction successfully DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,142 LocalSessions.java:863 - Prepare phase for incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c completed INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,143 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data2/tr/x-1b255f4def2540a6000000000000000c/oa-1-big INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,144 CoordinatorSession.java:225 - Incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c successfully prepared. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,146 CoordinatorSession.java:353 - Incremental repair 46c2d950-39c5-11ef-99a4-a939d1f9f39c prepare phase completed in 0 seconds INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,146 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.4:7012, /127.0.0.1:7012], transEndpoints=[/127.0.0.1:7012], ranges=[(20,30]], hasSkippedReplicas=false} INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,149 RepairSession.java:297 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] parentSessionId = 46c2d950-39c5-11ef-99a4-a939d1f9f39c: new session: will sync /127.0.0.3:7012, /127.0.0.4:7012, /127.0.0.1:7012 on range CommonRange{endpoints=[/127.0.0.4:7012, /127.0.0.1:7012], transEndpoints=[/127.0.0.1:7012], ranges=[(20,30]], hasSkippedReplicas=false} for tr.[x] INFO [node3_Repair#1:1] node3 2024-07-04 05:21:33,158 RepairJob.java:137 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] tr.x not running paxos repair INFO [node3_RepairJobTask:1] node3 2024-07-04 05:21:33,159 RepairJob.java:504 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Requesting merkle trees for x (to [/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012]) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,161 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070493} org.apache.cassandra.repair.messages.ValidationRequest@6686315d DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,161 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070493} org.apache.cassandra.repair.messages.ValidationRequest@6686315d DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,161 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070493} org.apache.cassandra.repair.messages.ValidationRequest@6686315d DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,162 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46c2d950-39c5-11ef-99a4-a939d1f9f39c, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493042, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070493, lastUpdate=1720070493} to REPAIRING DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,162 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46c2d950-39c5-11ef-99a4-a939d1f9f39c, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493042, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070493, lastUpdate=1720070493} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,162 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=46c2d950-39c5-11ef-99a4-a939d1f9f39c, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493042, ranges=[(20,30]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.3:7012], startedAt=1720070493, lastUpdate=1720070493} to REPAIRING INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,164 CassandraValidationIterator.java:215 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c], parentSessionId=46c2d950-39c5-11ef-99a4-a939d1f9f39c: Performing validation compaction on 0 sstables in tr.x INFO [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,164 CassandraValidationIterator.java:215 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c], parentSessionId=46c2d950-39c5-11ef-99a4-a939d1f9f39c: Performing validation compaction on 1 sstables in tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,164 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,165 Validator.java:158 - Prepared AEService trees of size 1 for [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c on tr/x, [(20,30]]] INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,165 CassandraValidationIterator.java:215 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c], parentSessionId=46c2d950-39c5-11ef-99a4-a939d1f9f39c: Performing validation compaction on 1 sstables in tr.x INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:21:33,165 RepairMessage.java:259 - [#46c2d950-39c5-11ef-99a4-a939d1f9f39c] VALIDATION_REQ received by /127.0.0.1:7012 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,165 Validator.java:229 - Validated 0 partitions for 46d501c0-39c5-11ef-99a4-a939d1f9f39c. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,165 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,165 Validator.java:231 - Validated 0 partitions for 46d501c0-39c5-11ef-99a4-a939d1f9f39c. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,165 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,165 Validator.java:257 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Sending completed merkle tree to /127.0.0.3:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,165 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 1 msec, for [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c on tr/x, [(20,30]]] INFO [node3_RequestResponseStage-2] node3 2024-07-04 05:21:33,165 RepairMessage.java:259 - [#46c2d950-39c5-11ef-99a4-a939d1f9f39c] VALIDATION_REQ received by /127.0.0.4:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,166 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:21:33,166 RepairMessage.java:259 - [#46c2d950-39c5-11ef-99a4-a939d1f9f39c] VALIDATION_REQ received by /127.0.0.3:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,166 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes WARN 05:21:33 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:33,167 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,167 RepairSession.java:242 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Received merkle tree for x from /127.0.0.1:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,170 Validator.java:158 - Prepared AEService trees of size 127 for [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c on tr/x, [(20,30]]] DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,172 Validator.java:158 - Prepared AEService trees of size 127 for [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c on tr/x, [(20,30]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,173 Validator.java:229 - Validated 10 partitions for 46d501c0-39c5-11ef-99a4-a939d1f9f39c. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,173 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,173 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,173 Validator.java:231 - Validated 10 partitions for 46d501c0-39c5-11ef-99a4-a939d1f9f39c. Partition sizes are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,174 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,174 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,174 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,174 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,174 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,174 Validator.java:262 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Local completed merkle tree for /127.0.0.3:7012 for tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:21:33,174 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 9 msec, for [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c on tr/x, [(20,30]]] INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,174 RepairSession.java:242 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,178 Validator.java:229 - Validated 10 partitions for 46d501c0-39c5-11ef-99a4-a939d1f9f39c. Partitions per leaf are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,179 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,179 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,179 Validator.java:231 - Validated 10 partitions for 46d501c0-39c5-11ef-99a4-a939d1f9f39c. Partition sizes are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,180 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,180 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,180 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,180 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,180 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,180 Validator.java:257 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Sending completed merkle tree to /127.0.0.3:7012 for tr.x DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,180 ValidationManager.java:152 - Validation of 10 partitions (~114B) finished in 16 msec, for [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c on tr/x, [(20,30]]] INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,183 RepairSession.java:242 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Received merkle tree for x from /127.0.0.4:7012 INFO [node3_RepairJobTask:2] node3 2024-07-04 05:21:33,185 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 46c2d950-39c5-11ef-99a4-a939d1f9f39c (took: 2ms) INFO [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,185 SyncTask.java:93 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Endpoints /127.0.0.3:7012 and /127.0.0.1:7012 have 1 range(s) out of sync for x INFO [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,185 LocalSyncTask.java:118 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Performing streaming repair of 1 ranges with /127.0.0.1:7012 INFO [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,186 StreamResultFuture.java:98 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Executing streaming plan for Repair INFO [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,186 StreamSession.java:396 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Starting streaming to 127.0.0.1:7012 DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,186 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.1:7012 as initiator INFO [node3_RepairJobTask:2] node3 2024-07-04 05:21:33,187 SyncTask.java:93 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Endpoints /127.0.0.4:7012 and /127.0.0.1:7012 have 1 range(s) out of sync for x DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,189 StreamingMultiplexedChannel.java:473 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c channel: 31fee1de] Scheduling keep-alive task with 300s period. INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:33,189 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:43996)->/127.0.0.1:7012-STREAMING-5b0242fd streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,189 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:43996 channel.id 31fee1de DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,189 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.3:7012, src=/127.0.0.4:7012, dst=/127.0.0.1:7012, ranges=[(20,30]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@87207b16 DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,190 StreamSession.java:596 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Changing session state from INITIALIZED to PREPARING INFO [node1_Stream-Deserializer-/127.0.0.3:7012-5b0242fd] node1 2024-07-04 05:21:33,190 StreamResultFuture.java:123 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c ID#0] Creating new streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:43996 channel.local /127.0.0.1:7012 channel.id 5b0242fd INFO [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,190 StreamCoordinator.java:268 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c, ID#0] Beginning stream session with /127.0.0.1:7012 INFO [node1_Stream-Deserializer-/127.0.0.3:7012-5b0242fd] node1 2024-07-04 05:21:33,190 StreamResultFuture.java:131 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c, ID#0] Received streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:43996 channel.local /127.0.0.1:7012 channel.id 5b0242fd DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-5b0242fd] node1 2024-07-04 05:21:33,190 StreamDeserializingTask.java:132 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c channel: 5b0242fd] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 46daa710-39c5-11ef-99a4-a939d1f9f39c, session index = 0 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-5b0242fd] node1 2024-07-04 05:21:33,191 StreamDeserializingTask.java:132 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c channel: 5b0242fd] Received Prepare SYN (1 requests, 0 files} DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-5b0242fd] node1 2024-07-04 05:21:33,191 StreamSession.java:596 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Changing session state from INITIALIZED to PREPARING INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,192 StreamingRepairTask.java:84 - [streaming task #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Performing asymmetric streaming repair of 1 ranges with /127.0.0.1:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,193 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,193 StreamResultFuture.java:187 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,194 StreamSession.java:596 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Changing session state from PREPARING to COMPLETE INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,194 StreamingRepairTask.java:87 - [streaming task #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Stream plan created in 2ms DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,194 StreamDeserializingTask.java:132 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c channel: 31fee1de] Received Prepare SYNACK ( 0 files} INFO [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,194 StreamResultFuture.java:187 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,194 StreamSession.java:596 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Changing session state from PREPARING to STREAMING DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,194 StreamSession.java:596 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Changing session state from COMPLETE to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,194 StreamSession.java:596 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Changing session state from STREAMING to WAIT_COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,194 StreamResultFuture.java:201 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Session with /127.0.0.3:7012 is complete INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,194 StreamResultFuture.java:260 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] All sessions completed INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,194 StreamResultFuture.java:98 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Executing streaming plan for Repair INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,195 StreamSession.java:396 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Starting streaming to 127.0.0.1:7012 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,195 StreamDeserializingTask.java:132 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c channel: 31fee1de] Received Complete DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,195 StreamSession.java:1128 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] handling Complete message, state = WAIT_COMPLETE DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,195 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:33,195 StreamSession.java:596 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:33,195 StreamResultFuture.java:201 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Session with /127.0.0.1:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:33,195 StreamResultFuture.java:260 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] All sessions completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:33,195 LocalSyncTask.java:168 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Sync complete using session 46d501c0-39c5-11ef-99a4-a939d1f9f39c between /127.0.0.3:7012 and /127.0.0.1:7012 on x DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:33,195 StreamSession.java:564 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Will close attached inbound {31fee1de=org.apache.cassandra.streaming.async.NettyStreamingChannel@4b238d0c} and outbound {31fee1de=org.apache.cassandra.streaming.async.NettyStreamingChannel@4b238d0c} channels DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,195 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-31fee1de] node3 2024-07-04 05:21:33,195 StreamSession.java:712 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node3 2024-07-04 05:21:33,196 StreamingMultiplexedChannel.java:514 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:33,196 StreamingMultiplexedChannel.java:514 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-5b0242fd] node1 2024-07-04 05:21:33,196 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-5b0242fd] node1 2024-07-04 05:21:33,196 StreamSession.java:712 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Socket closed after session completed with state COMPLETE INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:33,198 InboundConnectionInitiator.java:450 - /127.0.0.4:7012(/127.0.0.1:44006)->/127.0.0.1:7012-STREAMING-ae6eef0e streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,199 StreamingMultiplexedChannel.java:473 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b channel: de866d26] Scheduling keep-alive task with 300s period. DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,199 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:44006 channel.id de866d26 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,200 StreamSession.java:596 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Changing session state from INITIALIZED to PREPARING INFO [node1_Stream-Deserializer-/127.0.0.4:7012-ae6eef0e] node1 2024-07-04 05:21:33,200 StreamResultFuture.java:123 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b ID#0] Creating new streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:44006 channel.local /127.0.0.1:7012 channel.id ae6eef0e INFO [node1_Stream-Deserializer-/127.0.0.4:7012-ae6eef0e] node1 2024-07-04 05:21:33,200 StreamResultFuture.java:131 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b, ID#0] Received streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:44006 channel.local /127.0.0.1:7012 channel.id ae6eef0e INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,200 StreamCoordinator.java:268 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b, ID#0] Beginning stream session with /127.0.0.1:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-ae6eef0e] node1 2024-07-04 05:21:33,200 StreamDeserializingTask.java:132 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b channel: ae6eef0e] Received StreamInitMessage: from = /127.0.0.4:7012, planId = 46dbb880-39c5-11ef-a91a-654b51ec069b, session index = 0 DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-ae6eef0e] node1 2024-07-04 05:21:33,201 StreamDeserializingTask.java:132 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b channel: ae6eef0e] Received Prepare SYN (1 requests, 0 files} DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-ae6eef0e] node1 2024-07-04 05:21:33,201 StreamSession.java:596 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Changing session state from INITIALIZED to PREPARING INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:21:33,201 RepairMessage.java:259 - [#46c2d950-39c5-11ef-99a4-a939d1f9f39c] SYNC_REQ received by /127.0.0.4:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,202 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,202 StreamResultFuture.java:187 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,202 StreamSession.java:596 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Changing session state from PREPARING to COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,202 StreamDeserializingTask.java:132 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b channel: de866d26] Received Prepare SYNACK ( 0 files} INFO [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,203 StreamResultFuture.java:187 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,203 StreamSession.java:596 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Changing session state from COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,203 StreamResultFuture.java:201 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Session with /127.0.0.4:7012 is complete DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,203 StreamSession.java:596 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Changing session state from PREPARING to STREAMING INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,203 StreamResultFuture.java:260 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] All sessions completed DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,203 StreamSession.java:596 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,203 StreamDeserializingTask.java:132 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b channel: de866d26] Received Complete DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,203 StreamSession.java:1128 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] handling Complete message, state = WAIT_COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,203 StreamSession.java:596 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,203 StreamResultFuture.java:201 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Session with /127.0.0.1:7012 is complete INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,204 StreamResultFuture.java:260 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] All sessions completed INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,204 StreamingRepairTask.java:121 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] streaming task succeed, returning response to /127.0.0.3:7012 DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,206 StreamSession.java:564 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Will close attached inbound {de866d26=org.apache.cassandra.streaming.async.NettyStreamingChannel@5ad709a6} and outbound {de866d26=org.apache.cassandra.streaming.async.NettyStreamingChannel@5ad709a6} channels DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,206 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-de866d26] node4 2024-07-04 05:21:33,206 StreamSession.java:712 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-1] node4 2024-07-04 05:21:33,206 StreamingMultiplexedChannel.java:514 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:33,207 StreamingMultiplexedChannel.java:514 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-ae6eef0e] node1 2024-07-04 05:21:33,207 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-ae6eef0e] node1 2024-07-04 05:21:33,207 StreamSession.java:712 - [Stream #46dbb880-39c5-11ef-a91a-654b51ec069b] Socket closed after session completed with state COMPLETE DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,207 RepairSession.java:263 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Repair completed between /127.0.0.4:7012 and /127.0.0.1:7012 on x INFO [node3_RepairJobTask:4] node3 2024-07-04 05:21:33,207 RepairJob.java:210 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] tr.x is fully synced INFO [node3_RepairJobTask:2] node3 2024-07-04 05:21:33,211 RepairSession.java:355 - [repair #46d501c0-39c5-11ef-99a4-a939d1f9f39c] Session completed successfully INFO [node3_RepairJobTask:2] node3 2024-07-04 05:21:33,211 RepairCoordinator.java:191 - Repair session 46d501c0-39c5-11ef-99a4-a939d1f9f39c for range [(20,30]] finished DEBUG [node3_RepairJobTask:2] node3 2024-07-04 05:21:33,211 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=46d501c0-39c5-11ef-99a4-a939d1f9f39c, keyspace='tr', ranges=[(20,30]], repairJobResults=[org.apache.cassandra.repair.RepairResult@36fd2e7c], skippedReplicas=false}] INFO [node3_RepairJobTask:2] node3 2024-07-04 05:21:33,212 CoordinatorSession.java:242 - Proposing finalization of repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node3_RepairJobTask:2] node3 2024-07-04 05:21:33,213 StreamSession.java:1379 - [Stream #46daa710-39c5-11ef-99a4-a939d1f9f39c] Stream session with peer /127.0.0.1:7012 is already in a final state on abort. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,214 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.117KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,215 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.119KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,232 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:33,239 Flushing.java:153 - Writing Memtable-repairs@978648602(950B serialized bytes, 5 ops, 6.117KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:33,239 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=105882) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:33,247 Flushing.java:153 - Writing Memtable-repairs@9093521(950B serialized bytes, 5 ops, 6.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:33,247 Flushing.java:153 - Writing Memtable-repairs@1033081205(950B serialized bytes, 5 ops, 6.119KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:33,247 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=81540) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:33,247 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=86231) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:33,322 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.938KiB), biggest 5.938KiB, smallest 5.938KiB DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:33,322 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.943KiB), biggest 5.943KiB, smallest 5.943KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:33,322 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.937KiB), biggest 5.937KiB, smallest 5.937KiB DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,322 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c, responded with FinalizePromise DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,322 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c, responded with FinalizePromise DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,323 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c, responded with FinalizePromise INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,323 CoordinatorSession.java:278 - Finalization proposal for repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c accepted by all participants. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,323 CoordinatorSession.java:373 - Incremental repair 46c2d950-39c5-11ef-99a4-a939d1f9f39c finalization phase completed in 0 seconds INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,323 CoordinatorSession.java:287 - Committing finalization of repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,324 CoordinatorSessions.java:97 - Removing completed session 46c2d950-39c5-11ef-99a4-a939d1f9f39c with state FINALIZED INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,324 CoordinatorSession.java:294 - Incremental repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c completed DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,324 CoordinatorSession.java:376 - Incremental repair 46c2d950-39c5-11ef-99a4-a939d1f9f39c phase completed in 0 seconds DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,325 LocalSessions.java:1010 - Finalized local repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,326 LocalSessions.java:1010 - Finalized local repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,327 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070493042 and session id = 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,328 RepairCoordinator.java:250 - [repair #46c2d950-39c5-11ef-99a4-a939d1f9f39c]Repair command #1 finished in 0 seconds DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,330 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 46c2d950-39c5-11ef-99a4-a939d1f9f39c on tr.x DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,330 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,331 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:21:33,331 LocalSessions.java:1010 - Finalized local repair session 46c2d950-39c5-11ef-99a4-a939d1f9f39c INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:33,332 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070493042 and session id = 46c2d950-39c5-11ef-99a4-a939d1f9f39c DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:33,333 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 46c2d950-39c5-11ef-99a4-a939d1f9f39c on tr.x INFO [node4_Repair-Task:1] node4 2024-07-04 05:21:33,445 RepairCoordinator.java:366 - Starting repair command #1 (4701de20-39c5-11ef-a91a-654b51ec069b), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,463 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(30,40]], parentRepairSession=4701de20-39c5-11ef-a91a-654b51ec069b, isIncremental=true, timestamp=1720070493462, isGlobal=true} DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,463 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000c]', ranges=[(30,40]], parentRepairSession=4701de20-39c5-11ef-a91a-654b51ec069b, isIncremental=true, timestamp=1720070493462, isGlobal=true} INFO [node4_RequestResponseStage-2] node4 2024-07-04 05:21:33,470 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node4_RequestResponseStage-2] node4 2024-07-04 05:21:33,471 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,474 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=4701de20-39c5-11ef-a91a-654b51ec069b, state=PREPARING, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493462, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070493, lastUpdate=1720070493} INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:33,474 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:59010)->/127.0.0.4:7012-SMALL_MESSAGES-b3c795f5 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:33,475 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:59010)->/127.0.0.4:7012-SMALL_MESSAGES-b4e3c20a successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,476 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=4701de20-39c5-11ef-a91a-654b51ec069b, state=PREPARING, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493462, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070493, lastUpdate=1720070493} DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,477 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=4701de20-39c5-11ef-a91a-654b51ec069b, state=PREPARING, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493462, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070493, lastUpdate=1720070493} DEBUG [node1_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node1 2024-07-04 05:21:33,480 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 4701de20-39c5-11ef-a91a-654b51ec069b DEBUG [node2_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node2 2024-07-04 05:21:33,480 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 4701de20-39c5-11ef-a91a-654b51ec069b DEBUG [node1_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node1 2024-07-04 05:21:33,480 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node2 2024-07-04 05:21:33,480 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node2 2024-07-04 05:21:33,480 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node1 2024-07-04 05:21:33,480 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node2_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node2 2024-07-04 05:21:33,480 LocalSessions.java:863 - Prepare phase for incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b completed DEBUG [node4_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node4 2024-07-04 05:21:33,480 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 4701de20-39c5-11ef-a91a-654b51ec069b DEBUG [node4_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node4 2024-07-04 05:21:33,481 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_Repair-4701de20-39c5-11ef-a91a-654b51ec069b:1] node4 2024-07-04 05:21:33,481 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:33,481 CompactionManager.java:928 - [repair #4701de20-39c5-11ef-a91a-654b51ec069b] Starting anticompaction for tr.x on 1/2 sstables INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:33,481 CompactionManager.java:987 - [repair #4701de20-39c5-11ef-a91a-654b51ec069b] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (30,40], mutating repairedAt instead of anticompacting DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:33,482 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:33,483 CompactionManager.java:948 - [repair #4701de20-39c5-11ef-a91a-654b51ec069b] Completed anticompaction successfully DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:33,483 LocalSessions.java:863 - Prepare phase for incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b completed INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,483 CompactionManager.java:928 - [repair #4701de20-39c5-11ef-a91a-654b51ec069b] Starting anticompaction for tr.x on 1/2 sstables INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,484 CompactionManager.java:987 - [repair #4701de20-39c5-11ef-a91a-654b51ec069b] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') fully contained in range (30,40], mutating repairedAt instead of anticompacting DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,485 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,486 CompactionManager.java:948 - [repair #4701de20-39c5-11ef-a91a-654b51ec069b] Completed anticompaction successfully DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,486 LocalSessions.java:863 - Prepare phase for incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b completed INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,489 CoordinatorSession.java:225 - Incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b successfully prepared. DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,490 CoordinatorSession.java:353 - Incremental repair 4701de20-39c5-11ef-a91a-654b51ec069b prepare phase completed in 0 seconds INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,490 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.1:7012, /127.0.0.2:7012], transEndpoints=[/127.0.0.2:7012], ranges=[(30,40]], hasSkippedReplicas=false} INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,493 RepairSession.java:297 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] parentSessionId = 4701de20-39c5-11ef-a91a-654b51ec069b: new session: will sync /127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012 on range CommonRange{endpoints=[/127.0.0.1:7012, /127.0.0.2:7012], transEndpoints=[/127.0.0.2:7012], ranges=[(30,40]], hasSkippedReplicas=false} for tr.[x] INFO [node4_Repair#1:1] node4 2024-07-04 05:21:33,502 RepairJob.java:137 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] tr.x not running paxos repair INFO [node4_RepairJobTask:1] node4 2024-07-04 05:21:33,503 RepairJob.java:504 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Requesting merkle trees for x (to [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.4:7012]) DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,505 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070493} org.apache.cassandra.repair.messages.ValidationRequest@6686315d DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,505 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070493} org.apache.cassandra.repair.messages.ValidationRequest@6686315d DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,506 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=4701de20-39c5-11ef-a91a-654b51ec069b, state=PREPARED, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493462, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070493, lastUpdate=1720070493} to REPAIRING DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,506 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=4701de20-39c5-11ef-a91a-654b51ec069b, state=PREPARED, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493462, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070493, lastUpdate=1720070493} to REPAIRING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,506 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070493} org.apache.cassandra.repair.messages.ValidationRequest@6686315d DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,506 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=4701de20-39c5-11ef-a91a-654b51ec069b, state=PREPARED, coordinator=/127.0.0.4:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000c], repairedAt=1720070493462, ranges=[(30,40]], participants=[/127.0.0.4:7012, /127.0.0.1:7012, /127.0.0.2:7012], startedAt=1720070493, lastUpdate=1720070493} to REPAIRING INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,508 CassandraValidationIterator.java:215 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b], parentSessionId=4701de20-39c5-11ef-a91a-654b51ec069b: Performing validation compaction on 1 sstables in tr.x INFO [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,508 CassandraValidationIterator.java:215 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b], parentSessionId=4701de20-39c5-11ef-a91a-654b51ec069b: Performing validation compaction on 1 sstables in tr.x INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,509 CassandraValidationIterator.java:215 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b], parentSessionId=4701de20-39c5-11ef-a91a-654b51ec069b: Performing validation compaction on 0 sstables in tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,509 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,509 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,510 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,510 Validator.java:158 - Prepared AEService trees of size 1 for [repair #47097f40-39c5-11ef-a91a-654b51ec069b on tr/x, [(30,40]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,510 Validator.java:229 - Validated 0 partitions for 47097f40-39c5-11ef-a91a-654b51ec069b. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,510 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,510 Validator.java:231 - Validated 0 partitions for 47097f40-39c5-11ef-a91a-654b51ec069b. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,510 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:21:33,510 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 1 msec, for [repair #47097f40-39c5-11ef-a91a-654b51ec069b on tr/x, [(30,40]]] INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,510 Validator.java:257 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Sending completed merkle tree to /127.0.0.4:7012 for tr.x WARN 05:21:33 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:33,512 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,512 RepairSession.java:242 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Received merkle tree for x from /127.0.0.2:7012 INFO [node4_RequestResponseStage-2] node4 2024-07-04 05:21:33,513 RepairMessage.java:259 - [#4701de20-39c5-11ef-a91a-654b51ec069b] VALIDATION_REQ received by /127.0.0.1:7012 INFO [node4_RequestResponseStage-2] node4 2024-07-04 05:21:33,513 RepairMessage.java:259 - [#4701de20-39c5-11ef-a91a-654b51ec069b] VALIDATION_REQ received by /127.0.0.4:7012 INFO [node4_RequestResponseStage-1] node4 2024-07-04 05:21:33,513 RepairMessage.java:259 - [#4701de20-39c5-11ef-a91a-654b51ec069b] VALIDATION_REQ received by /127.0.0.2:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,514 Validator.java:158 - Prepared AEService trees of size 127 for [repair #47097f40-39c5-11ef-a91a-654b51ec069b on tr/x, [(30,40]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,514 Validator.java:158 - Prepared AEService trees of size 127 for [repair #47097f40-39c5-11ef-a91a-654b51ec069b on tr/x, [(30,40]]] DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,517 Validator.java:229 - Validated 10 partitions for 47097f40-39c5-11ef-a91a-654b51ec069b. Partitions per leaf are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,517 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,517 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,517 Validator.java:231 - Validated 10 partitions for 47097f40-39c5-11ef-a91a-654b51ec069b. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,518 Validator.java:229 - Validated 10 partitions for 47097f40-39c5-11ef-a91a-654b51ec069b. Partitions per leaf are: DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,518 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,518 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,518 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,518 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,518 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,518 Validator.java:262 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Local completed merkle tree for /127.0.0.4:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,518 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,519 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,519 Validator.java:231 - Validated 10 partitions for 47097f40-39c5-11ef-a91a-654b51ec069b. Partition sizes are: INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,519 RepairSession.java:242 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Received merkle tree for x from /127.0.0.4:7012 DEBUG [node4_ValidationExecutor:1] node4 2024-07-04 05:21:33,519 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 11 msec, for [repair #47097f40-39c5-11ef-a91a-654b51ec069b on tr/x, [(30,40]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,519 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,520 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,520 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,520 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,520 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,520 Validator.java:257 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Sending completed merkle tree to /127.0.0.4:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:21:33,520 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 12 msec, for [repair #47097f40-39c5-11ef-a91a-654b51ec069b on tr/x, [(30,40]]] INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,522 RepairSession.java:242 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Received merkle tree for x from /127.0.0.1:7012 INFO [node4_RepairJobTask:3] node4 2024-07-04 05:21:33,524 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 4701de20-39c5-11ef-a91a-654b51ec069b (took: 1ms) INFO [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,525 SyncTask.java:93 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Endpoints /127.0.0.4:7012 and /127.0.0.2:7012 have 1 range(s) out of sync for x INFO [node4_RepairJobTask:3] node4 2024-07-04 05:21:33,525 SyncTask.java:93 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Endpoints /127.0.0.1:7012 and /127.0.0.2:7012 have 1 range(s) out of sync for x INFO [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,525 LocalSyncTask.java:118 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Performing streaming repair of 1 ranges with /127.0.0.2:7012 INFO [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,525 StreamResultFuture.java:98 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Executing streaming plan for Repair INFO [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,525 StreamSession.java:396 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Starting streaming to 127.0.0.2:7012 DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,525 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,526 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.4:7012, src=/127.0.0.1:7012, dst=/127.0.0.2:7012, ranges=[(30,40]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@4ae6cc6f INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,528 StreamingRepairTask.java:84 - [streaming task #47097f40-39c5-11ef-a91a-654b51ec069b] Performing asymmetric streaming repair of 1 ranges with /127.0.0.2:7012 INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:33,528 InboundConnectionInitiator.java:450 - /127.0.0.4:7012(/127.0.0.1:60490)->/127.0.0.2:7012-STREAMING-4a730b62 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,529 StreamingRepairTask.java:87 - [streaming task #47097f40-39c5-11ef-a91a-654b51ec069b] Stream plan created in 0ms DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,529 StreamingMultiplexedChannel.java:473 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b channel: 3f5cf72c] Scheduling keep-alive task with 300s period. DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,529 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:60490 channel.id 3f5cf72c INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,529 StreamResultFuture.java:98 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Executing streaming plan for Repair INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,529 StreamSession.java:396 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Starting streaming to 127.0.0.2:7012 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,529 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator DEBUG [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,529 StreamSession.java:596 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Changing session state from INITIALIZED to PREPARING INFO [node2_Stream-Deserializer-/127.0.0.4:7012-4a730b62] node2 2024-07-04 05:21:33,529 StreamResultFuture.java:123 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b ID#0] Creating new streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:60490 channel.local /127.0.0.2:7012 channel.id 4a730b62 INFO [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,530 StreamCoordinator.java:268 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node2_Stream-Deserializer-/127.0.0.4:7012-4a730b62] node2 2024-07-04 05:21:33,530 StreamResultFuture.java:131 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b, ID#0] Received streaming plan for Repair from /127.0.0.4:7012 channel.remote /127.0.0.1:60490 channel.local /127.0.0.2:7012 channel.id 4a730b62 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-4a730b62] node2 2024-07-04 05:21:33,530 StreamDeserializingTask.java:132 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b channel: 4a730b62] Received StreamInitMessage: from = /127.0.0.4:7012, planId = 470e8850-39c5-11ef-a91a-654b51ec069b, session index = 0 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-4a730b62] node2 2024-07-04 05:21:33,531 StreamDeserializingTask.java:132 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b channel: 4a730b62] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-4a730b62] node2 2024-07-04 05:21:33,531 StreamSession.java:596 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Changing session state from INITIALIZED to PREPARING INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:33,532 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:60496)->/127.0.0.2:7012-STREAMING-33086abf streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,532 StreamingMultiplexedChannel.java:473 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 channel: 025b9c7c] Scheduling keep-alive task with 300s period. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,532 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:60496 channel.id 025b9c7c DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,533 StreamSession.java:596 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Changing session state from INITIALIZED to PREPARING INFO [node2_Stream-Deserializer-/127.0.0.1:7012-33086abf] node2 2024-07-04 05:21:33,533 StreamResultFuture.java:123 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 ID#0] Creating new streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:60496 channel.local /127.0.0.2:7012 channel.id 33086abf INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,533 StreamCoordinator.java:268 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node2_Stream-Deserializer-/127.0.0.1:7012-33086abf] node2 2024-07-04 05:21:33,533 StreamResultFuture.java:131 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971, ID#0] Received streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:60496 channel.local /127.0.0.2:7012 channel.id 33086abf DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-33086abf] node2 2024-07-04 05:21:33,533 StreamDeserializingTask.java:132 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 channel: 33086abf] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 470efd80-39c5-11ef-9520-1f8a75ee0971, session index = 0 DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,533 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node4_RequestResponseStage-2] node4 2024-07-04 05:21:33,534 RepairMessage.java:259 - [#4701de20-39c5-11ef-a91a-654b51ec069b] SYNC_REQ received by /127.0.0.1:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-33086abf] node2 2024-07-04 05:21:33,534 StreamDeserializingTask.java:132 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 channel: 33086abf] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-33086abf] node2 2024-07-04 05:21:33,534 StreamSession.java:596 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Changing session state from INITIALIZED to PREPARING INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,534 StreamResultFuture.java:187 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,534 StreamSession.java:596 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Changing session state from PREPARING to COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,534 StreamDeserializingTask.java:132 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b channel: 3f5cf72c] Received Prepare SYNACK ( 0 files} INFO [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,535 StreamResultFuture.java:187 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,535 StreamSession.java:596 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Changing session state from PREPARING to STREAMING DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,535 StreamSession.java:596 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,535 StreamDeserializingTask.java:132 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b channel: 3f5cf72c] Received Complete DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,535 StreamSession.java:1128 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] handling Complete message, state = WAIT_COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,535 StreamSession.java:596 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,535 StreamResultFuture.java:201 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Session with /127.0.0.2:7012 is complete INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,535 StreamResultFuture.java:260 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] All sessions completed INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,536 LocalSyncTask.java:168 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Sync complete using session 47097f40-39c5-11ef-a91a-654b51ec069b between /127.0.0.4:7012 and /127.0.0.2:7012 on x DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,536 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:33,536 StreamSession.java:564 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Will close attached inbound {3f5cf72c=org.apache.cassandra.streaming.async.NettyStreamingChannel@737c726f} and outbound {3f5cf72c=org.apache.cassandra.streaming.async.NettyStreamingChannel@737c726f} channels INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,536 StreamResultFuture.java:187 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,536 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-3f5cf72c] node4 2024-07-04 05:21:33,536 StreamSession.java:712 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node4 2024-07-04 05:21:33,536 StreamingMultiplexedChannel.java:514 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,536 StreamSession.java:596 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Changing session state from PREPARING to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,536 StreamDeserializingTask.java:132 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 channel: 025b9c7c] Received Prepare SYNACK ( 0 files} INFO [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,537 StreamResultFuture.java:187 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,537 StreamSession.java:596 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Changing session state from COMPLETE to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,537 StreamSession.java:596 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Changing session state from PREPARING to STREAMING INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,537 StreamResultFuture.java:201 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Session with /127.0.0.4:7012 is complete DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,537 StreamSession.java:596 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Changing session state from STREAMING to WAIT_COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,537 StreamResultFuture.java:260 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] All sessions completed DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,537 StreamSession.java:596 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Changing session state from COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,537 StreamResultFuture.java:201 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Session with /127.0.0.1:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:33,537 StreamResultFuture.java:260 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] All sessions completed DEBUG [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:33,537 StreamingMultiplexedChannel.java:514 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-4a730b62] node2 2024-07-04 05:21:33,538 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,538 StreamDeserializingTask.java:132 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971 channel: 025b9c7c] Received Complete DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-4a730b62] node2 2024-07-04 05:21:33,538 StreamSession.java:712 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,538 StreamSession.java:1128 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] handling Complete message, state = WAIT_COMPLETE DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,539 StreamSession.java:596 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,539 StreamResultFuture.java:201 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Session with /127.0.0.2:7012 is complete INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,539 StreamResultFuture.java:260 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] All sessions completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,539 StreamingRepairTask.java:121 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] streaming task succeed, returning response to /127.0.0.4:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:33,539 StreamSession.java:564 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Will close attached inbound {025b9c7c=org.apache.cassandra.streaming.async.NettyStreamingChannel@7b3454fb} and outbound {025b9c7c=org.apache.cassandra.streaming.async.NettyStreamingChannel@7b3454fb} channels DEBUG [Streaming-EventLoop-4-2] node1 2024-07-04 05:21:33,539 StreamingMultiplexedChannel.java:514 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,540 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-025b9c7c] node1 2024-07-04 05:21:33,540 StreamSession.java:712 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Socket closed after session completed with state COMPLETE DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:33,540 StreamingMultiplexedChannel.java:514 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,540 RepairSession.java:263 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Repair completed between /127.0.0.1:7012 and /127.0.0.2:7012 on x DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-33086abf] node2 2024-07-04 05:21:33,540 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node4_RepairJobTask:2] node4 2024-07-04 05:21:33,540 RepairJob.java:210 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] tr.x is fully synced DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-33086abf] node2 2024-07-04 05:21:33,540 StreamSession.java:712 - [Stream #470efd80-39c5-11ef-9520-1f8a75ee0971] Socket closed after session completed with state COMPLETE INFO [node4_RepairJobTask:3] node4 2024-07-04 05:21:33,546 RepairSession.java:355 - [repair #47097f40-39c5-11ef-a91a-654b51ec069b] Session completed successfully INFO [node4_RepairJobTask:3] node4 2024-07-04 05:21:33,546 RepairCoordinator.java:191 - Repair session 47097f40-39c5-11ef-a91a-654b51ec069b for range [(30,40]] finished DEBUG [node4_RepairJobTask:3] node4 2024-07-04 05:21:33,547 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=47097f40-39c5-11ef-a91a-654b51ec069b, keyspace='tr', ranges=[(30,40]], repairJobResults=[org.apache.cassandra.repair.RepairResult@3bddce1e], skippedReplicas=false}] INFO [node4_RepairJobTask:3] node4 2024-07-04 05:21:33,548 CoordinatorSession.java:242 - Proposing finalization of repair session 4701de20-39c5-11ef-a91a-654b51ec069b DEBUG [node4_RepairJobTask:3] node4 2024-07-04 05:21:33,551 StreamSession.java:1379 - [Stream #470e8850-39c5-11ef-a91a-654b51ec069b] Stream session with peer /127.0.0.2:7012 is already in a final state on abort. INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,552 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,552 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.117KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,556 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:33,560 Flushing.java:153 - Writing Memtable-repairs@924942868(950B serialized bytes, 5 ops, 6.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:33,560 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=83235) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:33,561 Flushing.java:153 - Writing Memtable-repairs@1562653358(950B serialized bytes, 5 ops, 6.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:33,561 Flushing.java:153 - Writing Memtable-repairs@1477850597(950B serialized bytes, 5 ops, 6.117KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:33,562 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=87638) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:33,562 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070477531, position=108577) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:33,605 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.938KiB), biggest 5.938KiB, smallest 5.938KiB DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,606 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b, responded with FinalizePromise DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:33,616 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.938KiB), biggest 5.938KiB, smallest 5.938KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:33,616 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.947KiB), biggest 5.947KiB, smallest 5.947KiB DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,616 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b, responded with FinalizePromise DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,616 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b, responded with FinalizePromise INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,617 CoordinatorSession.java:278 - Finalization proposal for repair session 4701de20-39c5-11ef-a91a-654b51ec069b accepted by all participants. DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,617 CoordinatorSession.java:373 - Incremental repair 4701de20-39c5-11ef-a91a-654b51ec069b finalization phase completed in 0 seconds INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,617 CoordinatorSession.java:287 - Committing finalization of repair session 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,618 CoordinatorSessions.java:97 - Removing completed session 4701de20-39c5-11ef-a91a-654b51ec069b with state FINALIZED INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,618 CoordinatorSession.java:294 - Incremental repair session 4701de20-39c5-11ef-a91a-654b51ec069b completed DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,618 CoordinatorSession.java:376 - Incremental repair 4701de20-39c5-11ef-a91a-654b51ec069b phase completed in 0 seconds DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,620 LocalSessions.java:1010 - Finalized local repair session 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:33,621 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070493462 and session id = 4701de20-39c5-11ef-a91a-654b51ec069b DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:33,622 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 4701de20-39c5-11ef-a91a-654b51ec069b on tr.x DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,624 LocalSessions.java:1010 - Finalized local repair session 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,624 RepairCoordinator.java:250 - [repair #4701de20-39c5-11ef-a91a-654b51ec069b]Repair command #1 finished in 0 seconds DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:21:33,627 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:21:33,627 RepairMessageVerbHandler.java:290 - cleaning up repair INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:21:33,628 Gossiper.java:1808 - Announcing shutdown DEBUG [node4_AntiEntropyStage:1] node4 2024-07-04 05:21:33,628 LocalSessions.java:1010 - Finalized local repair session 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,628 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070493462 and session id = 4701de20-39c5-11ef-a91a-654b51ec069b INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:21:33,628 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:33,630 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 4701de20-39c5-11ef-a91a-654b51ec069b on tr.x INFO [node4_GossipStage:1] node4 2024-07-04 05:21:33,631 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:21:33,631 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:33,631 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:33,632 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:33,632 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:33,632 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:33,632 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:33,632 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:33,632 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:33,632 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:21:33,633 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:21:33,633 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:33,633 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:33,633 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:33,633 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:33,769 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:44018)->/127.0.0.1:7012-URGENT_MESSAGES-28e30dd6 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:33,769 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:44018)->/127.0.0.1:7012-URGENT_MESSAGES-53df1a77 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:34,183 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:44032)->/127.0.0.1:7012-URGENT_MESSAGES-063a78a2 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:34,183 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:44032)->/127.0.0.1:7012-URGENT_MESSAGES-e5273e0a successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:35,149 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:44042)->/127.0.0.1:7012-URGENT_MESSAGES-719708e0 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:35,149 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:44042)->/127.0.0.1:7012-URGENT_MESSAGES-34e8f2ab successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:21:35,636 HintsService.java:234 - Paused hints dispatch DEBUG [node1_isolatedExecutor:6] node1 2024-07-04 05:21:35,643 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node1_isolatedExecutor:6] node1 2024-07-04 05:21:35,643 MessagingService.java:643 - Waiting for messaging service to quiesce INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:36,185 NoSpamLogger.java:104 - /127.0.0.2:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:36,185 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:36,185 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:37,059 NoSpamLogger.java:104 - /127.0.0.4:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:37,060 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:37,060 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:37,153 NoSpamLogger.java:104 - /127.0.0.3:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:37,153 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:37,153 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:37,186 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:37,187 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:37,652 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [main] node1 2024-07-04 05:21:38,043 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-07-04 05:21:38,048 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-07-04 05:21:38,048 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node1 2024-07-04 05:21:38,048 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-07-04 05:21:38,049 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node1 2024-07-04 05:21:38,049 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-07-04 05:21:38,049 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node1 2024-07-04 05:21:38,050 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node1 2024-07-04 05:21:38,050 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-07-04 05:21:38,051 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-07-04 05:21:38,052 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-07-04 05:21:38,052 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node1 2024-07-04 05:21:38,052 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node1 2024-07-04 05:21:38,052 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-07-04 05:21:38,053 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-07-04 05:21:38,053 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node1 2024-07-04 05:21:38,053 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-07-04 05:21:38,054 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-07-04 05:21:38,054 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:38,061 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:38,061 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,097 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,098 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,098 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,098 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,099 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,099 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,104 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,104 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:38,155 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:38,155 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,183 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:38,192 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:38,192 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,193 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,230 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,230 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:613 - Heap size: 832.000MiB/1.000GiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 396837616(387536K) committed = 398000128(388672K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 51449728(50243K) committed = 51511296(50304K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 52131904(50910K) committed = 52690944(51456K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 335494696(327631K) committed = 369098752(360448K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 410726408(401100K) committed = 822083584(802816K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,231 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 50331648(49152K) committed = 50331648(49152K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,232 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 12380672(12090K) committed = 12386304(12096K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,232 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,232 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_ScheduledTasks:1] node1 2024-07-04 05:21:38,282 StorageService.java:294 - Overriding RING_DELAY to 15000ms DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,410 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,410 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,569 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,570 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds WARN 05:21:38 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,767 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:38 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,774 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:38 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,774 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,785 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,786 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,791 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,794 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,794 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,794 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,795 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,799 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,802 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,802 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,802 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,802 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,803 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,804 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,805 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,805 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,806 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,806 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,806 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,806 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,807 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,807 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:21:38 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,807 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:38 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,808 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,809 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,809 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,812 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:38,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/hints INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,007 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,011 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:39,065 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:39,065 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,137 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,145 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,152 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:39,158 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:39,158 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_SecondaryIndexManagement:1] node1 2024-07-04 05:21:39,169 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,178 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,191 ColumnFamilyStore.java:508 - Initializing system.local DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:39,194 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:39,194 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,216 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,241 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,242 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,242 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,265 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,291 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big (233B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,291 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big (28B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,301 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big (28B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,343 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,349 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,360 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,371 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,377 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,381 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,385 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,390 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,396 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,401 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,404 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,408 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,413 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,419 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,426 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,433 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,445 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,450 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big (241B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,450 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big (247B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,453 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big (158B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,458 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,464 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,470 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big (1.795KiB) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,472 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,472 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,478 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,488 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,651 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,658 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big (369B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,658 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big (107B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,665 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,682 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big (4.017KiB) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,689 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,702 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big (7.918KiB) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,711 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,724 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big (3.301KiB) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:39,729 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big (27B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,735 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,743 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,750 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,754 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big (101B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,760 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,763 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,769 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,774 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,786 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,789 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,799 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,801 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,806 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:39,808 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big (173B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,825 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,825 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,826 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,826 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,839 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,840 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,840 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,843 Startup.java:504 - hasAnyEpoch = true, hasBootedBefore = true INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,844 Startup.java:103 - Initializing as non CMS node DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,895 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,895 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,895 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,895 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,901 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_64764158475588533835.so DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,904 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,905 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,907 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,908 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,908 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,912 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,920 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,939 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,944 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:39,944 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:40,066 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:40,066 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:40,161 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:40,161 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:40,195 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:40,195 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,252 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=distributed_test_keyspace, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}}, tables=[], views=[], functions=[], types=[]}] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,262 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,263 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,265 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,281 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=Epoch{epoch=13}, entries=0: []} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:40,284 LocalLog.java:492 - Enacted ForceSnapshot{epoch=Epoch{epoch=13}}. New tail is Epoch{epoch=13} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,328 StorageService.java:494 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,331 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,345 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=13} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,346 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=13} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,346 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,350 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,350 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=13} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,359 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,364 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,370 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,376 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,380 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,386 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,391 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,423 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,430 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,430 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,430 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,436 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,437 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,437 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,443 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,444 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,444 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,448 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,454 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,464 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,470 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,479 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:21:40,487 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/tr/x-1b255f4def2540a6000000000000000c/oa-4-big (108B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:21:40,494 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/tr/x-1b255f4def2540a6000000000000000c/oa-2-big (199B) INFO [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:40,583 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,610 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,657 Flushing.java:153 - Writing Memtable-column_masks@68217933(32B serialized bytes, 1 ops, 578B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,659 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,787 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa_txn_flush_4b483a60-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,813 CompactionManager.java:236 - Autocompaction on system_schema.column_masks is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,813 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,814 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 59.405KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,819 Flushing.java:153 - Writing Memtable-columns@877897171(12.668KiB serialized bytes, 73 ops, 59.405KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,827 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db (5.229KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,865 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_4b66e5f0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,867 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,867 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db')] (1 sstables, 7.404KiB), biggest 7.404KiB, smallest 7.404KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,869 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 42.250KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,874 Flushing.java:153 - Writing Memtable-tables@1834630833(12.824KiB serialized bytes, 16 ops, 42.250KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,877 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db (7.195KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,904 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_4b6f4a60-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,913 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,913 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db')] (1 sstables, 8.211KiB), biggest 8.211KiB, smallest 8.211KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:40,914 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 4.586KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,926 Flushing.java:153 - Writing Memtable-keyspaces@1972260342(932B serialized bytes, 6 ops, 4.586KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:40,927 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db (676B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,980 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_4b762830-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,986 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:40,987 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db')] (1 sstables, 5.591KiB), biggest 5.591KiB, smallest 5.591KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,016 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN), (NodeId{id=2},JOIN), (NodeId{id=3},JOIN), (NodeId{id=4},JOIN)] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,025 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.1:7012), nic: lo, encryption: unencrypted INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:41,032 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 694B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,041 Flushing.java:153 - Writing Memtable-local@1212522053(89B serialized bytes, 2 ops, 694B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,041 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db (38B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=15953) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,051 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,051 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,056 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,057 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:41,067 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:41,067 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,076 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,076 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,076 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,078 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,078 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,079 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,079 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,079 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,079 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,079 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,079 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,079 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,091 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,091 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,091 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,094 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_4b880280-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,102 CassandraDaemon.java:514 - opening keyspace distributed_test_keyspace DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,102 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,102 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,102 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,102 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,102 CassandraDaemon.java:514 - opening keyspace tr DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,103 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,103 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,103 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db')] (1 sstables, 5.040KiB), biggest 5.040KiB, smallest 5.040KiB INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:41,139 SecondaryIndexManager.java:947 - Executing pre-join post-bootstrap tasks for: CFS(Keyspace='tr', ColumnFamily='x') WARN 05:21:41 Using stored Gossip Generation 1720070502 as it is greater than current system time 1720070501. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:41,141 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070502 as it is greater than current system time 1720070501. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:41,143 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 1.991KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,159 Flushing.java:153 - Writing Memtable-local@1628559267(426B serialized bytes, 2 ops, 1.991KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,159 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (170B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=16405) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,189 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,195 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_4b994090-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,199 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,199 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 5.820KiB), biggest 5.820KiB, smallest 5.820KiB DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,201 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,201 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,201 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@30e17294 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:41,224 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 14, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,4), DC=Value(dc0,5), RACK=Value(rack0,6), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,7), RPC_ADDRESS=Value(127.0.0.1,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,9), TOKENS=Value(10,10), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,11), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,12), STATUS_WITH_PORT=Value(NORMAL,10,13)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:41,229 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:41,238 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:41,244 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0)} DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,249 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,249 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,249 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,249 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,249 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:41,252 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:44184)->/127.0.0.1:7012-URGENT_MESSAGES-74d05a56 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:41,253 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:44182)->/127.0.0.1:7012-URGENT_MESSAGES-cdca0833 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,273 CommitLog.java:205 - Replaying /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/commitlog/CommitLog-9-1720070477531.log INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:41,281 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:44182)->/127.0.0.1:7012-URGENT_MESSAGES-008c7cd8 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:41,281 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:44184)->/127.0.0.1:7012-URGENT_MESSAGES-d7172377 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,298 CommitLogReplayer.java:175 - Global replay position is CommitLogPosition(segmentId=-1, position=0) from columnfamilies 0ecdaa87-f8fb-3e60-88d1-74fb36fe5c0d:{}, b8b43d5f-d6c0-331c-8f7d-765ea658f4c4:{}, 618f817b-005f-3678-b8a4-53f3930b8e86:{}, b7b7f0c2-fd0a-3410-8c05-3ef614bb7c2d:{}, c4325fbb-8e5e-3baf-bd07-0f9250ed818e:{}, 5a8b1ca8-6602-3f77-a045-9273d308917a:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=84899)}, 0feb57ac-311f-382f-ba6d-9024d305702f:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=84899)}, 5a1ff267-ace0-3f12-8563-cfae6103c65e:{}, 4224a088-2ac9-3d0c-889d-fbb5f0facda0:{}, d6123acc-8649-3496-9d4e-f3fe39a6018b:{}, 4df70b66-6b05-3251-95a1-32b54005fd48:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=84899)}, deabd734-b99d-3b9c-92e5-fd92eb5abf14:{}, 176c39cd-b93d-33a5-a218-8eb06a56f66e:{}, ecb86667-40b2-3316-bb91-e612c8047457:{}, 4b3c50a9-ea87-3d76-9101-6dbc9c38494a:{}, 37f71aca-7dc2-383b-a706-72528af04d4f:{}, 24101c25-a2ae-3af7-87c1-b40ee1aca33f:{CommitLogPosition(segmentId=1720070477531, position=21799)=CommitLogPosition(segmentId=1720070477531, position=95142), CommitLogPosition(segmentId=1720070498584, position=28)=CommitLogPosition(segmentId=1720070498584, position=15780)}, 1ff78f1a-7df1-3a2a-a998-6f4932270af5:{}, d885727a-f67b-3a32-951b-78efe9c75732:{}, 7ad54392-bcdd-35a6-8417-4e047860b377:{CommitLogPosition(segmentId=1720070477531, position=66061)=CommitLogPosition(segmentId=1720070477531, position=69727), CommitLogPosition(segmentId=1720070498584, position=28)=CommitLogPosition(segmentId=1720070498584, position=16405)}, 7e5a361c-317c-351f-b15f-ffd8afd3dd4b:{}, afddfb9d-bc1e-3068-8056-eed6c302ba09:{CommitLogPosition(segmentId=1720070477531, position=21799)=CommitLogPosition(segmentId=1720070477531, position=95142), CommitLogPosition(segmentId=1720070498584, position=28)=CommitLogPosition(segmentId=1720070498584, position=15780)}, 5582b59f-8e4e-35e1-b913-3acada51eb04:{}, b4dbb7b4-dc49-3fb5-b3bf-ce6e434832ca:{}, 62efe31f-3be8-310c-8d29-8963439c1288:{}, 8826e8e9-e16a-3728-8753-3bc1fc713c25:{}, 9c48af00-13f6-3059-bb0e-8fcabba6eecb:{}, 9786ac1c-dd58-3201-a7cd-ad556410c985:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=84899)}, 0e65065f-e401-38ed-9507-b9213fae8d11:{}, 919a4bc5-7a33-3573-b03e-13fc3f68b465:{}, 5bc52802-de25-35ed-aeab-188eecebb090:{}, 6c22df66-c3bd-3df6-b74d-21179c6a9fe9:{}, 924c5587-2e3a-345b-b10c-12f37c1ba895:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=84899)}, 738cc5ed-0168-3268-b9d1-853d4bc278af:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=93915), CommitLogPosition(segmentId=1720070498584, position=28)=CommitLogPosition(segmentId=1720070498584, position=15780)}, 0bd47a48-d6ba-3c8e-b442-0f6349329bda:{}, 9f5c6374-d485-3229-9a0a-5094af9ad1e3:{}, abac5682-dea6-31c5-b535-b3d6cffd0fb6:{CommitLogPosition(segmentId=1720070477531, position=21799)=CommitLogPosition(segmentId=1720070477531, position=95327), CommitLogPosition(segmentId=1720070498584, position=28)=CommitLogPosition(segmentId=1720070498584, position=15780)}, 1b255f4d-ef25-40a6-0000-00000000000c:{CommitLogPosition(segmentId=1720070477531, position=92831)=CommitLogPosition(segmentId=1720070477531, position=100222)}, a3d277d1-cfaf-36f5-a2a7-38d5eea9ad6a:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=108577)}, 59dfeaea-8db2-3341-91ef-109974d81484:{}, 6775be21-7f1f-3a2f-90d5-bd313a15ce78:{}, e4ddd16e-bea6-31f4-8361-e88f07af8d4e:{CommitLogPosition(segmentId=1720070477531, position=67241)=CommitLogPosition(segmentId=1720070477531, position=92831)}, 3afbe79f-2194-31a7-add7-f5ab90d8ec9c:{}, c5e99f16-8677-3914-b17e-960613512345:{}, 6cad20f7-d4f5-3af2-b6e2-0da33c6c1f83:{}, 5e7583b5-f3f4-3af1-9a39-b7e1d6f5f11f:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=84899)}, 5f2fbdad-91f1-3946-bd25-d5da3a5c35ec:{}, 759fffad-624b-3181-80ee-fa9a52d1f627:{}, c539fcab-d65a-31d1-8133-d25605643ee3:{}, d46780c2-2f1c-3db9-b4c1-b8d9fbc0cc23:{}, 18a9c257-6a0c-3841-ba71-8cd529849fef:{}, 96489b79-80be-3e14-a701-66a0b9159450:{CommitLogPosition(segmentId=1720070477531, position=28)=CommitLogPosition(segmentId=1720070477531, position=84899)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,326 CommitLogReader.java:266 - Reading /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/commitlog/CommitLog-9-1720070477531.log (CL version 9, messaging version 14, compression null) INFO [node1_MutationStage-2] node1 2024-07-04 05:21:41,367 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,518 CommitLogReader.java:257 - Finished reading /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/commitlog/CommitLog-9-1720070477531.log INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,524 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: STARTUP, Usage: 58.268KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,525 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: STARTUP, Usage: 3.062KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,525 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: STARTUP, Usage: 39.356KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,525 ColumnFamilyStore.java:1060 - Enqueuing flush of system_distributed.parent_repair_history, Reason: STARTUP, Usage: 16.660KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,526 ColumnFamilyStore.java:1060 - Enqueuing flush of system_distributed.repair_history, Reason: STARTUP, Usage: 8.115KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,526 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: STARTUP, Usage: 12.235KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,526 ColumnFamilyStore.java:1060 - Enqueuing flush of system_auth.roles, Reason: STARTUP, Usage: 1.000KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,526 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: STARTUP, Usage: 11.273KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,527 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: STARTUP, Usage: 23.292KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,527 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: STARTUP, Usage: 13.860KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,527 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: STARTUP, Usage: 5.335KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,527 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: STARTUP, Usage: 14.013KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,527 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: STARTUP, Usage: 2.886KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,528 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: STARTUP, Usage: 3.567KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,528 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: STARTUP, Usage: 4.386KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:41,528 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: STARTUP, Usage: 2.163KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,538 Flushing.java:153 - Writing Memtable-columns@1568850566(12.513KiB serialized bytes, 72 ops, 58.268KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,544 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db (5.311KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,592 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_4bd3b180-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,599 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,599 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db')] (1 sstables, 7.447KiB), biggest 7.447KiB, smallest 7.447KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,613 Flushing.java:153 - Writing Memtable-keyspaces@1516557629(622B serialized bytes, 4 ops, 3.062KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,614 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db (461B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,670 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_4bde86f0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,678 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,678 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db')] (1 sstables, 5.471KiB), biggest 5.471KiB, smallest 5.471KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,686 Flushing.java:153 - Writing Memtable-tables@1052237698(12.069KiB serialized bytes, 15 ops, 39.356KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,687 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db (6.854KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,733 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_4beabbf0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,739 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,739 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db')] (1 sstables, 8.186KiB), biggest 8.186KiB, smallest 8.186KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,749 Flushing.java:153 - Writing Memtable-parent_repair_history@1374993208(2.832KiB serialized bytes, 8 ops, 16.660KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,751 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db (1.346KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,782 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa_txn_flush_4bf3e3b0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,784 CompactionManager.java:236 - Autocompaction on system_distributed.parent_repair_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,785 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db')] (1 sstables, 6.189KiB), biggest 6.189KiB, smallest 6.189KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,789 Flushing.java:153 - Writing Memtable-repair_history@438945138(1.570KiB serialized bytes, 8 ops, 8.115KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,790 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db (617B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,818 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa_txn_flush_4bfae890-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,820 CompactionManager.java:236 - Autocompaction on system_distributed.repair_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,820 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db')] (1 sstables, 6.179KiB), biggest 6.179KiB, smallest 6.179KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,824 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1721247287(4.060KiB serialized bytes, 13 ops, 12.235KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,826 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db (3.225KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,876 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa_txn_flush_4c003fc0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,887 CompactionManager.java:236 - Autocompaction on system_cluster_metadata.distributed_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,887 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db')] (1 sstables, 7.047KiB), biggest 7.047KiB, smallest 7.047KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,901 Flushing.java:153 - Writing Memtable-roles@1716764329(151B serialized bytes, 4 ops, 1.000KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,902 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db (83B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,953 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa_txn_flush_4c0aa000-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,964 CompactionManager.java:236 - Autocompaction on system_auth.roles is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:41,964 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db')] (1 sstables, 5.165KiB), biggest 5.165KiB, smallest 5.165KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,978 Flushing.java:153 - Writing Memtable-compaction_history@302703648(2.242KiB serialized bytes, 8 ops, 11.273KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:41,979 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db (1.109KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,031 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa_txn_flush_4c1638c0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,036 CompactionManager.java:236 - Autocompaction on system.compaction_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,036 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db')] (1 sstables, 6.244KiB), biggest 6.244KiB, smallest 6.244KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,042 Flushing.java:153 - Writing Memtable-paxos@1188868422(6.678KiB serialized bytes, 40 ops, 23.292KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,045 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db (5.427KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,047 UncommittedTableData.java:516 - flushing generation 0 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:42,071 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:59482)->/127.0.0.1:7012-URGENT_MESSAGES-9a9a9b02 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:42,072 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:59482)->/127.0.0.1:7012-URGENT_MESSAGES-58a43060 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,080 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa_txn_flush_4c215c50-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,083 CompactionManager.java:236 - Autocompaction on system.paxos is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,083 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db')] (1 sstables, 8.232KiB), biggest 8.232KiB, smallest 8.232KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,087 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1632804404(264B serialized bytes, 33 ops, 13.860KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,089 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db (1.472KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,138 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa_txn_flush_4c286130-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,144 CompactionManager.java:236 - Autocompaction on system.sstable_activity_v2 is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,145 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db')] (1 sstables, 6.859KiB), biggest 6.859KiB, smallest 6.859KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,153 Flushing.java:153 - Writing Memtable-peers_v2@437244481(951B serialized bytes, 25 ops, 5.335KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,153 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db (342B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,230 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa_txn_flush_4c31d710-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,238 CompactionManager.java:236 - Autocompaction on system.peers_v2 is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,238 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db')] (1 sstables, 5.771KiB), biggest 5.771KiB, smallest 5.771KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,246 Flushing.java:153 - Writing Memtable-sstable_activity@1600200388(264B serialized bytes, 33 ops, 14.013KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,248 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db (1.562KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,298 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa_txn_flush_4c402ef0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,306 CompactionManager.java:236 - Autocompaction on system.sstable_activity is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,306 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,326 Flushing.java:153 - Writing Memtable-repairs@2081735407(475B serialized bytes, 1 ops, 2.886KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,327 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db (178B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,357 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa_txn_flush_4c4a8f30-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,360 CompactionManager.java:236 - Autocompaction on system.repairs is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,360 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db')] (1 sstables, 5.824KiB), biggest 5.824KiB, smallest 5.824KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,364 Flushing.java:153 - Writing Memtable-local_metadata_log@163729511(1.681KiB serialized bytes, 3 ops, 3.567KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,365 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (1.485KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,392 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_4c52a580-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,395 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,395 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.902KiB), biggest 5.902KiB, smallest 5.902KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,408 Flushing.java:153 - Writing Memtable-peers@1832588996(795B serialized bytes, 25 ops, 4.386KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,408 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db (297B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,463 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa_txn_flush_4c57fcb0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,474 CompactionManager.java:236 - Autocompaction on system.peers is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,475 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db')] (1 sstables, 5.559KiB), biggest 5.559KiB, smallest 5.559KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,483 Flushing.java:153 - Writing Memtable-local@989573785(462B serialized bytes, 7 ops, 2.163KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,484 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=17926) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,531 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_4c6431b0-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,539 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,539 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db')] (1 sstables, 5.899KiB), biggest 5.899KiB, smallest 5.899KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,539 CommitLog.java:207 - Log replay complete, 214 replayed mutations INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,542 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,542 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,542 StorageService.java:704 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,543 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,576 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes WARN 05:21:42 Using stored Gossip Generation 1720070503 as it is greater than current system time 1720070502. See CASSANDRA-3654 if you experience problems WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,696 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070503 as it is greater than current system time 1720070502. See CASSANDRA-3654 if you experience problems INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,697 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,713 Flushing.java:153 - Writing Memtable-local@1612844179(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:42,714 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=61727) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,774 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_4c861190-39c5-11ef-9d7b-bd2859fa2036.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,776 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:42,777 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 4.974KiB), biggest 4.974KiB, smallest 4.974KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,778 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:42,779 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 25, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), RPC_ADDRESS=Value(127.0.0.1,19), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,796 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:42,797 Gossiper.java:511 - Convicting /127.0.0.2:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:21:42,797 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,798 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:42,798 Gossiper.java:511 - Convicting /127.0.0.3:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:21:42,798 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,798 FailureDetector.java:389 - Forcing conviction of /127.0.0.4:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:42,798 Gossiper.java:511 - Convicting /127.0.0.4:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:21:42,798 Gossiper.java:1154 - InetAddress /127.0.0.4:7012 is now DOWN INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:42,799 Gossiper.java:1940 - Waiting for gossip to settle... INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:43,184 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:42708)->/127.0.0.3:7012-URGENT_MESSAGES-6e786103 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:43,186 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:42708)->/127.0.0.3:7012-URGENT_MESSAGES-4f238878 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:43,188 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node3_GossipStage:1] node3 2024-07-04 05:21:43,188 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node3_GossipStage:1] node3 2024-07-04 05:21:43,189 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:43,192 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:43,193 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:43,193 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node2_GossipStage:1] node2 2024-07-04 05:21:43,194 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node2_GossipStage:1] node2 2024-07-04 05:21:43,194 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,196 Gossiper.java:1090 - Clearing interval times for /127.0.0.4:7012 due to generation change DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,196 Gossiper.java:1090 - Clearing interval times for /127.0.0.2:7012 due to generation change DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,196 Gossiper.java:1090 - Clearing interval times for /127.0.0.3:7012 due to generation change INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:43,196 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:51468)->/127.0.0.2:7012-URGENT_MESSAGES-0becdad5 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,197 Gossiper.java:1197 - Node /127.0.0.2:7012 has restarted, now UP INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:43,197 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:51468)->/127.0.0.2:7012-URGENT_MESSAGES-5a574775 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,198 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:43,200 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:43,200 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,206 Gossiper.java:1197 - Node /127.0.0.3:7012 has restarted, now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,206 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,209 Gossiper.java:1197 - Node /127.0.0.4:7012 has restarted, now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,211 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:43,213 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:53736)->/127.0.0.4:7012-URGENT_MESSAGES-bac9e579 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:43,213 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:53736)->/127.0.0.4:7012-URGENT_MESSAGES-ccc4a67d successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:43,216 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:43,216 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,217 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,217 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,217 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,218 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,218 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,218 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,218 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,218 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,218 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,218 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:43,219 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:43,219 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,219 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,219 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,219 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,220 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,220 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,220 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:43,220 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:43,220 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node4_BatchlogTasks:1] node4 2024-07-04 05:21:43,505 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint DEBUG [node2_BatchlogTasks:1] node2 2024-07-04 05:21:43,892 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint DEBUG [node3_BatchlogTasks:1] node3 2024-07-04 05:21:43,998 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:44,064 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node4_GossipStage:1] node4 2024-07-04 05:21:44,064 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node4_GossipStage:1] node4 2024-07-04 05:21:44,065 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:44,069 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:44,070 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:44,072 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:44,072 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,099 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 60, AppStateMap = {LOAD=Value(146880.0,45), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 60, AppStateMap = {NET_VERSION=Value(14,8), STATUS_WITH_PORT=Value(NORMAL,30,36), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), RACK=Value(rack0,29), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), TOKENS=Value(30,33), LOAD=Value(125770.0,45), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), DC=Value(dc0,28), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 61, AppStateMap = {LOAD=Value(125439.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(40,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,35), STATUS_WITH_PORT=Value(NORMAL,40,36), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,400 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 61, AppStateMap = {LOAD=Value(146880.0,45), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 60, AppStateMap = {NET_VERSION=Value(14,8), STATUS_WITH_PORT=Value(NORMAL,30,36), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), RACK=Value(rack0,29), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), TOKENS=Value(30,33), LOAD=Value(125770.0,45), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), DC=Value(dc0,28), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 61, AppStateMap = {LOAD=Value(125439.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(40,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,35), STATUS_WITH_PORT=Value(NORMAL,40,36), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,700 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 61, AppStateMap = {LOAD=Value(146880.0,45), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,32), TOKENS=Value(20,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,35), STATUS_WITH_PORT=Value(NORMAL,20,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 60, AppStateMap = {NET_VERSION=Value(14,8), STATUS_WITH_PORT=Value(NORMAL,30,36), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), RACK=Value(rack0,29), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,32), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), TOKENS=Value(30,33), LOAD=Value(125770.0,45), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), DC=Value(dc0,28), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070486, version = 61, AppStateMap = {LOAD=Value(125439.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,48), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(40,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,35), STATUS_WITH_PORT=Value(NORMAL,40,36), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,701 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,706 Startup.java:400 - NORMAL DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,715 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,715 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,722 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,729 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888512000 bytes available, checking if we can write 795 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,730 CompactionTask.java:167 - Compacting (4dbb5d40-39c5-11ef-9d7b-bd2859fa2036) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,732 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,738 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,763 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,789 CompactionTask.java:258 - Compacted (4dbb5d40-39c5-11ef-9d7b-bd2859fa2036) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-5-big,] to level=0. 795B to 277B (~34% of original) in 54ms. Read Throughput = 14.179KiB/s, Write Throughput = 4.940KiB/s, Row Throughput = ~6/s. 6 total partitions merged to 3. Partition merge counts were {2:3, }. Time spent writing keys = 26ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,789 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,790 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,792 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,793 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,795 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,796 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888554803 bytes available, checking if we can write 703 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,796 CompactionTask.java:167 - Compacting (4dc632b0-39c5-11ef-9d7b-bd2859fa2036) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,797 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,883 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,885 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,888 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,889 CompactionTask.java:258 - Compacted (4dc632b0-39c5-11ef-9d7b-bd2859fa2036) 7 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big,] to level=0. 703B to 231B (~32% of original) in 88ms. Read Throughput = 7.748KiB/s, Write Throughput = 2.546KiB/s, Row Throughput = ~2/s. 7 total partitions merged to 1. Partition merge counts were {7:1, }. Time spent writing keys = 18ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,889 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,890 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,890 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,890 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,890 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,890 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,890 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,892 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888679322 bytes available, checking if we can write 999 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,892 CompactionTask.java:167 - Compacting (4dd4d8b0-39c5-11ef-9d7b-bd2859fa2036) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,893 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,896 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,898 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:44,967 CompactionTask.java:258 - Compacted (4dd4d8b0-39c5-11ef-9d7b-bd2859fa2036) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big,] to level=0. 999B to 354B (~35% of original) in 73ms. Read Throughput = 13.185KiB/s, Write Throughput = 4.672KiB/s, Row Throughput = ~16/s. 19 total partitions merged to 8. Partition merge counts were {1:2, 2:1, 3:5, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,970 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,972 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,974 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:44,975 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,975 AbstractLocalProcessor.java:98 - Committed PrepareMove{nodeId=NodeId{id=1}, tokens=[15], streamData=true}. New epoch is Epoch{epoch=14} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:44,977 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=14} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:44,978 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 758B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:44,991 Flushing.java:153 - Writing Memtable-local_metadata_log@2071476632(114B serialized bytes, 1 ops, 758B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:44,992 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=67709) DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,028 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:45,028 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,028 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,029 LocalLog.java:492 - Enacted EXECUTED {PrepareMove{nodeId=NodeId{id=1}, tokens=[15], streamData=true}}. New tail is Epoch{epoch=14} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,030 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,032 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} to /127.0.0.4:7012 INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:45,032 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,032 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,032 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} to /127.0.0.2:7012 INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:45,035 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:45,035 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:45,035 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:45,035 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:45,035 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:45,036 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=14} -> Epoch{epoch=14}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,038 Move.java:193 - Moving /127.0.0.1:7012 from [10] to [15]. INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:45,041 Flushing.java:153 - Writing Memtable-local@1312857349(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:45,041 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=67791) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,060 AbstractLocalProcessor.java:98 - Committed StartMove{id=NodeId{id=1}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}}}}. New epoch is Epoch{epoch=15} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,061 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=15} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.243KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,062 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node4_GossipStage:1] node4 2024-07-04 05:21:45,065 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=14} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,065 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,091 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:45,091 Flushing.java:153 - Writing Memtable-local_metadata_log@258531793(114B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:45,092 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=89903) INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,092 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=13}} from /127.0.0.4:7012: start = Epoch{epoch=13}, current = Epoch{epoch=14} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,096 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=2: Epoch{epoch=14} -> Epoch{epoch=15}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:45,097 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=14} -> Epoch{epoch=15}} INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,101 Flushing.java:153 - Writing Memtable-local_metadata_log@130656534(114B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,101 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=84801) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,111 Flushing.java:153 - Writing Memtable-local_metadata_log@236661329(114B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,111 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (45B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=89496) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:45,138 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:21:45,138 LegacyStateListener.java:133 - Node /127.0.0.1:7012 state MOVING, tokens [10] DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:45,139 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 48, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,38), DC=Value(dc0,39), RACK=Value(rack0,40), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,41), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,42), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,43), TOKENS=Value(10,44), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,45), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,46), STATUS_WITH_PORT=Value(MOVING,15,47), SSTABLE_VERSIONS=Value(big-oa,33)} INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:45,150 Flushing.java:153 - Writing Memtable-local_metadata_log@701006126(629B serialized bytes, 1 ops, 1.243KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:45,150 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (562B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=70819) INFO [node2_GossipStage:1] node2 2024-07-04 05:21:45,196 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=14} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,196 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=13}} from /127.0.0.2:7012: start = Epoch{epoch=13}, current = Epoch{epoch=14} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,200 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=2: Epoch{epoch=14} -> Epoch{epoch=15}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:45,201 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=14} -> Epoch{epoch=15}} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:45,206 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,206 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,206 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,206 LocalLog.java:492 - Enacted PrepareMove{nodeId=NodeId{id=1}, tokens=[15], streamData=true}. New tail is Epoch{epoch=14} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,207 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:21:45,208 LegacyStateListener.java:133 - Node /127.0.0.1:7012 state MOVING, tokens [10] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,210 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.242KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:45,230 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:45,230 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,230 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,230 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,230 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,230 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,230 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),52), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1232)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,230 LocalLog.java:492 - Enacted PrepareMove{nodeId=NodeId{id=1}, tokens=[15], streamData=true}. New tail is Epoch{epoch=14} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,230 LocalLog.java:492 - Enacted PrepareMove{nodeId=NodeId{id=1}, tokens=[15], streamData=true}. New tail is Epoch{epoch=14} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,231 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:45,231 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,38), DC=Value(dc0,39), RACK=Value(rack0,40), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,41), RPC_ADDRESS=Value(127.0.0.1,0), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,43), TOKENS=Value(10,44), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,45), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,46), STATUS_WITH_PORT=Value(MOVING,15,47), SSTABLE_VERSIONS=Value(big-oa,33)} DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,231 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888620954 bytes available, checking if we can write 2131 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,231 CompactionTask.java:167 - Compacting (4e0892e0-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,232 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:21:45,232 LegacyStateListener.java:133 - Node /127.0.0.1:7012 state MOVING, tokens [10] DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:21:45,233 LegacyStateListener.java:133 - Node /127.0.0.1:7012 state MOVING, tokens [10] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,236 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.242KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:45,237 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), RPC_ADDRESS=Value(127.0.0.1,0), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(MOVING,15,24), SSTABLE_VERSIONS=Value(big-oa,33)} DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:45,238 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), RPC_ADDRESS=Value(127.0.0.1,0), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(MOVING,15,24), SSTABLE_VERSIONS=Value(big-oa,33)} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:45,244 Flushing.java:153 - Writing Memtable-local_metadata_log@2124118261(629B serialized bytes, 1 ops, 1.242KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:45,244 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db (562B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=91086) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,253 Flushing.java:153 - Writing Memtable-local_metadata_log@1812793305(629B serialized bytes, 1 ops, 1.242KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,254 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (562B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=85437) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:45,264 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.278KiB), biggest 5.278KiB, smallest 5.278KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,264 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,264 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,265 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),1838), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),224), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),832), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),52)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,264 LocalLog.java:492 - Enacted EXECUTED {StartMove{id=NodeId{id=1}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}}}}}. New tail is Epoch{epoch=15} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,266 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888570368 bytes available, checking if we can write 2946 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,266 CompactionTask.java:167 - Compacting (4e0dea10-39c5-11ef-9d7b-bd2859fa2036) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,266 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,266 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} to /127.0.0.4:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,267 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,267 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} to /127.0.0.2:7012 INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:45,268 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:45,268 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:45,268 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:45,268 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:45,269 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:45,269 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,271 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.244KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_OptionalTasks:1] node2 2024-07-04 05:21:45,272 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=15} INFO [node4_OptionalTasks:1] node4 2024-07-04 05:21:45,273 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=15} INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:45,273 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=15} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,274 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=14}} from /127.0.0.2:7012: start = Epoch{epoch=14}, current = Epoch{epoch=15} INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:45,275 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:59496)->/127.0.0.1:7012-URGENT_MESSAGES-779df5ab messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:45,275 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:59496)->/127.0.0.1:7012-URGENT_MESSAGES-b53fbc8e successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,276 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:45,276 ProgressBarrier.java:538 - Received watermark response from /127.0.0.1:7012 with epoch Epoch{epoch=15} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,277 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=14}} from /127.0.0.3:7012: start = Epoch{epoch=14}, current = Epoch{epoch=15} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,277 Flushing.java:153 - Writing Memtable-local_metadata_log@1465650361(629B serialized bytes, 1 ops, 1.244KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,278 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db (562B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=90639) INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,279 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,280 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=14}} from /127.0.0.4:7012: start = Epoch{epoch=14}, current = Epoch{epoch=15} DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:45,280 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,282 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,303 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,303 CompactionTask.java:258 - Compacted (4e0892e0-39c5-11ef-a91a-654b51ec069b) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.081KiB to 1.807KiB (~86% of original) in 71ms. Read Throughput = 29.181KiB/s, Write Throughput = 25.333KiB/s, Row Throughput = ~28/s. 14 total partitions merged to 14. Partition merge counts were {1:14, }. Time spent writing keys = 23ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,304 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,304 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,305 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,307 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,310 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:45,333 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db')] (1 sstables, 5.278KiB), biggest 5.278KiB, smallest 5.278KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,333 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,333 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,333 LocalLog.java:492 - Enacted StartMove{id=NodeId{id=1}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}}}}. New tail is Epoch{epoch=15} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,335 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:45,335 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:45,335 ProgressBarrier.java:538 - Received watermark response from /127.0.0.2:7012 with epoch Epoch{epoch=15} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,335 LocalLog.java:523 - An already appended entry Epoch{epoch=15} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=15} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:45,338 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.273KiB), biggest 5.273KiB, smallest 5.273KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,338 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,338 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,338 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,339 CompactionTask.java:258 - Compacted (4e0dea10-39c5-11ef-9d7b-bd2859fa2036) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big,] to level=0. 2.877KiB to 1.953KiB (~67% of original) in 70ms. Read Throughput = 40.670KiB/s, Write Throughput = 27.610KiB/s, Row Throughput = ~30/s. 18 total partitions merged to 15. Partition merge counts were {1:12, 2:3, }. Time spent writing keys = 12ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,339 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,339 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,338 LocalLog.java:492 - Enacted StartMove{id=NodeId{id=1}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}}}}. New tail is Epoch{epoch=15} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,339 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,340 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:45,340 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=15} -> Epoch{epoch=15}} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,341 LocalLog.java:523 - An already appended entry Epoch{epoch=15} discovered in the pending buffer, ignoring. Max consecutive: Epoch{epoch=15} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:45,341 ProgressBarrier.java:538 - Received watermark response from /127.0.0.4:7012 with epoch Epoch{epoch=15} INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,343 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,345 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:45,365 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db')] (1 sstables, 5.274KiB), biggest 5.274KiB, smallest 5.274KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,365 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,365 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,365 LocalLog.java:492 - Enacted StartMove{id=NodeId{id=1}, kind=START_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}}}}}. New tail is Epoch{epoch=15} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:45,366 ProgressBarrier.java:538 - Received watermark response from /127.0.0.3:7012 with epoch Epoch{epoch=15} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,366 ProgressBarrier.java:237 - Collected acknowledgements from [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012] of nodes for a progress barrier for epoch Epoch{epoch=15} at EACH_QUORUM INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,366 Move.java:208 - fetching new ranges and streaming old ranges DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,367 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,375 Move.java:229 - Stream source: Full(/127.0.0.2:7012,(10,15]) destination: Full(/127.0.0.1:7012,(10,15]) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,381 Move.java:229 - Stream source: Full(/127.0.0.4:7012,(10,15]) destination: Full(/127.0.0.1:7012,(10,15]) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,381 Move.java:229 - Stream source: Full(/127.0.0.3:7012,(10,15]) destination: Full(/127.0.0.1:7012,(10,15]) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,381 Move.java:229 - Stream source: Full(/127.0.0.3:7012,(10,15]) destination: Full(/127.0.0.1:7012,(10,15]) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,381 Move.java:229 - Stream source: Transient(/127.0.0.4:7012,(10,15]) destination: Full(/127.0.0.1:7012,(10,15]) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,385 StreamResultFuture.java:98 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Executing streaming plan for Relocation INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,385 StreamSession.java:396 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Starting streaming to 127.0.0.2:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,388 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:45,391 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:51472)->/127.0.0.2:7012-STREAMING-148e02a9 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,393 StreamingMultiplexedChannel.java:473 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 8ac7ac13] Scheduling keep-alive task with 300s period. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,394 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:51472 channel.id 8ac7ac13 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,395 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from INITIALIZED to PREPARING INFO [node2_Stream-Deserializer-/127.0.0.1:7012-148e02a9] node2 2024-07-04 05:21:45,395 StreamResultFuture.java:123 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Creating new streaming plan for Relocation from /127.0.0.1:7012 channel.remote /127.0.0.1:51472 channel.local /127.0.0.2:7012 channel.id 148e02a9 INFO [node2_Stream-Deserializer-/127.0.0.1:7012-148e02a9] node2 2024-07-04 05:21:45,396 StreamResultFuture.java:131 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036, ID#0] Received streaming plan for Relocation from /127.0.0.1:7012 channel.remote /127.0.0.1:51472 channel.local /127.0.0.2:7012 channel.id 148e02a9 DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-148e02a9] node2 2024-07-04 05:21:45,396 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 148e02a9] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 4e1da180-39c5-11ef-9d7b-bd2859fa2036, session index = 0 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,396 StreamCoordinator.java:268 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,396 StreamSession.java:396 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Starting streaming to 127.0.0.3:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,396 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-148e02a9] node2 2024-07-04 05:21:45,396 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 148e02a9] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-148e02a9] node2 2024-07-04 05:21:45,396 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from INITIALIZED to PREPARING DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,397 StreamResultFuture.java:187 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,398 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from PREPARING to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,398 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 8ac7ac13] Received Prepare SYNACK ( 0 files} DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,398 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,398 StreamResultFuture.java:201 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Session with /127.0.0.1:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,398 StreamResultFuture.java:260 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] All sessions completed INFO [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,399 StreamResultFuture.java:187 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:45,399 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:42722)->/127.0.0.3:7012-STREAMING-7bef2dd2 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,399 StreamingMultiplexedChannel.java:473 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 2c7b21c5] Scheduling keep-alive task with 300s period. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,400 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:42722 channel.id 2c7b21c5 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,400 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from INITIALIZED to PREPARING INFO [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,400 StreamResultFuture.java:123 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Creating new streaming plan for Relocation from /127.0.0.1:7012 channel.remote /127.0.0.1:42722 channel.local /127.0.0.3:7012 channel.id 7bef2dd2 INFO [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,400 StreamResultFuture.java:131 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036, ID#0] Received streaming plan for Relocation from /127.0.0.1:7012 channel.remote /127.0.0.1:42722 channel.local /127.0.0.3:7012 channel.id 7bef2dd2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,400 StreamCoordinator.java:268 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036, ID#0] Beginning stream session with /127.0.0.3:7012 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,400 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 7bef2dd2] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 4e1da180-39c5-11ef-9d7b-bd2859fa2036, session index = 0 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,400 StreamSession.java:396 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Starting streaming to 127.0.0.4:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,400 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.4:7012 as initiator DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,401 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 7bef2dd2] Received Prepare SYN (2 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,401 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from INITIALIZED to PREPARING DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,401 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,401 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from PREPARING to STREAMING DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,401 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,401 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,402 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 8ac7ac13] Received Complete DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,402 StreamSession.java:1128 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] handling Complete message, state = WAIT_COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,402 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: STREAMING, Usage: 8.125KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,402 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,402 StreamResultFuture.java:201 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Session with /127.0.0.2:7012 is complete INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:45,403 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:53740)->/127.0.0.4:7012-STREAMING-32630bd2 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,403 StreamingMultiplexedChannel.java:473 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 91915d1f] Scheduling keep-alive task with 300s period. DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,403 StreamSession.java:564 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Will close attached inbound {8ac7ac13=org.apache.cassandra.streaming.async.NettyStreamingChannel@687e182a} and outbound {8ac7ac13=org.apache.cassandra.streaming.async.NettyStreamingChannel@687e182a} channels DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,403 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:53740 channel.id 91915d1f DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,404 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from INITIALIZED to PREPARING INFO [node4_Stream-Deserializer-/127.0.0.1:7012-32630bd2] node4 2024-07-04 05:21:45,404 StreamResultFuture.java:123 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Creating new streaming plan for Relocation from /127.0.0.1:7012 channel.remote /127.0.0.1:53740 channel.local /127.0.0.4:7012 channel.id 32630bd2 DEBUG [Streaming-EventLoop-4-1] node1 2024-07-04 05:21:45,404 StreamingMultiplexedChannel.java:514 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Closing stream connection channels on /127.0.0.2:7012 INFO [node4_Stream-Deserializer-/127.0.0.1:7012-32630bd2] node4 2024-07-04 05:21:45,404 StreamResultFuture.java:131 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036, ID#0] Received streaming plan for Relocation from /127.0.0.1:7012 channel.remote /127.0.0.1:53740 channel.local /127.0.0.4:7012 channel.id 32630bd2 DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-32630bd2] node4 2024-07-04 05:21:45,404 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 32630bd2] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 4e1da180-39c5-11ef-9d7b-bd2859fa2036, session index = 0 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:45,404 StreamingMultiplexedChannel.java:514 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-148e02a9] node2 2024-07-04 05:21:45,405 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-148e02a9] node2 2024-07-04 05:21:45,405 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,405 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,405 StreamCoordinator.java:268 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036, ID#0] Beginning stream session with /127.0.0.4:7012 DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-32630bd2] node4 2024-07-04 05:21:45,405 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 32630bd2] Received Prepare SYN (2 requests, 0 files} DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-32630bd2] node4 2024-07-04 05:21:45,405 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from INITIALIZED to PREPARING DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-8ac7ac13] node1 2024-07-04 05:21:45,405 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,406 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,406 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,406 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,406 CassandraStreamManager.java:129 - ViewFilter for 0/0 sstables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,406 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: STREAMING, Usage: 4.043KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,412 Flushing.java:153 - Writing Memtable-x@1866528153(580B serialized bytes, 20 ops, 8.125KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,413 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db (235B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=90639) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,416 Flushing.java:153 - Writing Memtable-x@979223936(290B serialized bytes, 10 ops, 4.043KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,417 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db (115B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=86986) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:45,508 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db')] (1 sstables, 5.268KiB), biggest 5.268KiB, smallest 5.268KiB DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:45,508 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db')] (1 sstables, 5.070KiB), biggest 5.070KiB, smallest 5.070KiB DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,508 CassandraStreamManager.java:129 - ViewFilter for 2/3 sstables DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,508 CassandraStreamManager.java:129 - ViewFilter for 0/3 sstables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,508 StreamResultFuture.java:187 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,509 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from PREPARING to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,509 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 91915d1f] Received Prepare SYNACK ( 0 files} INFO [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,509 StreamResultFuture.java:187 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,509 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from PREPARING to STREAMING DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,509 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,509 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,509 StreamResultFuture.java:201 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Session with /127.0.0.1:7012 is complete DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,509 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 91915d1f] Received Complete DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,510 StreamSession.java:1128 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] handling Complete message, state = WAIT_COMPLETE DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,510 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:45,510 StreamResultFuture.java:260 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] All sessions completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,510 StreamResultFuture.java:201 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Session with /127.0.0.4:7012 is complete DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,510 StreamSession.java:564 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Will close attached inbound {91915d1f=org.apache.cassandra.streaming.async.NettyStreamingChannel@7fa5fcf3} and outbound {91915d1f=org.apache.cassandra.streaming.async.NettyStreamingChannel@7fa5fcf3} channels DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,510 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.4:7012-91915d1f] node1 2024-07-04 05:21:45,510 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-1] node1 2024-07-04 05:21:45,510 StreamingMultiplexedChannel.java:514 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:45,510 StreamingMultiplexedChannel.java:514 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-32630bd2] node4 2024-07-04 05:21:45,511 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.1:7012-32630bd2] node4 2024-07-04 05:21:45,511 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,514 StreamResultFuture.java:187 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Prepare completed. Receiving 0 files(0B), sending 2 files(302B) DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,515 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 2c7b21c5] Received Prepare SYNACK ( 2 files} INFO [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,517 StreamResultFuture.java:187 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Prepare completed. Receiving 2 files(302B), sending 0 files(0B) DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,517 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 7bef2dd2] Received Prepare ACK INFO [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,517 StreamResultFuture.java:187 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 ID#0] Prepare completed. Receiving 0 files(0B), sending 2 files(302B) DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,517 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,517 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,517 StreamingMultiplexedChannel.java:220 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #0, repairedAt: 0, pendingRepair: null, sendByFollower: true), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db}} DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,518 StreamingMultiplexedChannel.java:220 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #1, repairedAt: 1720070492607, pendingRepair: null, sendByFollower: true), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db}} DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:45,518 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.1:7012 as follower DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:45,519 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.1:7012 as follower DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:45,520 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:59508 channel.id 434e6017 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:45,520 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:59512 channel.id d47e3f00 INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:45,521 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:59508)->/127.0.0.1:7012-STREAMING-c43c733b streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:45,521 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:59512)->/127.0.0.1:7012-STREAMING-de3f8a32 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:45,524 CassandraCompressedStreamWriter.java:62 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Start streaming file /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db to /127.0.0.1:7012, repairedAt = 0, totalSize = 193 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:45,524 CassandraCompressedStreamWriter.java:62 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Start streaming file /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db to /127.0.0.1:7012, repairedAt = 1720070492607, totalSize = 109 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:45,524 CassandraCompressedStreamWriter.java:80 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Writing section 0 with length 109 to stream. DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:45,524 CassandraCompressedStreamWriter.java:80 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Writing section 0 with length 193 to stream. DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:1] node3 2024-07-04 05:21:45,526 CassandraCompressedStreamWriter.java:101 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db to /127.0.0.1:7012, bytesTransferred = 193B, totalSize = 193B DEBUG [node3_NettyStreaming-Outbound-/127.0.0.1.7012:2] node3 2024-07-04 05:21:45,526 CassandraCompressedStreamWriter.java:101 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db to /127.0.0.1:7012, bytesTransferred = 109B, totalSize = 109B DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-de3f8a32] node1 2024-07-04 05:21:45,526 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-c43c733b] node1 2024-07-04 05:21:45,526 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-de3f8a32] node1 2024-07-04 05:21:45,527 CassandraCompressedStreamReader.java:68 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Start receiving file #1 from /127.0.0.3:7012, repairedAt = 1720070492607, size = 109, ks = 'tr', pendingRepair = 'null', table = 'x'. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-c43c733b] node1 2024-07-04 05:21:45,527 CassandraCompressedStreamReader.java:68 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Start receiving file #0 from /127.0.0.3:7012, repairedAt = 0, size = 193, ks = 'tr', pendingRepair = 'null', table = 'x'. INFO [node1_Stream-Deserializer-/127.0.0.3:7012-c43c733b] node1 2024-07-04 05:21:45,539 CassandraCompressedStreamReader.java:107 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Finished receiving file #0 from /127.0.0.3:7012 readBytes = 193B, totalSize = 193B DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-c43c733b] node1 2024-07-04 05:21:45,539 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: c43c733b] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #0, repairedAt: 0, pendingRepair: null, sendByFollower: true), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-c43c733b] node1 2024-07-04 05:21:45,540 StreamReceiveTask.java:87 - received 1 of 2 total files, 193 of total bytes 193 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,540 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 7bef2dd2] Received Received (1b255f4d-ef25-40a6-0000-00000000000c, #0) INFO [node1_Stream-Deserializer-/127.0.0.3:7012-de3f8a32] node1 2024-07-04 05:21:45,540 CassandraCompressedStreamReader.java:107 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Finished receiving file #1 from /127.0.0.3:7012 readBytes = 109B, totalSize = 109B DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,540 StreamTransferTask.java:93 - received sequenceNumber 0, remaining files [1] DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-de3f8a32] node1 2024-07-04 05:21:45,559 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: de3f8a32] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000c, #1, repairedAt: 1720070492607, pendingRepair: null, sendByFollower: true), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-de3f8a32] node1 2024-07-04 05:21:45,560 StreamReceiveTask.java:87 - received 2 of 2 total files, 302 of total bytes 109 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,560 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 7bef2dd2] Received Received (1b255f4d-ef25-40a6-0000-00000000000c, #1) DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,560 StreamTransferTask.java:93 - received sequenceNumber 1, remaining files [] DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,560 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from STREAMING to COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,561 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from COMPLETE to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,561 StreamDeserializingTask.java:132 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036 channel: 2c7b21c5] Received Complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,561 StreamResultFuture.java:201 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Session with /127.0.0.1:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,561 StreamResultFuture.java:260 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] All sessions completed DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,582 StreamSession.java:1128 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] handling Complete message, state = STREAMING DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,583 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node1_StreamReceiveTask:1] node1 2024-07-04 05:21:45,588 CassandraStreamReceiver.java:257 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Received 2 sstables from /127.0.0.3:7012 ([BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data2/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db')]) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,589 StreamSession.java:596 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,589 StreamResultFuture.java:201 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Session with /127.0.0.3:7012 is complete INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,590 StreamResultFuture.java:260 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] All sessions completed DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:45,590 StreamSession.java:564 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Will close attached inbound {c43c733b=org.apache.cassandra.streaming.async.NettyStreamingChannel@59286fff, de3f8a32=org.apache.cassandra.streaming.async.NettyStreamingChannel@55de66f1, 2c7b21c5=org.apache.cassandra.streaming.async.NettyStreamingChannel@6bbc19e3} and outbound {2c7b21c5=org.apache.cassandra.streaming.async.NettyStreamingChannel@6bbc19e3} channels INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,590 StorageService.java:3291 - skipping paxos repair for move. skip_paxos_repair_on_topology_change is set DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-c43c733b] node1 2024-07-04 05:21:45,591 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,591 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-de3f8a32] node1 2024-07-04 05:21:45,591 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-c43c733b] node1 2024-07-04 05:21:45,591 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-2c7b21c5] node1 2024-07-04 05:21:45,591 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-de3f8a32] node1 2024-07-04 05:21:45,591 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:45,591 StreamingMultiplexedChannel.java:514 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:45,591 StreamingMultiplexedChannel.java:514 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,591 TestProcessor.java:76 - Test processor is paused, waiting... DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,591 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-7bef2dd2] node3 2024-07-04 05:21:45,591 StreamSession.java:712 - [Stream #4e1da180-39c5-11ef-9d7b-bd2859fa2036] Socket closed after session completed with state COMPLETE DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:45,596 TestChangeListener.java:82 - Requesting pause before enacting Epoch{epoch=16} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,598 TestProcessor.java:82 - Resumed test processor... INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,603 AbstractLocalProcessor.java:98 - Committed MidMove{id=NodeId{id=1}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}}}}. New epoch is Epoch{epoch=16} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,603 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=16} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,604 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.390KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:45,614 Flushing.java:153 - Writing Memtable-local_metadata_log@1501447696(779B serialized bytes, 1 ops, 1.390KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:45,614 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=75496) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:45,668 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.323KiB), biggest 5.323KiB, smallest 5.323KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,668 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:45,668 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,668 LocalLog.java:492 - Enacted EXECUTED {MidMove{id=NodeId{id=1}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}}}}}. New tail is Epoch{epoch=16} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:45,670 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,670 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} to /127.0.0.4:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,671 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:45,671 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} to /127.0.0.2:7012 INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:45,672 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:45,672 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:45,672 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:45,672 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:45,673 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} from /127.0.0.1:7012 INFO [node4_OptionalTasks:1] node4 2024-07-04 05:21:45,673 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=16} DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:45,673 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node3_OptionalTasks:1] node3 2024-07-04 05:21:45,673 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=16} INFO [node2_OptionalTasks:1] node2 2024-07-04 05:21:45,673 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=16} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,674 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=15}} from /127.0.0.4:7012: start = Epoch{epoch=15}, current = Epoch{epoch=16} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:45,674 ProgressBarrier.java:538 - Received watermark response from /127.0.0.1:7012 with epoch Epoch{epoch=16} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,675 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.389KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,677 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.389KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,677 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,678 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.391KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,678 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=15}} from /127.0.0.2:7012: start = Epoch{epoch=15}, current = Epoch{epoch=16} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:21:45,680 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,681 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,682 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=15}} from /127.0.0.3:7012: start = Epoch{epoch=15}, current = Epoch{epoch=16} INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,682 Flushing.java:153 - Writing Memtable-local_metadata_log@22528509(779B serialized bytes, 1 ops, 1.389KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:45,683 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=87772) DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:45,683 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:45,685 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,686 Flushing.java:153 - Writing Memtable-local_metadata_log@1324992829(779B serialized bytes, 1 ops, 1.391KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:45,686 Flushing.java:153 - Writing Memtable-local_metadata_log@252132417(779B serialized bytes, 1 ops, 1.389KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:45,686 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=92379) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:45,686 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (712B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=91425) DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:45,688 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=16} -> Epoch{epoch=16}} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:45,781 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db')] (1 sstables, 5.332KiB), biggest 5.332KiB, smallest 5.332KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,781 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:45,781 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,781 LocalLog.java:492 - Enacted MidMove{id=NodeId{id=1}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}}}}. New tail is Epoch{epoch=16} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:45,781 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:45,782 ProgressBarrier.java:538 - Received watermark response from /127.0.0.4:7012 with epoch Epoch{epoch=16} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:45,790 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.323KiB), biggest 5.323KiB, smallest 5.323KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,790 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,790 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:45,790 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.333KiB), biggest 5.333KiB, smallest 5.333KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,791 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,791 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,791 TestChangeListener.java:58 - Epoch matches pre-commit predicate, pausing DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:45,791 TestChangeListener.java:109 - Log follower is paused, waiting... DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,791 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),1824), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),220), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),52), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),280)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,791 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),1825), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),224), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),52), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),272)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,791 LocalLog.java:492 - Enacted MidMove{id=NodeId{id=1}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}}}}. New tail is Epoch{epoch=16} DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,791 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888317440 bytes available, checking if we can write 2376 bytes DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,791 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888317440 bytes available, checking if we can write 2373 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,792 CompactionTask.java:167 - Compacting (4e5e2cf0-39c5-11ef-99a4-a939d1f9f39c) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,792 CompactionTask.java:167 - Compacting (4e5e2cf0-39c5-11ef-be06-a3f8887dcaed) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, ] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:45,792 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:45,793 ProgressBarrier.java:538 - Received watermark response from /127.0.0.2:7012 with epoch Epoch{epoch=16} INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,817 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,817 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,818 StorageService.java:2564 - Starting Cleanup on system_auth.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,818 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,819 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,820 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,820 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,820 StorageService.java:2564 - Starting Cleanup on system_distributed.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,820 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,820 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,820 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,821 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,821 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,821 StorageService.java:2564 - Starting Cleanup on system_traces.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,821 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,821 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,821 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,822 StorageService.java:2564 - Starting Cleanup on tr.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,822 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:45,822 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,836 CompactionTask.java:258 - Compacted (4e5e2cf0-39c5-11ef-99a4-a939d1f9f39c) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big,] to level=0. 2.320KiB to 2.069KiB (~89% of original) in 43ms. Read Throughput = 53.763KiB/s, Write Throughput = 47.947KiB/s, Row Throughput = ~32/s. 16 total partitions merged to 16. Partition merge counts were {1:16, }. Time spent writing keys = 17ms DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,836 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:45,836 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,836 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,839 CompactionTask.java:258 - Compacted (4e5e2cf0-39c5-11ef-be06-a3f8887dcaed) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big,] to level=0. 2.317KiB to 2.061KiB (~88% of original) in 46ms. Read Throughput = 49.769KiB/s, Write Throughput = 44.253KiB/s, Row Throughput = ~32/s. 16 total partitions merged to 16. Partition merge counts were {1:16, }. Time spent writing keys = 17ms DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,839 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,840 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,840 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,840 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,842 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,842 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:45,844 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,844 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,847 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,852 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,853 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,853 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,855 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,855 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,855 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,856 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,856 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,856 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,856 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,856 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,856 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,856 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,857 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,858 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,859 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,860 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,860 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,860 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,860 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,860 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,860 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,860 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,861 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,861 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,862 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,863 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,864 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,864 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,864 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,864 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,864 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,864 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,865 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,866 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,866 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,866 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,866 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,867 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,867 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,867 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:45,868 CompactionManager.java:681 - Skipping cleanup for 0/2 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10]], transient ranges: [(30,40]]) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,870 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,936 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 66ms. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:45,936 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db') INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:45,938 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,005 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db. 199B to 199B (~100% of original) for 20 keys. Time: 69ms. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,005 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,006 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:46,006 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,040 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,041 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,041 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,044 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,044 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,044 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,045 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,045 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,045 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,046 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,046 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,046 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,046 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,046 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,047 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,047 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,047 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,047 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,047 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,048 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,048 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,048 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,048 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,048 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,049 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,049 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,049 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,049 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,049 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,050 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,050 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,050 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,050 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,051 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,052 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,053 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,053 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,054 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,054 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,054 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,055 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,056 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,056 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,056 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,056 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,056 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,056 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,057 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,057 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,057 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,057 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,057 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,057 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,057 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,058 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,058 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,058 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,058 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,058 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,059 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,059 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,059 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,059 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,059 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,059 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,059 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,060 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,061 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,061 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,061 CompactionManager.java:681 - Skipping cleanup for 0/3 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30]], transient ranges: [(40,], (,10]]) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,063 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,127 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 64ms. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,127 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db') INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:46,128 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,184 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 56ms. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,184 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:46,187 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,254 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db. 193B to 193B (~100% of original) for 20 keys. Time: 69ms. INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,254 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,255 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:46,258 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,283 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,284 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,285 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,287 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,287 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,287 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,287 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,287 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,288 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,288 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,288 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,288 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,288 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,289 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,289 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,289 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,289 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,289 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,290 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,290 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,290 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,290 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,290 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,291 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,291 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,291 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,291 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,291 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,291 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,291 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,292 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,293 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,293 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,293 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,293 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,293 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,293 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,293 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,294 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,294 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,294 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,295 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,296 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,296 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,296 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,296 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,296 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,297 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,297 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,297 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,297 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,297 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,297 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,297 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,298 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,299 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,299 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,299 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,299 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,299 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,300 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,300 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,300 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,300 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,300 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,300 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,301 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,301 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,301 CompactionManager.java:441 - Starting Cleanup for tr.x DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,302 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') ([22, 40]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,302 CompactionManager.java:681 - Skipping cleanup for 1/3 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: [(10,15], (15,20]]) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,304 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big-Data.db') INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,360 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 56ms. INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,361 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big-Data.db') INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,363 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-4-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,414 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 53ms. INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,414 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,414 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,416 TestChangeListener.java:116 - Unpausing log follower INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,416 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-2-big DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,416 TestChangeListener.java:111 - Resumed log follower... INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,416 LocalLog.java:492 - Enacted MidMove{id=NodeId{id=1}, kind=MID_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={}, additions={}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(10,15])]}}, writes=Delta{removals={}, additions={}}}}}}. New tail is Epoch{epoch=16} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:46,418 ProgressBarrier.java:538 - Received watermark response from /127.0.0.3:7012 with epoch Epoch{epoch=16} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,418 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,418 ProgressBarrier.java:237 - Collected acknowledgements from [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.4:7012] of nodes for a progress barrier for epoch Epoch{epoch=16} at EACH_QUORUM INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,421 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 700B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,437 Flushing.java:153 - Writing Memtable-local@1676673118(63B serialized bytes, 1 ops, 700B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,438 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=75573) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,447 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,448 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,448 StorageService.java:2564 - Starting Cleanup on system_auth.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,448 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,449 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,450 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,450 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,450 StorageService.java:2564 - Starting Cleanup on system_distributed.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,451 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,451 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,451 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,451 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,451 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,451 StorageService.java:2564 - Starting Cleanup on system_traces.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,452 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,452 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,452 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,452 StorageService.java:2564 - Starting Cleanup on tr.[] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,453 CompactionManager.java:632 - Cleanup cannot run before a node has joined the ring INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:21:46,453 StorageService.java:2571 - Completed Cleanup with status ABORTED INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,473 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,474 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,474 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,475 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,475 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,475 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,475 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,475 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,476 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,476 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,476 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,476 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,476 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,476 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,476 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,477 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,478 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(10,15], (15,20]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,479 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,480 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,480 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,481 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,482 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,483 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,483 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,483 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,483 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,483 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,483 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,484 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,484 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,484 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,484 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10]], transient ranges: []) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,484 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,484 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,484 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,485 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,485 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,485 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,485 CompactionManager.java:681 - Skipping cleanup for 0/2 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10]], transient ranges: [(30,40]]) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,486 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:46,501 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,508 AbstractLocalProcessor.java:98 - Committed FinishMove{id=NodeId{id=1}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,10]), Transient(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15]), Transient(/127.0.0.3:7012,(,10])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}}}}}. New epoch is Epoch{epoch=17} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,508 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=17} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:46,510 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.773KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,522 Flushing.java:153 - Writing Memtable-local_metadata_log@689050000(2.145KiB serialized bytes, 1 ops, 2.773KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,522 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db (2.079KiB) for commitlog position CommitLogPosition(segmentId=1720070498584, position=84869) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,557 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 71ms. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,557 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db') INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:46,558 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:46,583 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db')] (1 sstables, 5.546KiB), biggest 5.546KiB, smallest 5.546KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,583 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,583 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:46,583 LocalLog.java:492 - Enacted EXECUTED {FinishMove{id=NodeId{id=1}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,10]), Transient(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15]), Transient(/127.0.0.3:7012,(,10])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}}}}}}. New tail is Epoch{epoch=17} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:46,585 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},MOVE)] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,585 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} to /127.0.0.4:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,585 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,586 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} to /127.0.0.2:7012 WARN 05:21:46 Using stored Gossip Generation 1720070506 as it is greater than current system time 1720070506. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:46,588 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070506 as it is greater than current system time 1720070506. See CASSANDRA-3654 if you experience problems INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:46,588 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:1] node4 2024-07-04 05:21:46,588 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:46,588 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:46,589 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:46,589 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} from /127.0.0.1:7012 INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:46,589 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:46,589 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=17} -> Epoch{epoch=17}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,601 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:46,603 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.772KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,604 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db. 199B to 199B (~100% of original) for 20 keys. Time: 46ms. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,604 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:46,604 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.772KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:46,604 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,604 Flushing.java:153 - Writing Memtable-local@1144923245(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,605 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=84951) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,605 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.774KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:21:46,606 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,607 AbstractLocalProcessor.java:98 - Committed PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New epoch is Epoch{epoch=18} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,608 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=18} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:46,608 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 798B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:46,612 Flushing.java:153 - Writing Memtable-local_metadata_log@1260145112(2.145KiB serialized bytes, 1 ops, 2.772KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:46,613 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (2.079KiB) for commitlog position CommitLogPosition(segmentId=1720070482227, position=90812) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:46,617 Flushing.java:153 - Writing Memtable-local_metadata_log@434580241(2.145KiB serialized bytes, 1 ops, 2.774KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:46,617 Flushing.java:153 - Writing Memtable-local_metadata_log@1942675021(2.145KiB serialized bytes, 1 ops, 2.772KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:46,617 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (2.079KiB) for commitlog position CommitLogPosition(segmentId=1720070482224, position=95652) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:46,617 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db (2.079KiB) for commitlog position CommitLogPosition(segmentId=1720070482232, position=96051) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,623 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,623 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,623 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,624 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,625 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,626 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,627 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,628 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,628 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,628 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,628 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,628 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (10,15], (15,20], (,10], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,629 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,630 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,631 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,631 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,631 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,631 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,631 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,631 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,632 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,632 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,632 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,632 CompactionManager.java:681 - Skipping cleanup for 0/3 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(10,15], (15,20], (20,30]], transient ranges: [(40,], (,10]]) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,633 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db') DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:46,702 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,703 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888006144 bytes available, checking if we can write 317 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,703 CompactionTask.java:167 - Compacting (4ee955f0-39c5-11ef-9d7b-bd2859fa2036) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big-Data.db:level=0, ] INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:46,704 SecondaryIndexManager.java:947 - Executing pre-join post-bootstrap tasks for: CFS(Keyspace='tr', ColumnFamily='x') INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:46,704 LegacyStateListener.java:108 - Node /127.0.0.1:7012 state jump to NORMAL WARN 05:21:46 Using stored Gossip Generation 1720070507 as it is greater than current system time 1720070506. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:46,705 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070507 as it is greater than current system time 1720070506. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:46,706 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:46,713 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.590KiB), biggest 5.590KiB, smallest 5.590KiB DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,713 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,713 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,713 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db'),1850), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db'),543), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db'),220), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db'),279)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,714 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617887994470 bytes available, checking if we can write 2892 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,714 CompactionTask.java:167 - Compacting (4eeadc90-39c5-11ef-a91a-654b51ec069b) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big-Data.db:level=0, ] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:46,713 LocalLog.java:492 - Enacted FinishMove{id=NodeId{id=1}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,10]), Transient(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15]), Transient(/127.0.0.3:7012,(,10])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}}}}}. New tail is Epoch{epoch=17} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:46,714 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},MOVE)] INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,714 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-9-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 82ms. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,715 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db') DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:46,715 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,38), DC=Value(dc0,39), RACK=Value(rack0,40), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,41), RPC_ADDRESS=Value(127.0.0.1,0), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,43), TOKENS=Value(15,44), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,45), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,46), STATUS_WITH_PORT=Value(NORMAL,15,47), SSTABLE_VERSIONS=Value(big-oa,33)} INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:46,716 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:46,720 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.530KiB), biggest 5.530KiB, smallest 5.530KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:46,720 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big-Data.db')] (1 sstables, 5.546KiB), biggest 5.546KiB, smallest 5.546KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,720 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,720 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,720 Flushing.java:153 - Writing Memtable-local_metadata_log@1876669500(154B serialized bytes, 1 ops, 798B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,721 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=86075) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:46,720 LocalLog.java:492 - Enacted FinishMove{id=NodeId{id=1}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,10]), Transient(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15]), Transient(/127.0.0.3:7012,(,10])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}}}}}. New tail is Epoch{epoch=17} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,720 LocalLog.java:492 - Enacted FinishMove{id=NodeId{id=1}, kind=FINISH_MOVE, delta=DeltaMap{map={ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=4}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,10]), Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,10]), Transient(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15]), Transient(/127.0.0.3:7012,(,10])], /127.0.0.4:7012=[Transient(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Transient(/127.0.0.3:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=2}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=3}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,10]), Full(/127.0.0.2:7012,(10,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,10]), Full(/127.0.0.3:7012,(10,15])], /127.0.0.4:7012=[Full(/127.0.0.4:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(,15])], /127.0.0.3:7012=[Full(/127.0.0.3:7012,(,15])]}}}, ReplicationParams{class=org.apache.cassandra.locator.SimpleStrategy, replication_factor=1}=PlacementDelta{reads=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}, writes=Delta{removals={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,10]), Full(/127.0.0.1:7012,(10,15])], /127.0.0.2:7012=[Full(/127.0.0.2:7012,(10,15])]}, additions={/127.0.0.1:7012=[Full(/127.0.0.1:7012,(,15])]}}}}}}. New tail is Epoch{epoch=17} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,722 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},MOVE)] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:46,722 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},MOVE)] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:46,722 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,38), DC=Value(dc0,39), RACK=Value(rack0,40), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,41), RPC_ADDRESS=Value(127.0.0.1,0), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,43), TOKENS=Value(15,44), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,45), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,46), STATUS_WITH_PORT=Value(NORMAL,15,47), SSTABLE_VERSIONS=Value(big-oa,33)} DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:46,723 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000d,38), DC=Value(dc0,39), RACK=Value(rack0,40), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,41), RPC_ADDRESS=Value(127.0.0.1,0), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,43), TOKENS=Value(15,44), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,45), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,46), STATUS_WITH_PORT=Value(NORMAL,15,47), SSTABLE_VERSIONS=Value(big-oa,33)} INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,765 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-10-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 50ms. DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,765 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,766 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,766 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db') INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:46,767 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-7-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,768 CompactionTask.java:258 - Compacted (4ee955f0-39c5-11ef-9d7b-bd2859fa2036) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-16-big,] to level=0. 317B to 233B (~73% of original) in 64ms. Read Throughput = 4.826KiB/s, Write Throughput = 3.547KiB/s, Row Throughput = ~2/s. 4 total partitions merged to 1. Partition merge counts were {4:1, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,769 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,771 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,773 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-14-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,773 CompactionTask.java:258 - Compacted (4eeadc90-39c5-11ef-a91a-654b51ec069b) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big,] to level=0. 2.824KiB to 2.473KiB (~87% of original) in 58ms. Read Throughput = 48.246KiB/s, Write Throughput = 42.240KiB/s, Row Throughput = ~34/s. 17 total partitions merged to 17. Partition merge counts were {1:17, }. Time spent writing keys = 13ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,774 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,774 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,774 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,775 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,776 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-20-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,778 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,780 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-19-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:46,795 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db')] (1 sstables, 5.148KiB), biggest 5.148KiB, smallest 5.148KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,795 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,795 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:46,795 LocalLog.java:492 - Enacted EXECUTED {PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}}. New tail is Epoch{epoch=18} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,795 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db'),92), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db'),272), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db'),498), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db'),2000)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:46,796 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,796 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} to /127.0.0.4:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,796 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,796 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} to /127.0.0.2:7012 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,796 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617888157901 bytes available, checking if we can write 2862 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,796 CompactionTask.java:167 - Compacting (4ef786c0-39c5-11ef-9d7b-bd2859fa2036) [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db:level=0, ] INFO [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:46,797 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} from /127.0.0.1:7012 INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:46,797 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} from /127.0.0.1:7012 DEBUG [node4_InternalMetadataStage:2] node4 2024-07-04 05:21:46,797 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:21:46,797 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:46,797 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:21:46,797 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=18} -> Epoch{epoch=18}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:46,798 SingleNodeSequences.java:165 - Successfully moved to new token 15 INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:46,800 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:46,800 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,800 PrepareCMSReconfiguration.java:177 - Proposed CMS reconfiguration resulted in no required modifications at epoch 17 INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,801 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 799B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:46,801 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 797B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:46,801 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 797B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,810 Flushing.java:153 - Writing Memtable-local@214612841(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:46,810 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070498584, position=86157) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:46,817 Flushing.java:153 - Writing Memtable-local_metadata_log@1328266413(154B serialized bytes, 1 ops, 797B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:46,817 Flushing.java:153 - Writing Memtable-local_metadata_log@778687824(154B serialized bytes, 1 ops, 799B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:46,817 Flushing.java:153 - Writing Memtable-local_metadata_log@1004851084(154B serialized bytes, 1 ops, 797B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:46,818 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070482232, position=96863) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:21:46,818 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070482227, position=92521) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:46,818 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db (85B) for commitlog position CommitLogPosition(segmentId=1720070482224, position=96609) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,834 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-11-big-Data.db. 193B to 193B (~100% of original) for 20 keys. Time: 68ms. INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,834 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:21:46,834 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:21:46,835 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/tr/x-1b255f4def2540a6000000000000000c/oa-8-big INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,848 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,849 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,849 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,850 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,851 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,852 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,853 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,853 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,853 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,853 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,853 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,853 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,853 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,854 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,855 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(15,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,855 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,855 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,855 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,855 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,856 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,857 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,857 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,857 CompactionManager.java:441 - Starting Cleanup for tr.x DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,857 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-5-big-Data.db') ([22, 40]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,857 CompactionManager.java:681 - Skipping cleanup for 1/3 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: [(15,20]]) INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,858 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big-Data.db') INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,876 CompactionTask.java:258 - Compacted (4ef786c0-39c5-11ef-9d7b-bd2859fa2036) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-25-big,] to level=0. 2.795KiB to 2.444KiB (~87% of original) in 78ms. Read Throughput = 35.392KiB/s, Write Throughput = 30.952KiB/s, Row Throughput = ~36/s. 18 total partitions merged to 18. Partition merge counts were {1:18, }. Time spent writing keys = 24ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,877 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:46,877 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,877 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-24-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,878 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,880 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-23-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:46,881 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-17-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:46,881 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:46,881 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070501, version = 65, AppStateMap = {LOAD=Value(252884.0,51), SCHEMA=Value(00000000-0000-0000-0000-00000000000d,55), DC=Value(dc0,56), RACK=Value(rack0,57), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,58), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,59), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,60), TOKENS=Value(15,61), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,62), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,63), STATUS_WITH_PORT=Value(NORMAL,15,64), SSTABLE_VERSIONS=Value(big-oa,33)} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:46,885 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db')] (1 sstables, 5.148KiB), biggest 5.148KiB, smallest 5.148KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,885 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:46,885 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-21-big-Data.db')] (1 sstables, 5.148KiB), biggest 5.148KiB, smallest 5.148KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,885 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:21:46,885 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:21:46,885 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:46,885 LocalLog.java:492 - Enacted PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New tail is Epoch{epoch=18} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,885 LocalLog.java:492 - Enacted PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New tail is Epoch{epoch=18} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:46,885 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:46,885 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:21:46,896 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-22-big-Data.db')] (1 sstables, 5.148KiB), biggest 5.148KiB, smallest 5.148KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:21:46,896 LocalLog.java:492 - Enacted PrepareCMSReconfiguration#Complex{replicationParams=ReplicationParams{class=org.apache.cassandra.locator.MetaStrategy, dc0=1}}. New tail is Epoch{epoch=18} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:21:46,896 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,932 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-8-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 74ms. INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,933 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-7-big-Data.db') INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,934 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-6-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,996 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-9-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 63ms. DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,996 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,996 CompactionManager.java:483 - Finished Cleanup for tr.x successfully DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:21:46,996 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:21:46,996 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:21:46,997 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests1275629026681038035/node4/data0/tr/x-1b255f4def2540a6000000000000000c/oa-7-big INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,065 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [main] <main> 2024-07-04 05:21:47,067 AbstractCluster.java:1090 - Closing cluster 1c893689-0ca1-4570-b306-98ac0a988c38 INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:21:47,069 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:21:47,070 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node2_isolatedExecutor:4] node2 2024-07-04 05:21:47,070 Gossiper.java:1808 - Announcing shutdown INFO [node2_isolatedExecutor:4] node2 2024-07-04 05:21:47,070 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown INFO [node3_isolatedExecutor:4] node3 2024-07-04 05:21:47,070 Gossiper.java:1808 - Announcing shutdown INFO [node3_isolatedExecutor:4] node3 2024-07-04 05:21:47,070 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:47,071 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:21:47,071 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:21:47,071 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:47,071 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:47,071 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:47,071 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:21:47,071 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:47,072 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:21:47,072 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:47,072 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:47,072 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:21:47,072 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:47,072 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:21:47,072 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:47,072 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:47,072 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:47,073 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,073 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node1_GossipStage:1] node1 2024-07-04 05:21:47,073 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,073 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.3:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:47,073 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:47,073 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:21:47,073 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:47,073 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:21:47,073 Gossiper.java:576 - Marked /127.0.0.3:7012 as shutdown DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:47,074 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:21:47,074 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node1_GossipStage:1] node1 2024-07-04 05:21:47,074 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:47,074 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:21:47,074 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:47,074 Gossiper.java:576 - Marked /127.0.0.3:7012 as shutdown INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:47,074 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:51488)->/127.0.0.2:7012-URGENT_MESSAGES-bc08c395 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:47,074 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:51488)->/127.0.0.2:7012-URGENT_MESSAGES-2be5ae45 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_GossipStage:1] node2 2024-07-04 05:21:47,075 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:21:47,075 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.3:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:47,075 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:21:47,075 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:47,075 Gossiper.java:576 - Marked /127.0.0.3:7012 as shutdown INFO [node4_isolatedExecutor:4] node4 2024-07-04 05:21:47,076 Gossiper.java:1808 - Announcing shutdown INFO [node4_isolatedExecutor:4] node4 2024-07-04 05:21:47,076 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:47,158 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:42740)->/127.0.0.3:7012-URGENT_MESSAGES-6226bf96 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:47,158 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:42730)->/127.0.0.3:7012-URGENT_MESSAGES-d5d364c1 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:47,158 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:42740)->/127.0.0.3:7012-URGENT_MESSAGES-61ac94f6 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:47,158 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:42730)->/127.0.0.3:7012-URGENT_MESSAGES-845020e6 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_GossipStage:1] node3 2024-07-04 05:21:47,159 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:47,195 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:51494)->/127.0.0.2:7012-URGENT_MESSAGES-7bfd6f2a messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:47,195 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:59514)->/127.0.0.1:7012-URGENT_MESSAGES-3e8e30c9 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:21:47,195 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:51494)->/127.0.0.2:7012-URGENT_MESSAGES-61e334e7 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:47,195 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:59514)->/127.0.0.1:7012-URGENT_MESSAGES-ee237fc9 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_GossipStage:1] node2 2024-07-04 05:21:47,196 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:47,197 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:51502)->/127.0.0.2:7012-URGENT_MESSAGES-84e8aeb6 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:47,197 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:51502)->/127.0.0.2:7012-URGENT_MESSAGES-132252fc successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:47,786 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:42744)->/127.0.0.3:7012-URGENT_MESSAGES-a963bb14 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:47,786 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:59516)->/127.0.0.1:7012-URGENT_MESSAGES-febcde2b messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:21:47,787 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:59516)->/127.0.0.1:7012-URGENT_MESSAGES-452cfc93 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:47,787 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:42744)->/127.0.0.3:7012-URGENT_MESSAGES-71119760 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:21:47,789 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:47,792 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:59518)->/127.0.0.1:7012-URGENT_MESSAGES-40aa1274 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:47,792 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:59518)->/127.0.0.1:7012-URGENT_MESSAGES-af7cffd1 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_isolatedExecutor:4] node2 2024-07-04 05:21:49,081 HintsService.java:234 - Paused hints dispatch INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:21:49,083 HintsService.java:234 - Paused hints dispatch INFO [node3_isolatedExecutor:4] node3 2024-07-04 05:21:49,083 HintsService.java:234 - Paused hints dispatch INFO [node4_isolatedExecutor:4] node4 2024-07-04 05:21:49,104 HintsService.java:234 - Paused hints dispatch DEBUG [node2_isolatedExecutor:13] node2 2024-07-04 05:21:49,136 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node2_isolatedExecutor:13] node2 2024-07-04 05:21:49,136 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node3_isolatedExecutor:10] node3 2024-07-04 05:21:49,136 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node3_isolatedExecutor:10] node3 2024-07-04 05:21:49,137 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node4_isolatedExecutor:13] node4 2024-07-04 05:21:49,140 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node4_isolatedExecutor:13] node4 2024-07-04 05:21:49,141 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node1_isolatedExecutor:3] node1 2024-07-04 05:21:49,167 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:21:49,167 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node2_COMMIT-LOG-WRITER] node2 2024-07-04 05:21:51,157 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_COMMIT-LOG-WRITER] node4 2024-07-04 05:21:51,161 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_COMMIT-LOG-WRITER] node3 2024-07-04 05:21:51,164 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:51,177 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. nodeIdTopology configured for 4 nodes while nodeCount is 3 Node id topology: node 1: dc = dc0, rack = rack0 node 2: dc = dc0, rack = rack0 node 3: dc = dc0, rack = rack0 node 4: dc = dc0, rack = rack0 Configured node count: 3, nodeIdTopology size: 4 DEBUG [main] node1 2024-07-04 05:21:51,698 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-07-04 05:21:51,701 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-07-04 05:21:51,701 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node1 2024-07-04 05:21:51,702 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-07-04 05:21:51,702 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node1 2024-07-04 05:21:51,702 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-07-04 05:21:51,703 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node1 2024-07-04 05:21:51,703 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node1 2024-07-04 05:21:51,703 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-07-04 05:21:51,704 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-07-04 05:21:51,704 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-07-04 05:21:51,704 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node1 2024-07-04 05:21:51,705 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node1 2024-07-04 05:21:51,705 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-07-04 05:21:51,705 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-07-04 05:21:51,705 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node1 2024-07-04 05:21:51,706 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-07-04 05:21:51,706 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-07-04 05:21:51,706 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node2 2024-07-04 05:21:51,893 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node2 2024-07-04 05:21:51,896 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node2 2024-07-04 05:21:51,896 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node2 2024-07-04 05:21:51,896 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node2 2024-07-04 05:21:51,897 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node2 2024-07-04 05:21:51,897 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node2 2024-07-04 05:21:51,897 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node2 2024-07-04 05:21:51,897 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node2 2024-07-04 05:21:51,898 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node2 2024-07-04 05:21:51,898 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node2 2024-07-04 05:21:51,898 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node2 2024-07-04 05:21:51,898 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node2 2024-07-04 05:21:51,898 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node2 2024-07-04 05:21:51,899 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node2 2024-07-04 05:21:51,899 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node2 2024-07-04 05:21:51,899 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node2 2024-07-04 05:21:51,899 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node2 2024-07-04 05:21:51,900 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node2 2024-07-04 05:21:51,900 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false DEBUG [main] node3 2024-07-04 05:21:52,084 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node3 2024-07-04 05:21:52,087 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node3 2024-07-04 05:21:52,087 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node3 2024-07-04 05:21:52,088 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node3 2024-07-04 05:21:52,088 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node3 2024-07-04 05:21:52,088 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node3 2024-07-04 05:21:52,088 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node3 2024-07-04 05:21:52,089 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node3 2024-07-04 05:21:52,089 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node3 2024-07-04 05:21:52,089 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node3 2024-07-04 05:21:52,090 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node3 2024-07-04 05:21:52,090 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node3 2024-07-04 05:21:52,090 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node3 2024-07-04 05:21:52,090 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node3 2024-07-04 05:21:52,090 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node3 2024-07-04 05:21:52,091 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node3 2024-07-04 05:21:52,091 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node3 2024-07-04 05:21:52,091 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node3 2024-07-04 05:21:52,091 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,155 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,156 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,156 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,156 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,157 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,157 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,159 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,159 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,202 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,208 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,225 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,225 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,225 CassandraDaemon.java:613 - Heap size: 832.000MiB/1.000GiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,225 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 449471696(438937K) committed = 450560000(440000K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 60276608(58863K) committed = 60293120(58880K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 59012376(57629K) committed = 59506688(58112K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 335494696(327631K) committed = 369098752(360448K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 438508040(428230K) committed = 822083584(802816K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 50331648(49152K) committed = 50331648(49152K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 13952128(13625K) committed = 13959168(13632K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,226 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,235 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,236 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node1_ScheduledTasks:1] node1 2024-07-04 05:21:52,306 StorageService.java:294 - Overriding RING_DELAY to 15000ms WARN 05:21:52 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,366 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:52 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,370 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:52 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,370 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,378 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,378 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,383 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,385 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,385 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,386 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,386 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,389 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,391 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,391 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,391 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,391 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,391 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,391 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,392 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,392 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,393 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,393 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,393 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,393 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,393 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,393 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:21:52 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,393 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:52 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,394 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,394 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,397 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,399 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,399 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,399 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,399 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,399 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/hints DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,508 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,508 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,699 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,701 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,781 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,785 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,792 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node1_SecondaryIndexManagement:1] node1 2024-07-04 05:21:52,799 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,803 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,807 ColumnFamilyStore.java:508 - Initializing system.local INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,811 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,817 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,823 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,827 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,833 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,838 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,843 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,848 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,851 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,855 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,859 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,863 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,867 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,872 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,876 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,882 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,887 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,892 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,900 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,901 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,902 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,906 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:52,928 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,053 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,056 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,059 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,063 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,066 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,068 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,071 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,074 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,076 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,079 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,081 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,086 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,086 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,086 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,087 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,093 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,093 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,093 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,094 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,094 Startup.java:97 - Initializing as first CMS node in a new cluster DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,152 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,152 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,152 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,152 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,157 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_648861037467633471176.so DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,159 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,159 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,161 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,161 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,162 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,165 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,171 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,185 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,188 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,188 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,241 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,244 StorageService.java:494 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,245 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,254 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,254 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,254 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,259 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,259 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,264 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,264 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,264 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:21:53,301 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,304 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.577KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,359 Flushing.java:153 - Writing Memtable-columns@418011307(735B serialized bytes, 4 ops, 3.577KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,362 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,420 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,425 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,425 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,426 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,440 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_52d954d0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,456 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,456 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,458 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.007KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,465 Flushing.java:153 - Writing Memtable-tables@125347313(868B serialized bytes, 1 ops, 3.007KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,465 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,514 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_52f01120-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,517 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,517 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,517 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 790B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,577 Flushing.java:153 - Writing Memtable-keyspaces@412304665(151B serialized bytes, 1 ops, 790B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,578 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=1479) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,663 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_52f938e0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,671 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,672 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,672 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,701 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=1} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,712 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 754B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,723 Flushing.java:153 - Writing Memtable-local_metadata_log@1660495711(110B serialized bytes, 1 ops, 754B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,723 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (41B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=1686) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,765 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_5316fa10-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,777 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,777 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.084KiB), biggest 5.084KiB, smallest 5.084KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,778 LocalLog.java:492 - Enacted PreInitialize{addr=/127.0.0.1:7012}. New tail is Epoch{epoch=1} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,791 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,911 AbstractLocalProcessor.java:98 - Committed Initialize{baseState = Epoch{epoch=1}}. New epoch is Epoch{epoch=2} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:53,911 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=2} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,913 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.038KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,923 Flushing.java:153 - Writing Memtable-local_metadata_log@1016107210(1.409KiB serialized bytes, 1 ops, 2.038KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:53,923 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070512245, position=8779) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,975 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_5335a5a0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,980 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:53,981 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,983 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,986 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,988 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,990 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,993 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,995 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:53,998 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,000 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,003 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,003 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,003 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,005 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,006 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,006 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,008 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,010 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,013 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,016 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,044 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.690KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,050 Flushing.java:153 - Writing Memtable-columns@2114317700(11.795KiB serialized bytes, 68 ops, 54.690KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,054 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070512245, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,077 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_53497bc0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,079 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,079 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,080 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.350KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,084 Flushing.java:153 - Writing Memtable-tables@2084357328(11.222KiB serialized bytes, 14 ops, 36.350KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,085 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070512245, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,132 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_534efa00-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,137 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,138 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,138 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.290KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,145 Flushing.java:153 - Writing Memtable-keyspaces@1473566679(471B serialized bytes, 3 ops, 2.290KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,146 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=21799) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,191 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_5357d3a0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,196 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,196 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,197 LocalLog.java:492 - Enacted EXECUTED {Initialize{baseState = Epoch{epoch=1}}}. New tail is Epoch{epoch=2} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:54,197 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,203 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.1:7012), nic: lo, encryption: unencrypted DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,216 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,216 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,220 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,223 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,224 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,235 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,236 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,241 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,241 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,241 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,249 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,249 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,249 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,249 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,250 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,289 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,308 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,308 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,309 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,310 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,311 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,311 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,313 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,313 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,313 StorageService.java:704 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,313 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,314 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,371 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.116KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,381 Flushing.java:153 - Writing Memtable-local@1870269223(462B serialized bytes, 4 ops, 2.116KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:54,381 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (216B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=66061) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,431 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_537b6130-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,436 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:54,436 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.882KiB), biggest 5.882KiB, smallest 5.882KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,436 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,438 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,438 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.1:7012 because it is not a member in token metadata INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:54,439 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:55,740 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,040 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,341 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.1,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,341 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,381 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=3} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,382 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=3} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:56,383 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,395 Flushing.java:153 - Writing Memtable-local_metadata_log@1052947073(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,396 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=67241) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,468 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_54ae62f0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,481 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,481 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:56,481 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=3} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:56,482 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,483 Register.java:122 - Registering with endpoint /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,485 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:56,486 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,502 Flushing.java:153 - Writing Memtable-local@608365517(65B serialized bytes, 1 ops, 578B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,503 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=67325) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,581 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_54bdf350-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,587 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,587 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,587 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000001, (Note: This should happen exactly once per node) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,591 BootStrapper.java:256 - tokens manually specified as [10] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,607 Flushing.java:153 - Writing Memtable-local@1440348925(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,607 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=67407) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,613 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=4} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,615 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=4} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:56,616 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,635 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_54cd83b0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,637 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,637 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:21:56,637 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.1:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:56,641 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,647 Flushing.java:153 - Writing Memtable-local_metadata_log@1791352914(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,647 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=68373) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,728 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_54d524d0-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,737 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,737 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:21:56,738 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=4} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:21:56,738 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,752 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 571B (0%) on-heap, 0B (0%) off-heap INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:56,759 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 700B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,769 Flushing.java:153 - Writing Memtable-local@1102577969(58B serialized bytes, 1 ops, 571B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,769 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (24B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=68456) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,857 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_54e6b100-39c5-11ef-b651-258387aac126.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,869 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,870 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,870 Startup.java:400 - NORMAL DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,881 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,881 Flushing.java:153 - Writing Memtable-local@1914148424(63B serialized bytes, 1 ops, 700B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,881 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,881 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (20B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=68533) DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,886 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,887 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,888 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,889 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),41), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,892 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,894 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617889990656 bytes available, checking if we can write 919 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,894 CompactionTask.java:167 - Compacting (54fbbfa0-39c5-11ef-b651-258387aac126) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,896 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:21:56,905 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,933 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,934 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,934 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,934 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,934 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,935 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,936 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,937 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,938 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,939 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,939 DatabaseDescriptor.java:512 - Syncing log with batch mode DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:56,939 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 5.025KiB), biggest 5.025KiB, smallest 5.025KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,939 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,939 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,940 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,942 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,942 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. WARN 05:21:56 Using stored Gossip Generation 1720070517 as it is greater than current system time 1720070516. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:56,943 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070517 as it is greater than current system time 1720070516. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:56,944 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,965 Flushing.java:153 - Writing Memtable-local@1753453797(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:56,965 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=68615) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,974 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,979 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:56,980 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:56,985 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,986 CompactionTask.java:258 - Compacted (54fbbfa0-39c5-11ef-b651-258387aac126) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big,] to level=0. 919B to 867B (~94% of original) in 86ms. Read Throughput = 10.386KiB/s, Write Throughput = 9.798KiB/s, Row Throughput = ~8/s. 4 total partitions merged to 4. Partition merge counts were {1:4, }. Time spent writing keys = 21ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,987 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617889862246 bytes available, checking if we can write 316 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:56,988 CompactionTask.java:167 - Compacting (550a8cb0-39c5-11ef-b651-258387aac126) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:56,988 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:56,989 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:56,990 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:56,992 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,002 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,002 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,002 CassandraDaemon.java:613 - Heap size: 832.000MiB/1.000GiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 481772888(470481K) committed = 482869248(471552K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 63279872(61796K) committed = 63307776(61824K) max = 122912768(120032K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 63169992(61689K) committed = 63700992(62208K) max = 1073741824(1048576K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 335494696(327631K) committed = 369098752(360448K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 438508040(428230K) committed = 822083584(802816K) max = 1073741824(1048576K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 50331648(49152K) committed = 50331648(49152K) max = -1(-1K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 14412416(14074K) committed = 14417920(14080K) max = 122916864(120036K) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,003 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,004 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,008 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,008 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,008 CassandraDaemon.java:613 - Heap size: 832.000MiB/1.000GiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,008 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,008 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 481920688(470625K) committed = 483000320(471680K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 63289216(61805K) committed = 63307776(61824K) max = 122912768(120032K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 63189280(61708K) committed = 63700992(62208K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 335494696(327631K) committed = 369098752(360448K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 438508040(428230K) committed = 822083584(802816K) max = 1073741824(1048576K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 50331648(49152K) committed = 50331648(49152K) max = -1(-1K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 14414720(14076K) committed = 14417920(14080K) max = 122916864(120036K) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,009 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,017 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,017 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,022 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,023 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:57,058 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB WARN 05:21:57 Using stored Gossip Generation 1720070518 as it is greater than current system time 1720070517. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:21:57,065 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070518 as it is greater than current system time 1720070517. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:21:57,066 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:57,074 Flushing.java:153 - Writing Memtable-local@755052247(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:21:57,074 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=69735) INFO [node2_ScheduledTasks:1] node2 2024-07-04 05:21:57,081 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:21:57,086 CompactionTask.java:258 - Compacted (550a8cb0-39c5-11ef-b651-258387aac126) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 316B to 229B (~72% of original) in 96ms. Read Throughput = 3.191KiB/s, Write Throughput = 2.313KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 41ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:57,087 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:57,088 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:21:57,088 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:57,089 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node3_ScheduledTasks:1] node3 2024-07-04 05:21:57,089 StorageService.java:294 - Overriding RING_DELAY to 15000ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:57,091 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:57,093 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:21:57,095 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:21:57,137 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node1_GossipStage:1] node1 2024-07-04 05:21:57,138 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.1,6), RPC_ADDRESS=Value(127.0.0.1,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)} WARN 05:21:57 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,165 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:57 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,188 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:57 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,189 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN 05:21:57 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,189 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:21:57 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,194 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:21:57 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,195 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,200 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,200 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,205 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,205 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,205 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,208 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,208 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,208 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,208 FileUtil.java:74 - Reading file /proc/version DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,211 FileUtil.java:74 - Reading file /proc/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,212 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,213 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,213 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,213 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,214 FileUtil.java:74 - Reading file /proc/version DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,215 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,215 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,215 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,215 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,216 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,216 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,217 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,217 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,217 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,218 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,218 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,218 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,218 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,218 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,219 FileUtil.java:74 - Reading file /proc/meminfo WARN 05:21:57 Cassandra server running in degraded mode. Swap should be disabled. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,219 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:57 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,219 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,220 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,222 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,222 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,222 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,222 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,222 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,222 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,223 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,223 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,223 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,224 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,224 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,224 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,224 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,224 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,225 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:21:57 Cassandra server running in degraded mode. Swap should be disabled. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,225 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:21:57 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,225 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,226 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,226 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,226 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/commitlog DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,226 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/saved_caches DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,226 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,226 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/hints DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,229 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,232 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data1 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,232 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,232 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/commitlog DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,232 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/saved_caches DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,232 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/hints DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,336 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,336 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,367 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,367 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,515 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,518 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,549 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,551 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,584 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,588 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,595 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node2_SecondaryIndexManagement:1] node2 2024-07-04 05:21:57,603 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,606 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,610 ColumnFamilyStore.java:508 - Initializing system.local INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,613 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,617 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,620 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,621 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,623 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,626 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,627 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,632 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,633 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,636 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,641 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node3_SecondaryIndexManagement:1] node3 2024-07-04 05:21:57,645 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,647 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,649 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,652 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,655 ColumnFamilyStore.java:508 - Initializing system.local INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,657 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,660 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,661 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,665 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,666 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,669 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,671 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,674 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,675 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,679 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,679 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,683 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,684 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,687 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,688 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,692 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,692 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,693 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,693 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,696 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,697 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,700 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,704 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,707 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,711 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,715 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,719 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,722 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,723 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,728 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,730 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,733 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,733 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,733 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,736 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,762 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,809 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,813 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,815 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,819 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,822 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,825 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,828 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,831 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,833 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,836 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,839 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,843 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,844 CassandraDaemon.java:514 - opening keyspace system DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,844 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,844 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,846 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,849 ColumnFamilyStore.java:508 - Initializing system_schema.tables DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,851 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,851 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,852 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,852 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,853 Startup.java:108 - Initializing for discovery INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,856 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,859 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,862 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,865 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,868 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,871 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,873 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,876 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,879 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,880 CassandraDaemon.java:514 - opening keyspace system DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,880 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,880 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,885 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,886 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,886 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,887 Startup.java:108 - Initializing for discovery DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,908 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,908 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,908 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,908 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,912 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_643979020661311342522.so DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,914 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,915 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,916 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,917 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,917 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,920 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,924 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,958 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,959 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,959 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,959 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,959 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,961 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node2_Messaging-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:57,961 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,964 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_648222486981605165868.so DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,967 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,967 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,969 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,970 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,970 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,973 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,980 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:57,996 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,000 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node3_Messaging-EventLoop DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,001 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,023 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,026 StorageService.java:494 - Initializing storage service mbean INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,027 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,036 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,036 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,036 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,042 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,042 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,046 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,047 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,047 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,065 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,068 StorageService.java:494 - Initializing storage service mbean INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,070 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node2_COMMIT-LOG-WRITER] node2 2024-07-04 05:21:58,071 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,082 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,082 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,082 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,084 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.579KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,089 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,089 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,097 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,097 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,098 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_COMMIT-LOG-WRITER] node3 2024-07-04 05:21:58,153 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,158 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.575KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,189 Flushing.java:153 - Writing Memtable-columns@1392778515(735B serialized bytes, 4 ops, 3.579KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,194 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=1479) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,235 Flushing.java:153 - Writing Memtable-columns@1493197776(735B serialized bytes, 4 ops, 3.575KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,237 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=1479) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,313 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,322 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,322 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,323 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,338 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_55b48850-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,369 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,369 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,371 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.009KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,378 Flushing.java:153 - Writing Memtable-tables@1814455062(868B serialized bytes, 1 ops, 3.009KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,380 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=1479) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,380 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,386 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,387 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,387 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,417 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_55be4c50-39c5-11ef-a1c9-4b8e7a2da833.log INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,434 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_55ddbb30-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,436 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,436 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,436 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 792B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,439 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,439 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,440 Flushing.java:153 - Writing Memtable-keyspaces@919458316(151B serialized bytes, 1 ops, 792B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,441 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.005KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,441 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=1479) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,446 Flushing.java:153 - Writing Memtable-tables@2078210549(868B serialized bytes, 1 ops, 3.005KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,447 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=1479) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,466 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_55e7cd50-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,468 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,468 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,469 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,478 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_55e86990-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,484 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,484 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,484 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 788B (0%) on-heap, 0B (0%) off-heap INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,490 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.2:7012), nic: null, encryption: unencrypted INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,499 Flushing.java:153 - Writing Memtable-keyspaces@2043825867(151B serialized bytes, 1 ops, 788B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,500 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=1479) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,503 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,503 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,507 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,510 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,510 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,523 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,523 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,523 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,523 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,523 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,524 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,524 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,524 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,524 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,524 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,524 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,524 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,530 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,530 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,530 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,539 Startup.java:205 - Discovering other nodes in the system DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,539 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:21:58,540 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@1be9d164) to /127.0.0.1:7012 INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,546 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_55ef2050-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,558 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,558 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,558 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,580 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.3:7012), nic: null, encryption: unencrypted DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,590 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,590 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,591 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@943526c DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,593 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,593 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,593 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,593 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,593 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,595 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,595 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,597 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,597 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,597 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@982b897 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,599 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,601 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,602 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,615 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,615 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,615 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,615 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,615 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,615 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,615 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,615 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,615 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,616 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,625 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,625 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,625 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,637 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:32784)->/127.0.0.1:7012-URGENT_MESSAGES-9f3cd42e messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,637 Startup.java:205 - Discovering other nodes in the system DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,637 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:21:58,637 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:32784)->/127.0.0.1:7012-URGENT_MESSAGES-244200d9 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:21:58,639 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@662164c9) to /127.0.0.1:7012 DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:21:58,642 Discovery.java:182 - Responding to discovery request from /127.0.0.2:7012: [/127.0.0.1:7012] INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:58,676 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:47684)->/127.0.0.2:7012-URGENT_MESSAGES-aaffc399 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:21:58,680 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:47684)->/127.0.0.2:7012-URGENT_MESSAGES-ac6a8b1c messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:21:58,683 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,695 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,695 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,695 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@5de6bf25 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,698 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,698 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,698 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,698 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,698 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:21:58,700 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:32790)->/127.0.0.1:7012-URGENT_MESSAGES-82ebfc96 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:58,711 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:21:58,719 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:32790)->/127.0.0.1:7012-URGENT_MESSAGES-41c2fad2 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:21:58,721 Discovery.java:182 - Responding to discovery request from /127.0.0.3:7012: [/127.0.0.1:7012] INFO [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:58,728 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:21:58,728 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:21:58,730 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:60984)->/127.0.0.3:7012-URGENT_MESSAGES-fff00b6b successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,732 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 749B (0%) on-heap, 0B (0%) off-heap INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:21:58,739 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:60984)->/127.0.0.3:7012-URGENT_MESSAGES-f420ea4b messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:21:58,742 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,748 Flushing.java:153 - Writing Memtable-local_metadata_log@1754088132(103B serialized bytes, 1 ops, 749B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,748 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=1679) INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:21:58,757 FetchCMSLog.java:119 - Responding to /127.0.0.3:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:58,773 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:21:58,774 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=4: Epoch{epoch=1} -> Epoch{epoch=4}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,778 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 745B (0%) on-heap, 0B (0%) off-heap INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,799 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_5614f7d0-39c5-11ef-a51d-eb1859d1d050.log INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,800 Flushing.java:153 - Writing Memtable-local_metadata_log@312204878(103B serialized bytes, 1 ops, 745B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,801 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=1679) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,805 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,805 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,805 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,805 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,822 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.040KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,838 Flushing.java:153 - Writing Memtable-local_metadata_log@1836724398(1.409KiB serialized bytes, 1 ops, 2.040KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:58,838 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070517030, position=3129) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,853 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_561bfcb0-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,860 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,861 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,861 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,861 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,869 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_56228c60-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,872 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:58,872 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,876 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,880 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.036KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,882 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,887 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,891 Flushing.java:153 - Writing Memtable-local_metadata_log@1646600136(1.409KiB serialized bytes, 1 ops, 2.036KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:58,891 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070517035, position=3129) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,892 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,897 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,902 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,907 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,912 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,919 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,919 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,920 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,924 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,925 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,925 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,930 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,931 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_562b6600-39c5-11ef-a1c9-4b8e7a2da833.log INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,934 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,939 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,939 ColumnFamilyStore.java:508 - Initializing system_traces.sessions DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:58,939 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,943 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,943 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,947 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,952 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,960 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,964 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,968 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,972 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,976 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,979 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,980 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,980 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,983 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,984 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,984 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,987 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,992 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:58,992 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.696KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:58,997 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,000 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,005 Flushing.java:153 - Writing Memtable-columns@840679620(11.795KiB serialized bytes, 68 ops, 54.696KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,011 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070517030, position=16149) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,041 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.685KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,078 Flushing.java:153 - Writing Memtable-columns@1857573672(11.795KiB serialized bytes, 68 ops, 54.685KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,082 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070517035, position=16149) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,097 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_563ca410-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,104 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,104 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,105 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.355KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,112 Flushing.java:153 - Writing Memtable-tables@1780365625(11.222KiB serialized bytes, 14 ops, 36.355KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,114 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070517030, position=16149) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,119 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_5643f710-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,123 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,123 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,124 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.344KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,128 Flushing.java:153 - Writing Memtable-tables@100138018(11.222KiB serialized bytes, 14 ops, 36.344KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,130 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070517035, position=16149) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,140 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_564dbb10-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,145 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,145 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,146 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.296KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,163 Flushing.java:153 - Writing Memtable-keyspaces@1745346012(471B serialized bytes, 3 ops, 2.296KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,164 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=16149) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,190 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_5650a140-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,198 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,199 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,199 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.284KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,219 Flushing.java:153 - Writing Memtable-keyspaces@1238514556(471B serialized bytes, 3 ops, 2.284KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,220 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=16149) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,243 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_5653fca0-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,255 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,255 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,255 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,258 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,265 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 814B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,284 Flushing.java:153 - Writing Memtable-local_metadata_log@1422159666(168B serialized bytes, 1 ops, 814B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,284 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=16414) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,292 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_565c12f0-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,301 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,301 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,301 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,306 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,310 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 810B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,329 Flushing.java:153 - Writing Memtable-local_metadata_log@54769361(168B serialized bytes, 1 ops, 810B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,329 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=16414) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,355 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_56662510-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,362 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,362 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,362 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,364 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:59,373 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,374 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_566d02e0-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:21:59,375 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,376 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,376 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,376 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,378 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,387 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 761B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:59,387 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:21:59,389 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,391 Flushing.java:153 - Writing Memtable-local_metadata_log@951425166(115B serialized bytes, 1 ops, 761B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:21:59,392 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=16535) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,401 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,411 Flushing.java:153 - Writing Memtable-local_metadata_log@793674882(115B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:21:59,412 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=16535) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,431 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_5678c2b0-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,436 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:21:59,437 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,437 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:21:59,437 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:21:59,440 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,450 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_567b0ca0-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,461 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:21:59,461 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,461 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:21:59,464 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:21:59,465 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,444 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,445 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,445 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,445 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,448 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,470 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,471 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,471 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,471 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,474 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,527 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,532 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,559 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,565 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,567 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,569 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,569 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,571 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,571 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,573 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,573 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,573 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,573 StorageService.java:704 - CQL version: 3.4.8 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,574 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,575 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,575 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,577 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,577 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,579 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,579 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,579 StorageService.java:704 - CQL version: 3.4.8 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,580 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,600 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,605 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,683 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.114KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:00,690 Flushing.java:153 - Writing Memtable-local@367164325(462B serialized bytes, 4 ops, 2.114KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:00,691 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=61213) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,693 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.118KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:00,707 Flushing.java:153 - Writing Memtable-local@595179856(462B serialized bytes, 4 ops, 2.118KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:00,707 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=61213) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:00,772 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_573e83b0-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:00,782 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:00,783 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.884KiB), biggest 5.884KiB, smallest 5.884KiB DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,783 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,784 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,784 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,784 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,787 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:00,787 Gossiper.java:511 - Convicting /127.0.0.1:7012 with status NORMAL - alive true INFO [node3_GossipStage:1] node3 2024-07-04 05:22:00,788 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:22:00,788 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:00,788 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:00,789 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node3_GossipStage:1] node3 2024-07-04 05:22:00,791 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node3_GossipStage:1] node3 2024-07-04 05:22:00,791 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:00,792 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:32794)->/127.0.0.1:7012-URGENT_MESSAGES-5a6ee677 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:00,792 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:32794)->/127.0.0.1:7012-URGENT_MESSAGES-56b022cf messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:00,794 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_57403160-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:00,799 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:00,799 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:22:00,802 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:00,802 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:00,802 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.884KiB), biggest 5.884KiB, smallest 5.884KiB DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,802 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,803 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,803 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,803 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,803 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,803 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,804 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=4} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,804 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:22:00,804 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,807 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:22:00,809 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node2_GossipStage:1] node2 2024-07-04 05:22:00,809 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:22:00,810 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:00,812 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:32798)->/127.0.0.1:7012-URGENT_MESSAGES-e56e9298 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:00,812 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:32798)->/127.0.0.1:7012-URGENT_MESSAGES-a6565ea6 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:00,819 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:00,819 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:22:00,819 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:22:00,819 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,819 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,819 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,819 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:00,820 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:22:00,820 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP WARN 05:22:01 Not marking nodes down due to local pause of 8649335751ns > 5000000000ns WARN [node1_GossipTasks:1] node1 2024-07-04 05:22:01,446 FailureDetector.java:355 - Not marking nodes down due to local pause of 8649335751ns > 5000000000ns DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:01,447 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node3_GossipStage:1] node3 2024-07-04 05:22:01,455 Gossiper.java:1199 - Node /127.0.0.2:7012 is now part of the cluster DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:01,460 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:01,460 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:01,460 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.2:7012 because it is not a member in token metadata INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:01,463 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:47686)->/127.0.0.2:7012-URGENT_MESSAGES-38db785a successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:01,463 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:47686)->/127.0.0.2:7012-URGENT_MESSAGES-529233fe messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:01,474 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:60994)->/127.0.0.3:7012-URGENT_MESSAGES-169a35bc successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:01,474 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:60994)->/127.0.0.3:7012-URGENT_MESSAGES-59100953 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:01,475 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:01,475 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,089 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 44, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:02,119 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 44, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,389 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 44, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:02,420 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 44, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:02,448 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:02,448 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node2_GossipStage:1] node2 2024-07-04 05:22:02,450 Gossiper.java:1199 - Node /127.0.0.3:7012 is now part of the cluster DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:02,450 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:02,450 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:02,450 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:02,451 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:22:02,451 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,690 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 44, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 11, AppStateMap = {INTERNAL_IP=Value(127.0.0.3,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,691 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:02,720 Gossiper.java:1957 - Gossip not settled after 3 polls. INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:02,752 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=4}} from /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:02,757 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=5} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:02,757 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=5} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:02,758 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:02,768 Flushing.java:153 - Writing Memtable-local_metadata_log@741413839(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:02,769 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=71997) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:02,819 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:02,819 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:02,819 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:02,819 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=5} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:02,819 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:02,820 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=5}, logState=LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}}} to sender /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:02,820 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:22:02,820 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,822 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=5} -> Epoch{epoch=5}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:02,823 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 810B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:02,836 Flushing.java:153 - Writing Memtable-local_metadata_log@1295236030(168B serialized bytes, 1 ops, 810B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:02,837 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=61934) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,863 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_58853480-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,865 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,866 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:02,866 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:02,866 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,867 Register.java:122 - Registering with endpoint /127.0.0.3:7012 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,868 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 576B (0%) on-heap, 0B (0%) off-heap INFO [node3_OptionalTasks:1] node3 2024-07-04 05:22:02,869 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 564B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:02,873 Flushing.java:153 - Writing Memtable-local@1406695927(65B serialized bytes, 1 ops, 576B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:02,874 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=62018) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,895 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_588beb40-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,897 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,897 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,898 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000002, (Note: This should happen exactly once per node) INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:02,900 BootStrapper.java:256 - tokens manually specified as [30] INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:02,901 Flushing.java:153 - Writing Memtable-local@149523866(53B serialized bytes, 1 ops, 564B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:02,902 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=62100) INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:02,902 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=5}} from /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:02,921 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=6} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:02,921 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=6} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:02,922 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:02,938 Flushing.java:153 - Writing Memtable-local_metadata_log@1658484183(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:02,938 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=72963) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,968 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_58907f20-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,979 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:02,980 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:22:02,980 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.3:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:02,980 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 24, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,19), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,20), TOKENS=Value(,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,23), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:03,010 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,010 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,010 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,010 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=6} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,011 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:03,012 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=6}, logState=LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}}} to sender /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:03,012 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,013 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=6} -> Epoch{epoch=6}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,021 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 45, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 12, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 12, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:03,028 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,040 Flushing.java:153 - Writing Memtable-local_metadata_log@240181361(115B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,041 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=62221) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,087 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_58a45540-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,098 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,098 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:03,098 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=6} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:03,100 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,111 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 569B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,124 Flushing.java:153 - Writing Memtable-local@1584288846(92B serialized bytes, 2 ops, 819B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,124 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=62381) INFO [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,168 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_58b0ff70-39c5-11ef-a1c9-4b8e7a2da833.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,179 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,180 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.092KiB), biggest 5.092KiB, smallest 5.092KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,180 Startup.java:400 - NORMAL WARN 05:22:03 Using stored Gossip Generation 1720070523 as it is greater than current system time 1720070523. See CASSANDRA-3654 if you experience problems WARN [node3_OptionalTasks:1] node3 2024-07-04 05:22:03,184 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070523 as it is greater than current system time 1720070523. See CASSANDRA-3654 if you experience problems INFO [node3_OptionalTasks:1] node3 2024-07-04 05:22:03,185 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 564B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,193 Flushing.java:153 - Writing Memtable-local@1323927989(53B serialized bytes, 1 ops, 564B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,194 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=62463) DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,195 SnapshotManager.java:125 - Adding snapshots: . INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,195 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,200 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,201 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,203 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,204 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,205 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:03,206 FetchCMSLog.java:119 - Responding to /127.0.0.3:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=6}}) with log delta: LogState{baseState=none , entries=0: []} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,210 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,210 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,211 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617886500250 bytes available, checking if we can write 1065 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,211 CompactionTask.java:167 - Compacting (58bf5750-39c5-11ef-a1c9-4b8e7a2da833) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] WARN 05:22:03 Using stored Gossip Generation 1720070524 as it is greater than current system time 1720070523. See CASSANDRA-3654 if you experience problems WARN [node3_OptionalTasks:1] node3 2024-07-04 05:22:03,217 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070524 as it is greater than current system time 1720070523. See CASSANDRA-3654 if you experience problems INFO [node3_OptionalTasks:1] node3 2024-07-04 05:22:03,218 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 564B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_isolatedExecutor:2] node3 2024-07-04 05:22:03,221 SnapshotManager.java:125 - Adding snapshots: . INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,223 Flushing.java:153 - Writing Memtable-local@170412207(53B serialized bytes, 1 ops, 564B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,223 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=62545) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,290 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:03,291 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 37, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), INTERNAL_IP=Value(127.0.0.3,6), RPC_ADDRESS=Value(127.0.0.3,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,311 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,312 CompactionTask.java:258 - Compacted (58bf5750-39c5-11ef-a1c9-4b8e7a2da833) 6 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big,] to level=0. 1.040KiB to 943B (~88% of original) in 95ms. Read Throughput = 10.934KiB/s, Write Throughput = 9.681KiB/s, Row Throughput = ~12/s. 6 total partitions merged to 6. Partition merge counts were {1:6, }. Time spent writing keys = 23ms DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,313 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617886457446 bytes available, checking if we can write 354 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,313 CompactionTask.java:167 - Compacting (58cfd210-39c5-11ef-a1c9-4b8e7a2da833) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,313 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,315 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,317 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,319 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,320 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,321 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 45, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 12, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 12, AppStateMap = {NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,390 CompactionTask.java:258 - Compacted (58cfd210-39c5-11ef-a1c9-4b8e7a2da833) 6 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 354B to 231B (~65% of original) in 74ms. Read Throughput = 4.614KiB/s, Write Throughput = 3.011KiB/s, Row Throughput = ~2/s. 6 total partitions merged to 1. Partition merge counts were {6:1, }. Time spent writing keys = 14ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,391 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,392 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,392 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,392 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,394 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,396 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,397 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:03,399 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:03,448 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:03,448 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node2_GossipStage:1] node2 2024-07-04 05:22:03,450 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=6} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:03,452 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=4}} from /127.0.0.2:7012: start = Epoch{epoch=4}, current = Epoch{epoch=6} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:03,456 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:22:03,457 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=2: Epoch{epoch=5} -> Epoch{epoch=6}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,458 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 814B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,472 Flushing.java:153 - Writing Memtable-local_metadata_log@1975937502(168B serialized bytes, 1 ops, 814B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,473 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=61934) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,516 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_58e61930-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,523 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,523 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,523 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,523 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:03,524 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:22:03,524 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,537 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 761B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,541 Flushing.java:153 - Writing Memtable-local_metadata_log@34350507(115B serialized bytes, 1 ops, 761B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,541 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=62055) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,563 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_58f22720-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,565 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,565 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,565 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=6} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,565 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:03,567 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,621 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070514, version = 46, AppStateMap = {LOAD=Value(62395.0,41), SCHEMA=Value(00000000-0000-0000-0000-000000000002,27), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,32), TOKENS=Value(10,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,35), STATUS_WITH_PORT=Value(NORMAL,10,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 12, AppStateMap = {INTERNAL_IP=Value(127.0.0.2,6), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 12, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,622 Gossiper.java:1969 - Gossip settled after 3 extra polls; proceeding INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:03,656 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=6}} from /127.0.0.2:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:03,661 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=7} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:03,661 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=7} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,662 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:03,670 Flushing.java:153 - Writing Memtable-local_metadata_log@378204629(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:03,671 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=74650) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:03,700 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,700 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,701 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,701 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=7} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,701 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),867)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,701 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:03,701 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} to /127.0.0.3:7012 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,702 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617886683136 bytes available, checking if we can write 1116 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,702 CompactionTask.java:167 - Compacting (590b0650-39c5-11ef-b651-258387aac126) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, ] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:03,702 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=7}, logState=LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}}} to sender /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:03,702 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:22:03,702 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:03,703 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:03,703 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:03,704 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 810B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,704 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,706 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 814B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,718 Flushing.java:153 - Writing Memtable-local_metadata_log@57828083(168B serialized bytes, 1 ops, 810B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,718 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=65366) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,725 Flushing.java:153 - Writing Memtable-local_metadata_log@384416908(168B serialized bytes, 1 ops, 814B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,726 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=62736) INFO [node3_GossipStage:1] node3 2024-07-04 05:22:03,788 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=7} INFO [node1_GossipStage:1] node1 2024-07-04 05:22:03,788 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:03,790 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=6}} from /127.0.0.3:7012: start = Epoch{epoch=6}, current = Epoch{epoch=7} INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,792 CompactionTask.java:258 - Compacted (590b0650-39c5-11ef-b651-258387aac126) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.090KiB to 997B (~89% of original) in 89ms. Read Throughput = 12.211KiB/s, Write Throughput = 10.909KiB/s, Row Throughput = ~14/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 25ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,792 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:03,792 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,792 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:03,793 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:22:03,793 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:03,795 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:03,796 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:03,797 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node2_GossipStage:1] node2 2024-07-04 05:22:03,806 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node2_GossipStage:1] node2 2024-07-04 05:22:03,809 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=7} INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,809 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_590bc9a0-39c5-11ef-a51d-eb1859d1d050.log INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:03,810 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=6}} from /127.0.0.2:7012: start = Epoch{epoch=6}, current = Epoch{epoch=7} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:03,811 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:22:03,812 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=7} -> Epoch{epoch=7}} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:03,814 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,814 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:03,814 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:03,814 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=7} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:03,815 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:03,815 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:22:03,815 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,821 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,822 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,822 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=7} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,822 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,823 Register.java:122 - Registering with endpoint /127.0.0.2:7012 INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,824 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 580B (0%) on-heap, 0B (0%) off-heap INFO [node2_OptionalTasks:1] node2 2024-07-04 05:22:03,825 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 568B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,842 Flushing.java:153 - Writing Memtable-local@2025071672(65B serialized bytes, 1 ops, 580B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,843 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=63367) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,880 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_591dcb00-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,887 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,887 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,887 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000003, (Note: This should happen exactly once per node) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,890 BootStrapper.java:256 - tokens manually specified as [20] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,890 Flushing.java:153 - Writing Memtable-local@1048197737(53B serialized bytes, 1 ops, 568B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,891 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=63449) INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:03,891 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=7}} from /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:03,906 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=8} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:03,906 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=8} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,907 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:03,914 Flushing.java:153 - Writing Memtable-local_metadata_log@853082693(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:03,914 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=77193) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,924 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_592767f0-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,929 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:03,929 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:22:03,929 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.2:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:03,930 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 25, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,16), DC=Value(dc0,17), RACK=Value(rack0,18), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,19), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,20), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,21), TOKENS=Value(,22), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,23), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,24), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:03,941 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,941 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:03,941 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,941 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=8} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:03,941 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:03,942 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:03,942 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=8}, logState=LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}}} to sender /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:03,942 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:22:03,943 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:22:03,943 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:03,943 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=8} -> Epoch{epoch=8}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:03,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 761B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:03,956 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,990 Flushing.java:153 - Writing Memtable-local_metadata_log@798137079(115B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,990 Flushing.java:153 - Writing Memtable-local_metadata_log@1563976048(115B serialized bytes, 1 ops, 761B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:03,991 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=63570) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:03,991 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=65487) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,039 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_5931ef40-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:04,050 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:04,050 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:04,050 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:04,050 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:04,051 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:04,052 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,4), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0), SSTABLE_VERSIONS=Value(big-oa,10)} DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,060 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,060 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.111KiB), biggest 5.111KiB, smallest 5.111KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:04,061 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:04,061 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,078 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 573B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:04,085 Flushing.java:153 - Writing Memtable-local@116308871(92B serialized bytes, 2 ops, 823B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:04,085 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=63730) INFO [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,116 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_59448ce0-39c5-11ef-a51d-eb1859d1d050.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,127 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,127 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,127 Startup.java:400 - NORMAL WARN 05:22:04 Using stored Gossip Generation 1720070524 as it is greater than current system time 1720070524. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-07-04 05:22:04,131 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070524 as it is greater than current system time 1720070524. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-07-04 05:22:04,132 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 568B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,139 SnapshotManager.java:125 - Adding snapshots: . INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,139 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:04,144 Flushing.java:153 - Writing Memtable-local@1604508294(53B serialized bytes, 1 ops, 568B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:04,145 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=63812) INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,149 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,150 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,152 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,153 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,154 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:04,156 FetchCMSLog.java:119 - Responding to /127.0.0.2:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=8}}) with log delta: LogState{baseState=none , entries=0: []} INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,161 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,163 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617886527488 bytes available, checking if we can write 1216 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,164 CompactionTask.java:167 - Compacting (59504cb0-39c5-11ef-a51d-eb1859d1d050) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] DEBUG [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,170 SnapshotManager.java:125 - Adding snapshots: . INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:04,186 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:57820)->/127.0.0.3:7012-SMALL_MESSAGES-bc12221b messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:04,186 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:57820)->/127.0.0.3:7012-SMALL_MESSAGES-8e72d476 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:04,187 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:41200)->/127.0.0.2:7012-SMALL_MESSAGES-89c27a4a messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:04,187 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:41200)->/127.0.0.2:7012-SMALL_MESSAGES-adbb2e74 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:04,199 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:39236)->/127.0.0.1:7012-SMALL_MESSAGES-d5e5d291 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:04,199 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:39250)->/127.0.0.1:7012-SMALL_MESSAGES-818b04ca messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:04,199 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:39236)->/127.0.0.1:7012-SMALL_MESSAGES-d491e05f successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:04,199 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:39250)->/127.0.0.1:7012-SMALL_MESSAGES-3c4a73e6 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,204 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB WARN 05:22:04 Using stored Gossip Generation 1720070525 as it is greater than current system time 1720070524. See CASSANDRA-3654 if you experience problems WARN [node2_OptionalTasks:1] node2 2024-07-04 05:22:04,214 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070525 as it is greater than current system time 1720070524. See CASSANDRA-3654 if you experience problems INFO [node2_OptionalTasks:1] node2 2024-07-04 05:22:04,215 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 568B (0%) on-heap, 0B (0%) off-heap INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:04,220 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:41202)->/127.0.0.2:7012-SMALL_MESSAGES-56044f43 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:04,220 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:41202)->/127.0.0.2:7012-SMALL_MESSAGES-a0c49325 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:04,221 Flushing.java:153 - Writing Memtable-local@820251241(53B serialized bytes, 1 ops, 568B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:04,222 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=63894) INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:04,225 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:57824)->/127.0.0.3:7012-SMALL_MESSAGES-f0f87f8c messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:04,225 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:57824)->/127.0.0.3:7012-SMALL_MESSAGES-96af07a2 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,250 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,252 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,254 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,260 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,262 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,264 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,265 CompactionTask.java:258 - Compacted (59504cb0-39c5-11ef-a51d-eb1859d1d050) 8 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big,] to level=0. 1.188KiB to 1018B (~83% of original) in 88ms. Read Throughput = 13.434KiB/s, Write Throughput = 11.246KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 45ms DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,266 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617886640333 bytes available, checking if we can write 324 bytes INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,266 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,266 CompactionTask.java:167 - Compacting (59613ca0-39c5-11ef-a51d-eb1859d1d050) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,268 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:04,327 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:04,327 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 38, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,28), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), INTERNAL_IP=Value(127.0.0.2,6), RPC_ADDRESS=Value(127.0.0.2,32), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,33), TOKENS=Value(20,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,36), STATUS_WITH_PORT=Value(NORMAL,20,37), SSTABLE_VERSIONS=Value(big-oa,10)} INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:04,367 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,386 CompactionTask.java:258 - Compacted (59613ca0-39c5-11ef-a51d-eb1859d1d050) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 324B to 229B (~70% of original) in 118ms. Read Throughput = 2.661KiB/s, Write Throughput = 1.881KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 60ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,388 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,388 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:04,388 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,389 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,391 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,392 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:04,393 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node3_isolatedExecutor:2] node3 2024-07-04 05:22:04,410 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' INFO [node2_isolatedExecutor:2] node2 2024-07-04 05:22:04,411 CassandraRoleManager.java:458 - Created default superuser role 'cassandra' DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:22:04,429 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (distributed_test_keyspace) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:04,435 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New epoch is Epoch{epoch=9} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:22:04,436 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=9} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,437 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 919B (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:04,449 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:04,449 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,449 Flushing.java:153 - Writing Memtable-local_metadata_log@374526138(275B serialized bytes, 1 ops, 919B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,450 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=79810) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,499 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.242KiB), biggest 5.242KiB, smallest 5.242KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:04,499 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:04,499 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,500 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.122KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,509 Flushing.java:153 - Writing Memtable-column_masks@655850346(10.483KiB serialized bytes, 253 ops, 68.122KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,513 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80007) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,534 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.451KiB), biggest 8.451KiB, smallest 8.451KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,534 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.303KiB (2%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,540 Flushing.java:153 - Writing Memtable-columns@1725051396(43.473KiB serialized bytes, 253 ops, 198.303KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,546 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80007) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,573 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,573 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.354KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,578 Flushing.java:153 - Writing Memtable-dropped_columns@476307377(135B serialized bytes, 3 ops, 1.354KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,578 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80007) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,632 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,632 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,647 Flushing.java:153 - Writing Memtable-triggers@481561479(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,647 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80007) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,702 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,702 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,716 Flushing.java:153 - Writing Memtable-types@6614864(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,716 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80007) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,773 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,774 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,783 Flushing.java:153 - Writing Memtable-functions@2010234698(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,784 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80007) INFO [node1_GossipStage:1] node1 2024-07-04 05:22:04,807 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,837 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,837 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,848 Flushing.java:153 - Writing Memtable-aggregates@1968007254(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,848 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80554) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,885 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,885 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.356KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,890 Flushing.java:153 - Writing Memtable-indexes@1226419531(213B serialized bytes, 3 ops, 1.356KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,891 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80554) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,919 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.552KiB), biggest 5.552KiB, smallest 5.552KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,919 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.695KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,924 Flushing.java:153 - Writing Memtable-tables@1847645527(28.593KiB serialized bytes, 38 ops, 90.695KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,926 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80554) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:04,975 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:04,975 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 725B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,983 Flushing.java:153 - Writing Memtable-views@342957110(16B serialized bytes, 2 ops, 725B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:04,984 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80554) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:05,036 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:05,037 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.331KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:05,045 Flushing.java:153 - Writing Memtable-keyspaces@182503734(415B serialized bytes, 5 ops, 2.331KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:05,046 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=80554) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:05,109 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:05,109 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}}. New tail is Epoch{epoch=9} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:05,109 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:05,118 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:05,118 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} to /127.0.0.2:7012 INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:22:05,122 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:05,123 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:05,123 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:22:05,123 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,130 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 921B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,130 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 917B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,142 Flushing.java:153 - Writing Memtable-local_metadata_log@776589028(275B serialized bytes, 1 ops, 921B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,143 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67044) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,147 Flushing.java:153 - Writing Memtable-local_metadata_log@766773905(275B serialized bytes, 1 ops, 917B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,147 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=66276) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,232 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.242KiB), biggest 5.242KiB, smallest 5.242KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:05,232 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,232 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.242KiB), biggest 5.242KiB, smallest 5.242KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,232 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:05,232 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,232 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,232 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),943), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),187)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,233 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617899041587 bytes available, checking if we can write 1281 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,233 CompactionTask.java:167 - Compacting (59f4a300-39c5-11ef-a1c9-4b8e7a2da833) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, ] INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,234 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.118KiB (1%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,234 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 68.126KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,241 Flushing.java:153 - Writing Memtable-column_masks@1695634104(10.483KiB serialized bytes, 253 ops, 68.118KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,243 Flushing.java:153 - Writing Memtable-column_masks@1569225257(10.483KiB serialized bytes, 253 ops, 68.126KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,247 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070517035, position=66473) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,250 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (7.329KiB) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67241) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,304 CompactionTask.java:258 - Compacted (59f4a300-39c5-11ef-a1c9-4b8e7a2da833) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big,] to level=0. 1.251KiB to 1.142KiB (~91% of original) in 70ms. Read Throughput = 17.757KiB/s, Write Throughput = 16.205KiB/s, Row Throughput = ~18/s. 9 total partitions merged to 9. Partition merge counts were {1:9, }. Time spent writing keys = 11ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:05,305 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,305 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:05,305 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:05,306 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:05,308 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:05,309 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,332 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.451KiB), biggest 8.451KiB, smallest 8.451KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,332 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.307KiB (2%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,337 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 8.452KiB), biggest 8.452KiB, smallest 8.452KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,337 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 198.299KiB (2%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,342 Flushing.java:153 - Writing Memtable-columns@347602420(43.473KiB serialized bytes, 253 ops, 198.307KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,349 Flushing.java:153 - Writing Memtable-columns@1969541395(43.473KiB serialized bytes, 253 ops, 198.299KiB (2%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,353 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67241) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,360 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (17.768KiB) for commitlog position CommitLogPosition(segmentId=1720070517035, position=67512) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,442 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.483KiB), biggest 11.483KiB, smallest 11.483KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,442 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 11.482KiB), biggest 11.482KiB, smallest 11.482KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,442 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.351KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,442 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.dropped_columns, Reason: INTERNALLY_FORCED, Usage: 1.358KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:05,449 FailureDetector.java:361 - Still not marking nodes down due to local pause DEBUG [node1_GossipTasks:1] node1 2024-07-04 05:22:05,449 FailureDetector.java:361 - Still not marking nodes down due to local pause INFO [node3_GossipStage:1] node3 2024-07-04 05:22:05,450 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:05,451 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=8}} from /127.0.0.3:7012: start = Epoch{epoch=8}, current = Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:05,453 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node3_GossipStage:1] node3 2024-07-04 05:22:05,453 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL DEBUG [node3_MetadataFetchLogStage:1] node3 2024-07-04 05:22:05,454 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,455 Flushing.java:153 - Writing Memtable-dropped_columns@1310369898(135B serialized bytes, 3 ops, 1.351KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,455 Flushing.java:153 - Writing Memtable-dropped_columns@76552777(135B serialized bytes, 3 ops, 1.358KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,456 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=67512) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,456 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67241) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,523 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,523 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big-Data.db')] (1 sstables, 5.398KiB), biggest 5.398KiB, smallest 5.398KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,524 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 729B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,524 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.triggers, Reason: INTERNALLY_FORCED, Usage: 721B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,527 Flushing.java:153 - Writing Memtable-triggers@1691273937(16B serialized bytes, 2 ops, 729B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,527 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67241) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,529 Flushing.java:153 - Writing Memtable-triggers@1131926458(16B serialized bytes, 2 ops, 721B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,529 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,560 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.159KiB), biggest 5.159KiB, smallest 5.159KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,560 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big-Data.db')] (1 sstables, 5.158KiB), biggest 5.158KiB, smallest 5.158KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,560 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 729B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,560 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.types, Reason: INTERNALLY_FORCED, Usage: 721B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,570 Flushing.java:153 - Writing Memtable-types@748473854(16B serialized bytes, 2 ops, 721B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,570 Flushing.java:153 - Writing Memtable-types@2047454547(16B serialized bytes, 2 ops, 729B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,571 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67241) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,571 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,624 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,624 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,624 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 721B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,624 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.functions, Reason: INTERNALLY_FORCED, Usage: 729B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,637 Flushing.java:153 - Writing Memtable-functions@2141416759(16B serialized bytes, 2 ops, 721B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,637 Flushing.java:153 - Writing Memtable-functions@1366996923(16B serialized bytes, 2 ops, 729B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,637 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67241) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,637 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,723 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,723 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,723 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 721B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,723 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.aggregates, Reason: INTERNALLY_FORCED, Usage: 729B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,735 Flushing.java:153 - Writing Memtable-aggregates@1692521297(16B serialized bytes, 2 ops, 721B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,735 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,746 Flushing.java:153 - Writing Memtable-aggregates@1438432655(16B serialized bytes, 2 ops, 729B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,747 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67241) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,798 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.327KiB), biggest 5.327KiB, smallest 5.327KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,798 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big-Data.db')] (1 sstables, 5.326KiB), biggest 5.326KiB, smallest 5.326KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,798 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.353KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,798 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.indexes, Reason: INTERNALLY_FORCED, Usage: 1.360KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,802 Flushing.java:153 - Writing Memtable-indexes@1194749355(213B serialized bytes, 3 ops, 1.360KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,802 Flushing.java:153 - Writing Memtable-indexes@435562100(213B serialized bytes, 3 ops, 1.353KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67426) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,802 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db (196B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) INFO [node2_GossipStage:1] node2 2024-07-04 05:22:05,807 PeerLogFetcher.java:91 - Fetching log from /127.0.0.1:7012, at least Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:05,807 FetchPeerLog.java:84 - Received peer log fetch request FetchPeerLog{, start=Epoch{epoch=8}} from /127.0.0.2:7012: start = Epoch{epoch=8}, current = Epoch{epoch=9} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:05,809 FetchPeerLog.java:87 - Responding with log delta: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node2_MetadataFetchLogStage:1] node2 2024-07-04 05:22:05,810 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=9} -> Epoch{epoch=9}} DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,861 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,861 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.691KiB (1%) on-heap, 0B (0%) off-heap DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,861 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big-Data.db')] (1 sstables, 5.553KiB), biggest 5.553KiB, smallest 5.553KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,861 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 90.699KiB (1%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,887 Flushing.java:153 - Writing Memtable-tables@1406135177(28.593KiB serialized bytes, 38 ops, 90.691KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,889 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,897 Flushing.java:153 - Writing Memtable-tables@1893872427(28.593KiB serialized bytes, 38 ops, 90.699KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,899 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (15.792KiB) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67426) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:05,970 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:05,970 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 9.196KiB), biggest 9.196KiB, smallest 9.196KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:05,970 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 721B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:05,970 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.views, Reason: INTERNALLY_FORCED, Usage: 729B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,982 Flushing.java:153 - Writing Memtable-views@937553426(16B serialized bytes, 2 ops, 721B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,982 Flushing.java:153 - Writing Memtable-views@1948354019(16B serialized bytes, 2 ops, 729B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:05,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:05,983 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db (49B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67426) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:06,044 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:06,044 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big-Data.db')] (1 sstables, 5.078KiB), biggest 5.078KiB, smallest 5.078KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,044 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.337KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,044 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.325KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,060 Flushing.java:153 - Writing Memtable-keyspaces@1567672548(415B serialized bytes, 5 ops, 2.325KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,060 Flushing.java:153 - Writing Memtable-keyspaces@1153502765(415B serialized bytes, 5 ops, 2.337KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,062 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67426) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,062 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (310B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68244) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:06,088 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.477KiB), biggest 5.477KiB, smallest 5.477KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:06,088 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.478KiB), biggest 5.478KiB, smallest 5.478KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,089 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=9} INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,089 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=9} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,089 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,090 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,098 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,098 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,098 Schema.java:287 - Submitting schema transformation CreateKeyspaceStatement (tr) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,099 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,099 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,100 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,108 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New epoch is Epoch{epoch=10} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,108 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=10} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,109 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 869B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,117 Flushing.java:153 - Writing Memtable-local_metadata_log@236412628(225B serialized bytes, 1 ops, 869B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,117 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=82053) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:06,156 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.220KiB), biggest 5.220KiB, smallest 5.220KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,156 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,156 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,156 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),997), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),164)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,157 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898294477 bytes available, checking if we can write 1401 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,157 CompactionTask.java:167 - Compacting (5a81a0c0-39c5-11ef-b651-258387aac126) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,158 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,171 Flushing.java:153 - Writing Memtable-keyspaces@1727379500(153B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,171 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=82223) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,248 CompactionTask.java:258 - Compacted (5a81a0c0-39c5-11ef-b651-258387aac126) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 1.368KiB to 1.210KiB (~88% of original) in 90ms. Read Throughput = 15.070KiB/s, Write Throughput = 13.328KiB/s, Row Throughput = ~20/s. 10 total partitions merged to 10. Partition merge counts were {1:10, }. Time spent writing keys = 26ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,249 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,249 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,249 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,251 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,252 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,253 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:06,278 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,279 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}}. New tail is Epoch{epoch=10} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,279 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,279 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898356736 bytes available, checking if we can write 615 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,279 CompactionTask.java:167 - Compacting (5a946570-39c5-11ef-b651-258387aac126) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,282 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,283 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} to /127.0.0.2:7012 INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:22:06,283 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:22:06,284 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:22:06,284 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:22:06,284 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=10} -> Epoch{epoch=10}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,286 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,286 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,287 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,287 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,288 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,288 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,295 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 867B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,295 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 871B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,307 Flushing.java:153 - Writing Memtable-local_metadata_log@812541995(225B serialized bytes, 1 ops, 871B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,307 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67748) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,317 Flushing.java:153 - Writing Memtable-local_metadata_log@1964871864(225B serialized bytes, 1 ops, 867B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,318 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68566) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,355 CompactionTask.java:258 - Compacted (5a946570-39c5-11ef-b651-258387aac126) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 360B (~58% of original) in 75ms. Read Throughput = 7.984KiB/s, Write Throughput = 4.673KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 17ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,356 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,357 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,359 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,361 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:06,371 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.220KiB), biggest 5.220KiB, smallest 5.220KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:06,371 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.220KiB), biggest 5.220KiB, smallest 5.220KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:06,371 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,371 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,371 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:06,371 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,373 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 753B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,373 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,382 Flushing.java:153 - Writing Memtable-keyspaces@1374973542(153B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,382 Flushing.java:153 - Writing Memtable-keyspaces@1495445041(153B serialized bytes, 1 ops, 753B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=68736) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,382 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=67918) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:06,444 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:06,444 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,444 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=10} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,444 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=10} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,444 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,445 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898317824 bytes available, checking if we can write 615 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,445 CompactionTask.java:167 - Compacting (5aad92c0-39c5-11ef-a51d-eb1859d1d050) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:06,445 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898317824 bytes available, checking if we can write 615 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:06,445 CompactionTask.java:167 - Compacting (5aad92c0-39c5-11ef-a1c9-4b8e7a2da833) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,445 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,451 Schema.java:287 - Submitting schema transformation CreateTableStatement (tr, x) INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,457 AbstractLocalProcessor.java:98 - Committed AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New epoch is Epoch{epoch=11} DEBUG [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,458 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=11} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,458 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.585KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,478 Flushing.java:153 - Writing Memtable-local_metadata_log@2063173736(979B serialized bytes, 1 ops, 1.585KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,478 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=88980) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,526 CompactionTask.java:258 - Compacted (5aad92c0-39c5-11ef-a51d-eb1859d1d050) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 363B (~59% of original) in 80ms. Read Throughput = 7.472KiB/s, Write Throughput = 4.410KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 17ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:06,526 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:06,528 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:06,530 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:06,531 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:06,537 CompactionTask.java:258 - Compacted (5aad92c0-39c5-11ef-a1c9-4b8e7a2da833) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big,] to level=0. 615B to 364B (~59% of original) in 90ms. Read Throughput = 6.604KiB/s, Write Throughput = 3.909KiB/s, Row Throughput = ~16/s. 8 total partitions merged to 8. Partition merge counts were {1:8, }. Time spent writing keys = 24ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:06,538 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:06,539 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:06,541 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:06,543 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:06,551 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.725KiB), biggest 5.725KiB, smallest 5.725KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,551 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,551 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,553 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,561 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,566 Flushing.java:153 - Writing Memtable-column_masks@1994147704(32B serialized bytes, 1 ops, 578B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,567 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=90064) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:06,616 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,616 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.138KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,623 Flushing.java:153 - Writing Memtable-columns@1116296841(159B serialized bytes, 1 ops, 1.138KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,624 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=90064) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:06,679 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,680 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.894KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,680 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898380083 bytes available, checking if we can write 8318 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,680 CompactionTask.java:167 - Compacting (5ad16e70-39c5-11ef-b651-258387aac126) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,686 Flushing.java:153 - Writing Memtable-tables@158769708(773B serialized bytes, 1 ops, 2.894KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,687 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=90064) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:06,764 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,765 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,776 CompactionTask.java:258 - Compacted (5ad16e70-39c5-11ef-b651-258387aac126) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.923KiB (~97% of original) in 94ms. Read Throughput = 85.750KiB/s, Write Throughput = 83.637KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 33ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,776 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,777 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898325606 bytes available, checking if we can write 4687 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,777 CompactionTask.java:167 - Compacting (5ae03b80-39c5-11ef-b651-258387aac126) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,778 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,779 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,780 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,783 Flushing.java:153 - Writing Memtable-keyspaces@1073402274(153B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:06,783 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=90064) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:06,825 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,826 LocalLog.java:492 - Enacted EXECUTED {AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}}. New tail is Epoch{epoch=11} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:06,826 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:06,828 CompactionTask.java:258 - Compacted (5ae03b80-39c5-11ef-b651-258387aac126) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.009KiB (~87% of original) in 50ms. Read Throughput = 90.316KiB/s, Write Throughput = 79.101KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 18ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,829 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,828 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.3:7012 INFO [node1_isolatedExecutor:2] node1 2024-07-04 05:22:06,829 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} to /127.0.0.2:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,830 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:06,830 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:06,831 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:22:06,831 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:22:06,831 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=11} -> Epoch{epoch=11}} INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,832 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:06,834 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,835 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.583KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,835 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.587KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,845 Flushing.java:153 - Writing Memtable-local_metadata_log@688060198(979B serialized bytes, 1 ops, 1.587KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,845 Flushing.java:153 - Writing Memtable-local_metadata_log@1636522617(979B serialized bytes, 1 ops, 1.583KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,845 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=71203) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,845 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=70385) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:06,926 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.725KiB), biggest 5.725KiB, smallest 5.725KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,926 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:06,926 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db')] (1 sstables, 5.725KiB), biggest 5.725KiB, smallest 5.725KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:06,926 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,927 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:06,927 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,927 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),1018), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),683)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,927 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898430669 bytes available, checking if we can write 2052 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:06,927 CompactionTask.java:167 - Compacting (5af745f0-39c5-11ef-a51d-eb1859d1d050) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, ] INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,929 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,929 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:06,940 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 576B (0%) on-heap, 0B (0%) off-heap INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:06,940 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 580B (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,959 Flushing.java:153 - Writing Memtable-column_masks@988256580(32B serialized bytes, 1 ops, 576B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,959 Flushing.java:153 - Writing Memtable-column_masks@1711158349(32B serialized bytes, 1 ops, 580B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:06,959 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=72287) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:06,959 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=71469) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,000 CompactionTask.java:258 - Compacted (5af745f0-39c5-11ef-a51d-eb1859d1d050) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big,] to level=0. 2.004KiB to 1.722KiB (~85% of original) in 71ms. Read Throughput = 28.019KiB/s, Write Throughput = 24.073KiB/s, Row Throughput = ~22/s. 11 total partitions merged to 11. Partition merge counts were {1:11, }. Time spent writing keys = 10ms DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,000 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,000 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,000 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,001 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,003 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,004 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:07,019 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:07,019 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:07,019 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.140KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:07,019 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.136KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,023 Flushing.java:153 - Writing Memtable-columns@602294000(159B serialized bytes, 1 ops, 1.136KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,023 Flushing.java:153 - Writing Memtable-columns@638728169(159B serialized bytes, 1 ops, 1.140KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,023 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=72287) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,023 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=72510) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:07,090 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:07,090 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:07,091 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.896KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:07,091 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.892KiB (0%) on-heap, 0B (0%) off-heap DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:07,091 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898337280 bytes available, checking if we can write 8318 bytes DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,091 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898337280 bytes available, checking if we can write 8318 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:07,091 CompactionTask.java:167 - Compacting (5b102520-39c5-11ef-a1c9-4b8e7a2da833) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,091 CompactionTask.java:167 - Compacting (5b102520-39c5-11ef-a51d-eb1859d1d050) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db:level=0, ] INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,103 Flushing.java:153 - Writing Memtable-tables@1416096275(773B serialized bytes, 1 ops, 2.896KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,104 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=72510) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,115 Flushing.java:153 - Writing Memtable-tables@1870215067(773B serialized bytes, 1 ops, 2.892KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,115 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=72287) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:07,203 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:07,204 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,207 CompactionTask.java:258 - Compacted (5b102520-39c5-11ef-a51d-eb1859d1d050) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.938KiB (~97% of original) in 114ms. Read Throughput = 70.642KiB/s, Write Throughput = 69.028KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 47ms INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:07,207 CompactionTask.java:258 - Compacted (5b102520-39c5-11ef-a1c9-4b8e7a2da833) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big,] to level=0. 8.123KiB to 7.954KiB (~97% of original) in 115ms. Read Throughput = 70.424KiB/s, Write Throughput = 68.960KiB/s, Row Throughput = ~331/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 50ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,208 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,208 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-4-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,208 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898243891 bytes available, checking if we can write 4687 bytes INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,208 CompactionTask.java:167 - Compacting (5b21ff70-39c5-11ef-a51d-eb1859d1d050) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,209 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,210 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:07,211 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db')] (1 sstables, 6.963KiB), biggest 6.963KiB, smallest 6.963KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:07,211 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 753B (0%) on-heap, 0B (0%) off-heap INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,212 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:07,212 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617898348954 bytes available, checking if we can write 4687 bytes INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,212 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:07,212 CompactionTask.java:167 - Compacting (5b229bb0-39c5-11ef-a1c9-4b8e7a2da833) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db:level=0, ] INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,214 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,214 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,218 Flushing.java:153 - Writing Memtable-keyspaces@1784843390(153B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,218 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=72510) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,224 Flushing.java:153 - Writing Memtable-keyspaces@1419436191(153B serialized bytes, 1 ops, 753B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,224 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=73102) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,292 CompactionTask.java:258 - Compacted (5b21ff70-39c5-11ef-a51d-eb1859d1d050) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 3.997KiB (~87% of original) in 82ms. Read Throughput = 55.659KiB/s, Write Throughput = 48.605KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 20ms INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,292 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,293 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,295 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,296 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:07,306 CompactionTask.java:258 - Compacted (5b229bb0-39c5-11ef-a1c9-4b8e7a2da833) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big,] to level=0. 4.577KiB to 4.001KiB (~87% of original) in 93ms. Read Throughput = 49.016KiB/s, Write Throughput = 42.846KiB/s, Row Throughput = ~59/s. 7 total partitions merged to 7. Partition merge counts were {1:7, }. Time spent writing keys = 24ms INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,307 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:07,308 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:07,308 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=11} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:07,308 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,308 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,310 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,311 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-4-big DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:07,318 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db')] (1 sstables, 5.210KiB), biggest 5.210KiB, smallest 5.210KiB INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:07,319 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=11} DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:07,319 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node1_Repair-Task:1] node1 2024-07-04 05:22:07,551 RepairCoordinator.java:366 - Starting repair command #1 (5b559290-39c5-11ef-b651-258387aac126), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,569 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000a]', ranges=[(30,10]], parentRepairSession=5b559290-39c5-11ef-b651-258387aac126, isIncremental=true, timestamp=1720070527559, isGlobal=true} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:07,569 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000a]', ranges=[(30,10]], parentRepairSession=5b559290-39c5-11ef-b651-258387aac126, isIncremental=true, timestamp=1720070527559, isGlobal=true} INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:22:07,578 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 5b559290-39c5-11ef-b651-258387aac126 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:22:07,579 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 5b559290-39c5-11ef-b651-258387aac126 INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:07,582 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:39264)->/127.0.0.1:7012-SMALL_MESSAGES-1cf0e0ce successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:07,582 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:39264)->/127.0.0.1:7012-SMALL_MESSAGES-cbeb6cd8 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,584 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5b559290-39c5-11ef-b651-258387aac126, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070527559, ranges=[(30,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070527, lastUpdate=1720070527} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:07,584 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5b559290-39c5-11ef-b651-258387aac126, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070527559, ranges=[(30,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070527, lastUpdate=1720070527} DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,587 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5b559290-39c5-11ef-b651-258387aac126, state=PREPARING, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070527559, ranges=[(30,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070527, lastUpdate=1720070527} INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,588 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 15.273KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,588 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 16.289KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:07,588 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: ANTICOMPACTION, Usage: 8.066KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:07,598 Flushing.java:153 - Writing Memtable-x@730445474(1.133KiB serialized bytes, 40 ops, 15.273KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:07,600 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db (473B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=95511) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,603 Flushing.java:153 - Writing Memtable-x@1378975473(580B serialized bytes, 20 ops, 8.066KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,603 Flushing.java:153 - Writing Memtable-x@2116714787(1.133KiB serialized bytes, 40 ops, 16.289KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:07,604 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db (233B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=76252) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:07,605 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db (473B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=77788) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:07,654 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] (1 sstables, 5.658KiB), biggest 5.658KiB, smallest 5.658KiB DEBUG [node1_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node1 2024-07-04 05:22:07,656 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node1_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node1 2024-07-04 05:22:07,656 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:07,656 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] (1 sstables, 5.269KiB), biggest 5.269KiB, smallest 5.269KiB DEBUG [node1_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node1 2024-07-04 05:22:07,657 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node3_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node3 2024-07-04 05:22:07,657 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:07,657 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] (1 sstables, 5.655KiB), biggest 5.655KiB, smallest 5.655KiB DEBUG [node3_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node3 2024-07-04 05:22:07,658 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,658 CompactionManager.java:928 - [repair #5b559290-39c5-11ef-b651-258387aac126] Starting anticompaction for tr.x on 1/1 sstables DEBUG [node2_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node2 2024-07-04 05:22:07,659 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5b559290-39c5-11ef-b651-258387aac126 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,659 CompactionManager.java:994 - [repair #5b559290-39c5-11ef-b651-258387aac126] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (,10] INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,659 CompactionManager.java:994 - [repair #5b559290-39c5-11ef-b651-258387aac126] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (30,] DEBUG [node3_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node3 2024-07-04 05:22:07,659 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node2_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node2 2024-07-04 05:22:07,659 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,659 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node3_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node3 2024-07-04 05:22:07,660 LocalSessions.java:863 - Prepare phase for incremental repair session 5b559290-39c5-11ef-b651-258387aac126 completed INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,660 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] in tr.x for 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node2_Repair-5b559290-39c5-11ef-b651-258387aac126:1] node2 2024-07-04 05:22:07,661 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,662 CompactionManager.java:928 - [repair #5b559290-39c5-11ef-b651-258387aac126] Starting anticompaction for tr.x on 1/1 sstables INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,665 CompactionManager.java:994 - [repair #5b559290-39c5-11ef-b651-258387aac126] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (,10] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,665 CompactionManager.java:994 - [repair #5b559290-39c5-11ef-b651-258387aac126] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db') ([00,49]) will be anticompacted on range (30,] INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,666 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 5b559290-39c5-11ef-b651-258387aac126 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,666 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] in tr.x for 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,829 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 5b559290-39c5-11ef-b651-258387aac126 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,829 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db')] for 5b559290-39c5-11ef-b651-258387aac126 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,829 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 5b559290-39c5-11ef-b651-258387aac126. INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,830 CompactionManager.java:948 - [repair #5b559290-39c5-11ef-b651-258387aac126] Completed anticompaction successfully DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:07,830 LocalSessions.java:863 - Prepare phase for incremental repair session 5b559290-39c5-11ef-b651-258387aac126 completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:07,831 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,839 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 5b559290-39c5-11ef-b651-258387aac126 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,840 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db')] for 5b559290-39c5-11ef-b651-258387aac126 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,840 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 5b559290-39c5-11ef-b651-258387aac126. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,840 CompactionManager.java:948 - [repair #5b559290-39c5-11ef-b651-258387aac126] Completed anticompaction successfully DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:07,840 LocalSessions.java:863 - Prepare phase for incremental repair session 5b559290-39c5-11ef-b651-258387aac126 completed INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,841 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/tr/x-1b255f4def2540a6000000000000000a/oa-1-big INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,844 CoordinatorSession.java:225 - Incremental repair session 5b559290-39c5-11ef-b651-258387aac126 successfully prepared. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,845 CoordinatorSession.java:353 - Incremental repair 5b559290-39c5-11ef-b651-258387aac126 prepare phase completed in 0 seconds INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,845 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.2:7012, /127.0.0.3:7012], transEndpoints=[/127.0.0.3:7012], ranges=[(30,10]], hasSkippedReplicas=false} INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,848 RepairSession.java:297 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] parentSessionId = 5b559290-39c5-11ef-b651-258387aac126: new session: will sync /127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012 on range CommonRange{endpoints=[/127.0.0.2:7012, /127.0.0.3:7012], transEndpoints=[/127.0.0.3:7012], ranges=[(30,10]], hasSkippedReplicas=false} for tr.[x] INFO [node1_Repair#1:1] node1 2024-07-04 05:22:07,856 RepairJob.java:137 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] tr.x not running paxos repair INFO [node1_RepairJobTask:1] node1 2024-07-04 05:22:07,857 RepairJob.java:504 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Requesting merkle trees for x (to [/127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.1:7012]) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,860 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070527} org.apache.cassandra.repair.messages.ValidationRequest@6686317f DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,861 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070527} org.apache.cassandra.repair.messages.ValidationRequest@6686317f DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:07,861 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070527} org.apache.cassandra.repair.messages.ValidationRequest@6686317f DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,863 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5b559290-39c5-11ef-b651-258387aac126, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070527559, ranges=[(30,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070527, lastUpdate=1720070527} to REPAIRING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,863 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5b559290-39c5-11ef-b651-258387aac126, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070527559, ranges=[(30,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070527, lastUpdate=1720070527} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:07,863 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5b559290-39c5-11ef-b651-258387aac126, state=PREPARED, coordinator=/127.0.0.1:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070527559, ranges=[(30,10]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070527, lastUpdate=1720070527} to REPAIRING INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:22:07,867 RepairMessage.java:259 - [#5b559290-39c5-11ef-b651-258387aac126] VALIDATION_REQ received by /127.0.0.2:7012 INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,869 CassandraValidationIterator.java:215 - [repair #5b83ce80-39c5-11ef-b651-258387aac126], parentSessionId=5b559290-39c5-11ef-b651-258387aac126: Performing validation compaction on 1 sstables in tr.x INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,870 CassandraValidationIterator.java:215 - [repair #5b83ce80-39c5-11ef-b651-258387aac126], parentSessionId=5b559290-39c5-11ef-b651-258387aac126: Performing validation compaction on 0 sstables in tr.x INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,871 CassandraValidationIterator.java:215 - [repair #5b83ce80-39c5-11ef-b651-258387aac126], parentSessionId=5b559290-39c5-11ef-b651-258387aac126: Performing validation compaction on 1 sstables in tr.x INFO [node1_RequestResponseStage-2] node1 2024-07-04 05:22:07,872 RepairMessage.java:259 - [#5b559290-39c5-11ef-b651-258387aac126] VALIDATION_REQ received by /127.0.0.3:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:22:07,872 RepairMessage.java:259 - [#5b559290-39c5-11ef-b651-258387aac126] VALIDATION_REQ received by /127.0.0.1:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,890 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,890 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,891 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,891 Validator.java:158 - Prepared AEService trees of size 1 for [repair #5b83ce80-39c5-11ef-b651-258387aac126 on tr/x, [(30,10]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,892 Validator.java:229 - Validated 0 partitions for 5b83ce80-39c5-11ef-b651-258387aac126. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,893 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,893 Validator.java:231 - Validated 0 partitions for 5b83ce80-39c5-11ef-b651-258387aac126. Partition sizes are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,893 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:07,893 Validator.java:257 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Sending completed merkle tree to /127.0.0.1:7012 for tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:07,893 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 24 msec, for [repair #5b83ce80-39c5-11ef-b651-258387aac126 on tr/x, [(30,10]]] WARN 05:22:07 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:07,895 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,896 RepairSession.java:242 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,898 Validator.java:158 - Prepared AEService trees of size 127 for [repair #5b83ce80-39c5-11ef-b651-258387aac126 on tr/x, [(30,10]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,900 Validator.java:158 - Prepared AEService trees of size 127 for [repair #5b83ce80-39c5-11ef-b651-258387aac126 on tr/x, [(30,10]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,907 Validator.java:229 - Validated 30 partitions for 5b83ce80-39c5-11ef-b651-258387aac126. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,908 EstimatedHistogram.java:337 - [0..0]: 124 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,908 EstimatedHistogram.java:337 - [1..1]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,908 EstimatedHistogram.java:337 - [2..2]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 EstimatedHistogram.java:337 - [3..3]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 EstimatedHistogram.java:337 - [4..19]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 Validator.java:231 - Validated 30 partitions for 5b83ce80-39c5-11ef-b651-258387aac126. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 EstimatedHistogram.java:337 - [0..11]: 124 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 EstimatedHistogram.java:337 - [12..100]: 2 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 EstimatedHistogram.java:337 - [101..189]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 EstimatedHistogram.java:337 - [190..278]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 EstimatedHistogram.java:337 - [279..931]: 2 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,909 Validator.java:262 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Local completed merkle tree for /127.0.0.1:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:07,909 ValidationManager.java:152 - Validation of 30 partitions (~353B) finished in 41 msec, for [repair #5b83ce80-39c5-11ef-b651-258387aac126 on tr/x, [(30,10]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,910 Validator.java:229 - Validated 30 partitions for 5b83ce80-39c5-11ef-b651-258387aac126. Partitions per leaf are: INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,910 RepairSession.java:242 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Received merkle tree for x from /127.0.0.1:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,911 EstimatedHistogram.java:337 - [0..0]: 124 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,911 EstimatedHistogram.java:337 - [1..1]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,911 EstimatedHistogram.java:337 - [2..2]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,911 EstimatedHistogram.java:337 - [3..3]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,911 EstimatedHistogram.java:337 - [4..19]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,912 Validator.java:231 - Validated 30 partitions for 5b83ce80-39c5-11ef-b651-258387aac126. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,912 EstimatedHistogram.java:337 - [0..11]: 124 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,912 EstimatedHistogram.java:337 - [12..100]: 2 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,912 EstimatedHistogram.java:337 - [101..189]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,912 EstimatedHistogram.java:337 - [190..278]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,912 EstimatedHistogram.java:337 - [279..931]: 2 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,912 Validator.java:257 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Sending completed merkle tree to /127.0.0.1:7012 for tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:07,913 ValidationManager.java:152 - Validation of 30 partitions (~353B) finished in 43 msec, for [repair #5b83ce80-39c5-11ef-b651-258387aac126 on tr/x, [(30,10]]] INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,917 RepairSession.java:242 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Received merkle tree for x from /127.0.0.2:7012 INFO [node1_RepairJobTask:4] node1 2024-07-04 05:22:07,918 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 5b559290-39c5-11ef-b651-258387aac126 (took: 1ms) INFO [node1_RepairJobTask:4] node1 2024-07-04 05:22:07,919 SyncTask.java:93 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Endpoints /127.0.0.2:7012 and /127.0.0.3:7012 have 1 range(s) out of sync for x INFO [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,919 SyncTask.java:93 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Endpoints /127.0.0.1:7012 and /127.0.0.3:7012 have 1 range(s) out of sync for x INFO [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,919 LocalSyncTask.java:118 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Performing streaming repair of 1 ranges with /127.0.0.3:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,921 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.1:7012, src=/127.0.0.2:7012, dst=/127.0.0.3:7012, ranges=[(30,10]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@1211eb11 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,925 StreamingRepairTask.java:84 - [streaming task #5b83ce80-39c5-11ef-b651-258387aac126] Performing asymmetric streaming repair of 1 ranges with /127.0.0.3:7012 INFO [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,930 StreamResultFuture.java:98 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Executing streaming plan for Repair INFO [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,931 StreamSession.java:396 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Starting streaming to 127.0.0.3:7012 DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,933 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,933 StreamingRepairTask.java:87 - [streaming task #5b83ce80-39c5-11ef-b651-258387aac126] Stream plan created in 8ms INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,937 StreamResultFuture.java:98 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Executing streaming plan for Repair INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,937 StreamSession.java:396 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Starting streaming to 127.0.0.3:7012 INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:07,937 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:57834)->/127.0.0.3:7012-STREAMING-81f46137 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,938 StreamingMultiplexedChannel.java:473 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 channel: f883ec9b] Scheduling keep-alive task with 300s period. DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,939 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:57834 channel.id f883ec9b DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,943 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator DEBUG [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,944 StreamSession.java:596 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Changing session state from INITIALIZED to PREPARING INFO [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,944 StreamCoordinator.java:268 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126, ID#0] Beginning stream session with /127.0.0.3:7012 INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:07,946 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:57848)->/127.0.0.3:7012-STREAMING-2d3e7f66 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,948 StreamingMultiplexedChannel.java:473 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 channel: 22bc7ea7] Scheduling keep-alive task with 300s period. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,949 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:57848 channel.id 22bc7ea7 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,954 StreamSession.java:596 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Changing session state from INITIALIZED to PREPARING INFO [node3_Stream-Deserializer-/127.0.0.1:7012-81f46137] node3 2024-07-04 05:22:07,954 StreamResultFuture.java:123 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 ID#0] Creating new streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:57834 channel.local /127.0.0.3:7012 channel.id 81f46137 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:07,954 StreamCoordinator.java:268 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050, ID#0] Beginning stream session with /127.0.0.3:7012 INFO [node1_RequestResponseStage-1] node1 2024-07-04 05:22:07,955 RepairMessage.java:259 - [#5b559290-39c5-11ef-b651-258387aac126] SYNC_REQ received by /127.0.0.2:7012 INFO [node3_Stream-Deserializer-/127.0.0.1:7012-81f46137] node3 2024-07-04 05:22:07,963 StreamResultFuture.java:131 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126, ID#0] Received streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:57834 channel.local /127.0.0.3:7012 channel.id 81f46137 INFO [node3_Stream-Deserializer-/127.0.0.2:7012-2d3e7f66] node3 2024-07-04 05:22:07,963 StreamResultFuture.java:123 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 ID#0] Creating new streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:57848 channel.local /127.0.0.3:7012 channel.id 2d3e7f66 INFO [node3_Stream-Deserializer-/127.0.0.2:7012-2d3e7f66] node3 2024-07-04 05:22:07,963 StreamResultFuture.java:131 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050, ID#0] Received streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:57848 channel.local /127.0.0.3:7012 channel.id 2d3e7f66 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-2d3e7f66] node3 2024-07-04 05:22:07,963 StreamDeserializingTask.java:132 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 channel: 2d3e7f66] Received StreamInitMessage: from = /127.0.0.2:7012, planId = 5b8fb560-39c5-11ef-a51d-eb1859d1d050, session index = 0 DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-81f46137] node3 2024-07-04 05:22:07,963 StreamDeserializingTask.java:132 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 channel: 81f46137] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 5b8ecb00-39c5-11ef-b651-258387aac126, session index = 0 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-2d3e7f66] node3 2024-07-04 05:22:07,964 StreamDeserializingTask.java:132 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 channel: 2d3e7f66] Received Prepare SYN (1 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-81f46137] node3 2024-07-04 05:22:07,964 StreamDeserializingTask.java:132 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 channel: 81f46137] Received Prepare SYN (1 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-2d3e7f66] node3 2024-07-04 05:22:07,965 StreamSession.java:596 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Changing session state from INITIALIZED to PREPARING DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-81f46137] node3 2024-07-04 05:22:07,965 StreamSession.java:596 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Changing session state from INITIALIZED to PREPARING DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,968 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,969 StreamResultFuture.java:187 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,973 StreamSession.java:596 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Changing session state from PREPARING to COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,973 StreamDeserializingTask.java:132 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 channel: 22bc7ea7] Received Prepare SYNACK ( 0 files} INFO [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,974 StreamResultFuture.java:187 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,975 CassandraStreamManager.java:129 - ViewFilter for 0/1 sstables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,975 StreamResultFuture.java:187 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,975 StreamSession.java:596 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Changing session state from PREPARING to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,975 StreamDeserializingTask.java:132 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 channel: f883ec9b] Received Prepare SYNACK ( 0 files} DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,976 StreamSession.java:596 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Changing session state from COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,976 StreamResultFuture.java:201 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Session with /127.0.0.2:7012 is complete INFO [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,976 StreamResultFuture.java:187 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,976 StreamSession.java:596 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Changing session state from PREPARING to STREAMING DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,976 StreamSession.java:596 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,977 StreamDeserializingTask.java:132 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050 channel: 22bc7ea7] Received Complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,977 StreamResultFuture.java:260 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] All sessions completed DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,977 StreamSession.java:1128 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] handling Complete message, state = WAIT_COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,977 StreamSession.java:596 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,977 StreamResultFuture.java:201 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Session with /127.0.0.3:7012 is complete DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,978 StreamSession.java:596 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Changing session state from COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,978 StreamResultFuture.java:201 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Session with /127.0.0.1:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:07,978 StreamResultFuture.java:260 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] All sessions completed DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,979 StreamSession.java:596 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Changing session state from PREPARING to STREAMING INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,979 StreamResultFuture.java:260 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] All sessions completed DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,979 StreamSession.java:596 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,979 StreamDeserializingTask.java:132 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126 channel: f883ec9b] Received Complete DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,979 StreamSession.java:1128 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] handling Complete message, state = WAIT_COMPLETE DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:07,980 StreamSession.java:596 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:07,980 StreamResultFuture.java:201 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Session with /127.0.0.3:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,980 StreamingRepairTask.java:121 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] streaming task succeed, returning response to /127.0.0.1:7012 INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:07,981 StreamResultFuture.java:260 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] All sessions completed DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:07,981 StreamSession.java:564 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Will close attached inbound {22bc7ea7=org.apache.cassandra.streaming.async.NettyStreamingChannel@72d5d7f2} and outbound {22bc7ea7=org.apache.cassandra.streaming.async.NettyStreamingChannel@72d5d7f2} channels INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:07,982 LocalSyncTask.java:168 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Sync complete using session 5b83ce80-39c5-11ef-b651-258387aac126 between /127.0.0.1:7012 and /127.0.0.3:7012 on x DEBUG [Streaming-EventLoop-4-1] node2 2024-07-04 05:22:07,982 StreamingMultiplexedChannel.java:514 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,982 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-22bc7ea7] node2 2024-07-04 05:22:07,982 StreamSession.java:712 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Socket closed after session completed with state COMPLETE DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:07,983 StreamSession.java:564 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Will close attached inbound {f883ec9b=org.apache.cassandra.streaming.async.NettyStreamingChannel@7520803c} and outbound {f883ec9b=org.apache.cassandra.streaming.async.NettyStreamingChannel@7520803c} channels DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:07,983 RepairSession.java:263 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Repair completed between /127.0.0.2:7012 and /127.0.0.3:7012 on x INFO [node1_RepairJobTask:3] node1 2024-07-04 05:22:07,983 RepairJob.java:210 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] tr.x is fully synced DEBUG [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:07,983 StreamingMultiplexedChannel.java:514 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Closing stream connection channels on /127.0.0.2:7012 DEBUG [Streaming-EventLoop-4-1] node1 2024-07-04 05:22:07,983 StreamingMultiplexedChannel.java:514 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:07,983 StreamingMultiplexedChannel.java:514 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-2d3e7f66] node3 2024-07-04 05:22:07,984 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-81f46137] node3 2024-07-04 05:22:07,984 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-2d3e7f66] node3 2024-07-04 05:22:07,984 StreamSession.java:712 - [Stream #5b8fb560-39c5-11ef-a51d-eb1859d1d050] Socket closed after session completed with state COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-81f46137] node3 2024-07-04 05:22:07,984 StreamSession.java:712 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Socket closed after session completed with state COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,985 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node1_RepairJobTask:4] node1 2024-07-04 05:22:07,985 RepairSession.java:355 - [repair #5b83ce80-39c5-11ef-b651-258387aac126] Session completed successfully DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-f883ec9b] node1 2024-07-04 05:22:07,986 StreamSession.java:712 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Socket closed after session completed with state COMPLETE INFO [node1_RepairJobTask:4] node1 2024-07-04 05:22:07,986 RepairCoordinator.java:191 - Repair session 5b83ce80-39c5-11ef-b651-258387aac126 for range [(30,10]] finished DEBUG [node1_RepairJobTask:4] node1 2024-07-04 05:22:07,986 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=5b83ce80-39c5-11ef-b651-258387aac126, keyspace='tr', ranges=[(30,10]], repairJobResults=[org.apache.cassandra.repair.RepairResult@741b4832], skippedReplicas=false}] INFO [node1_RepairJobTask:4] node1 2024-07-04 05:22:07,988 CoordinatorSession.java:242 - Proposing finalization of repair session 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node1_RepairJobTask:4] node1 2024-07-04 05:22:08,046 StreamSession.java:1379 - [Stream #5b8ecb00-39c5-11ef-b651-258387aac126] Stream session with peer /127.0.0.3:7012 is already in a final state on abort. INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,048 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.229KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,048 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.231KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,049 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 3.233KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:08,060 Flushing.java:153 - Writing Memtable-repairs@1139897217(475B serialized bytes, 4 ops, 3.229KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:08,060 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=78072) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:08,061 Flushing.java:153 - Writing Memtable-repairs@1227906160(475B serialized bytes, 4 ops, 3.233KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:08,061 Flushing.java:153 - Writing Memtable-repairs@591167556(475B serialized bytes, 4 ops, 3.231KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:08,062 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=97291) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:08,062 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db (188B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=79568) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:08,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.834KiB), biggest 5.834KiB, smallest 5.834KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:08,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.834KiB), biggest 5.834KiB, smallest 5.834KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:08,122 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db')] (1 sstables, 5.834KiB), biggest 5.834KiB, smallest 5.834KiB DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,123 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5b559290-39c5-11ef-b651-258387aac126, responded with FinalizePromise DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,123 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5b559290-39c5-11ef-b651-258387aac126, responded with FinalizePromise DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,123 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5b559290-39c5-11ef-b651-258387aac126, responded with FinalizePromise INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,124 CoordinatorSession.java:278 - Finalization proposal for repair session 5b559290-39c5-11ef-b651-258387aac126 accepted by all participants. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,124 CoordinatorSession.java:373 - Incremental repair 5b559290-39c5-11ef-b651-258387aac126 finalization phase completed in 0 seconds INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,124 CoordinatorSession.java:287 - Committing finalization of repair session 5b559290-39c5-11ef-b651-258387aac126 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,125 CoordinatorSessions.java:97 - Removing completed session 5b559290-39c5-11ef-b651-258387aac126 with state FINALIZED INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,125 CoordinatorSession.java:294 - Incremental repair session 5b559290-39c5-11ef-b651-258387aac126 completed DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,125 CoordinatorSession.java:376 - Incremental repair 5b559290-39c5-11ef-b651-258387aac126 phase completed in 0 seconds DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,129 LocalSessions.java:1010 - Finalized local repair session 5b559290-39c5-11ef-b651-258387aac126 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,129 RepairCoordinator.java:250 - [repair #5b559290-39c5-11ef-b651-258387aac126]Repair command #1 finished in 0 seconds DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,129 LocalSessions.java:1010 - Finalized local repair session 5b559290-39c5-11ef-b651-258387aac126 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,129 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070527559 and session id = 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,131 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,131 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 5b559290-39c5-11ef-b651-258387aac126 on tr.x DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,133 LocalSessions.java:1010 - Finalized local repair session 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,133 RepairMessageVerbHandler.java:290 - cleaning up repair INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,133 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070527559 and session id = 5b559290-39c5-11ef-b651-258387aac126 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,135 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 5b559290-39c5-11ef-b651-258387aac126 on tr.x INFO [node2_Repair-Task:1] node2 2024-07-04 05:22:08,219 RepairCoordinator.java:366 - Starting repair command #1 (5bbc43a0-39c5-11ef-a51d-eb1859d1d050), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,230 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000a]', ranges=[(10,20]], parentRepairSession=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, isIncremental=true, timestamp=1720070528229, isGlobal=true} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,230 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000a]', ranges=[(10,20]], parentRepairSession=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, isIncremental=true, timestamp=1720070528229, isGlobal=true} INFO [node2_RequestResponseStage-2] node2 2024-07-04 05:22:08,235 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node2_RequestResponseStage-2] node2 2024-07-04 05:22:08,235 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,237 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528229, ranges=[(10,20]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,237 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528229, ranges=[(10,20]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:08,238 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:41210)->/127.0.0.2:7012-SMALL_MESSAGES-723458b8 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:08,238 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:41210)->/127.0.0.2:7012-SMALL_MESSAGES-75aab36c messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node1 2024-07-04 05:22:08,238 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node1_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node1 2024-07-04 05:22:08,238 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node3 2024-07-04 05:22:08,238 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node3_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node3 2024-07-04 05:22:08,238 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node1 2024-07-04 05:22:08,238 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node3_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node3 2024-07-04 05:22:08,239 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node1_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node1 2024-07-04 05:22:08,239 LocalSessions.java:863 - Prepare phase for incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 completed INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,239 CompactionManager.java:928 - [repair #5bbc43a0-39c5-11ef-a51d-eb1859d1d050] Starting anticompaction for tr.x on 1/1 sstables DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,240 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, state=PREPARING, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528229, ranges=[(10,20]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,240 CompactionManager.java:994 - [repair #5bbc43a0-39c5-11ef-a51d-eb1859d1d050] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db') ([11,30]) will be anticompacted on range (10,20] INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,240 CompactionManager.java:1710 - Performing anticompaction on 1 sstables for 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node2_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node2 2024-07-04 05:22:08,241 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,241 CompactionManager.java:1760 - Anticompacting [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] in tr.x for 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node2_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node2 2024-07-04 05:22:08,241 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_Repair-5bbc43a0-39c5-11ef-a51d-eb1859d1d050:1] node2 2024-07-04 05:22:08,241 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,241 CompactionManager.java:928 - [repair #5bbc43a0-39c5-11ef-a51d-eb1859d1d050] Starting anticompaction for tr.x on 1/2 sstables INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,242 CompactionManager.java:987 - [repair #5bbc43a0-39c5-11ef-a51d-eb1859d1d050] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db') fully contained in range (10,20], mutating repairedAt instead of anticompacting DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,243 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,244 CompactionManager.java:948 - [repair #5bbc43a0-39c5-11ef-a51d-eb1859d1d050] Completed anticompaction successfully DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,244 LocalSessions.java:863 - Prepare phase for incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 completed DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,344 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,344 CompactionManager.java:1868 - Anticompacted [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')] in tr.x to full = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db')], transient = [], unrepaired = [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db')] for 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,344 CompactionManager.java:1734 - Anticompaction completed successfully, anticompacted from 1 to 2 sstable(s) for 5bbc43a0-39c5-11ef-a51d-eb1859d1d050. INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,344 CompactionManager.java:948 - [repair #5bbc43a0-39c5-11ef-a51d-eb1859d1d050] Completed anticompaction successfully DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,344 LocalSessions.java:863 - Prepare phase for incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,345 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-1-big INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,346 CoordinatorSession.java:225 - Incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 successfully prepared. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,347 CoordinatorSession.java:353 - Incremental repair 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 prepare phase completed in 0 seconds INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,347 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.3:7012, /127.0.0.1:7012], transEndpoints=[/127.0.0.1:7012], ranges=[(10,20]], hasSkippedReplicas=false} INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,350 RepairSession.java:297 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] parentSessionId = 5bbc43a0-39c5-11ef-a51d-eb1859d1d050: new session: will sync /127.0.0.2:7012, /127.0.0.3:7012, /127.0.0.1:7012 on range CommonRange{endpoints=[/127.0.0.3:7012, /127.0.0.1:7012], transEndpoints=[/127.0.0.1:7012], ranges=[(10,20]], hasSkippedReplicas=false} for tr.[x] INFO [node2_Repair#1:1] node2 2024-07-04 05:22:08,356 RepairJob.java:137 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] tr.x not running paxos repair INFO [node2_RepairJobTask:1] node2 2024-07-04 05:22:08,357 RepairJob.java:504 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Requesting merkle trees for x (to [/127.0.0.3:7012, /127.0.0.1:7012, /127.0.0.2:7012]) DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,359 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070528} org.apache.cassandra.repair.messages.ValidationRequest@66863180 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,359 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070528} org.apache.cassandra.repair.messages.ValidationRequest@66863180 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,359 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070528} org.apache.cassandra.repair.messages.ValidationRequest@66863180 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,359 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528229, ranges=[(10,20]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} to REPAIRING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,359 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528229, ranges=[(10,20]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} to REPAIRING DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,359 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5bbc43a0-39c5-11ef-a51d-eb1859d1d050, state=PREPARED, coordinator=/127.0.0.2:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528229, ranges=[(10,20]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} to REPAIRING INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,361 CassandraValidationIterator.java:215 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050], parentSessionId=5bbc43a0-39c5-11ef-a51d-eb1859d1d050: Performing validation compaction on 0 sstables in tr.x INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,361 CassandraValidationIterator.java:215 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050], parentSessionId=5bbc43a0-39c5-11ef-a51d-eb1859d1d050: Performing validation compaction on 1 sstables in tr.x INFO [node2_RequestResponseStage-2] node2 2024-07-04 05:22:08,361 RepairMessage.java:259 - [#5bbc43a0-39c5-11ef-a51d-eb1859d1d050] VALIDATION_REQ received by /127.0.0.3:7012 INFO [node2_RequestResponseStage-2] node2 2024-07-04 05:22:08,361 RepairMessage.java:259 - [#5bbc43a0-39c5-11ef-a51d-eb1859d1d050] VALIDATION_REQ received by /127.0.0.1:7012 INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,361 CassandraValidationIterator.java:215 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050], parentSessionId=5bbc43a0-39c5-11ef-a51d-eb1859d1d050: Performing validation compaction on 1 sstables in tr.x INFO [node2_RequestResponseStage-2] node2 2024-07-04 05:22:08,361 RepairMessage.java:259 - [#5bbc43a0-39c5-11ef-a51d-eb1859d1d050] VALIDATION_REQ received by /127.0.0.2:7012 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,362 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,362 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,362 Validator.java:158 - Prepared AEService trees of size 1 for [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050 on tr/x, [(10,20]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,362 Validator.java:229 - Validated 0 partitions for 5bd040d0-39c5-11ef-a51d-eb1859d1d050. Partitions per leaf are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,362 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,362 Validator.java:231 - Validated 0 partitions for 5bd040d0-39c5-11ef-a51d-eb1859d1d050. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,362 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,362 Validator.java:257 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Sending completed merkle tree to /127.0.0.2:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,362 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 1 msec, for [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050 on tr/x, [(10,20]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,363 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes WARN 05:22:08 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:08,364 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,364 RepairSession.java:242 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Received merkle tree for x from /127.0.0.1:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,366 Validator.java:158 - Prepared AEService trees of size 127 for [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050 on tr/x, [(10,20]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,369 Validator.java:229 - Validated 10 partitions for 5bd040d0-39c5-11ef-a51d-eb1859d1d050. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,369 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,369 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,369 Validator.java:231 - Validated 10 partitions for 5bd040d0-39c5-11ef-a51d-eb1859d1d050. Partition sizes are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,369 Validator.java:158 - Prepared AEService trees of size 127 for [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050 on tr/x, [(10,20]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,370 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,370 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,370 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,370 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,370 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,370 Validator.java:262 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Local completed merkle tree for /127.0.0.2:7012 for tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,370 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 9 msec, for [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050 on tr/x, [(10,20]]] INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,370 RepairSession.java:242 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Received merkle tree for x from /127.0.0.2:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,375 Validator.java:229 - Validated 10 partitions for 5bd040d0-39c5-11ef-a51d-eb1859d1d050. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,375 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,375 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,375 Validator.java:231 - Validated 10 partitions for 5bd040d0-39c5-11ef-a51d-eb1859d1d050. Partition sizes are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,376 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,376 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,376 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,376 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,376 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,376 Validator.java:257 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Sending completed merkle tree to /127.0.0.2:7012 for tr.x DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,376 ValidationManager.java:152 - Validation of 10 partitions (~113B) finished in 15 msec, for [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050 on tr/x, [(10,20]]] INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,379 RepairSession.java:242 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Received merkle tree for x from /127.0.0.3:7012 INFO [node2_RepairJobTask:2] node2 2024-07-04 05:22:08,380 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 (took: 1ms) INFO [node2_RepairJobTask:2] node2 2024-07-04 05:22:08,381 SyncTask.java:93 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Endpoints /127.0.0.3:7012 and /127.0.0.1:7012 have 1 range(s) out of sync for x INFO [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,381 SyncTask.java:93 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Endpoints /127.0.0.2:7012 and /127.0.0.1:7012 have 1 range(s) out of sync for x INFO [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,381 LocalSyncTask.java:118 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Performing streaming repair of 1 ranges with /127.0.0.1:7012 INFO [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,381 StreamResultFuture.java:98 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Executing streaming plan for Repair INFO [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,381 StreamSession.java:396 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Starting streaming to 127.0.0.1:7012 DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,381 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,382 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.2:7012, src=/127.0.0.3:7012, dst=/127.0.0.1:7012, ranges=[(10,20]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@59027bdc INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:08,384 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:39270)->/127.0.0.1:7012-STREAMING-7a348d8f streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,384 StreamingMultiplexedChannel.java:473 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 channel: 43e81226] Scheduling keep-alive task with 300s period. DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,384 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:39270 channel.id 43e81226 DEBUG [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,384 StreamSession.java:596 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Changing session state from INITIALIZED to PREPARING INFO [node1_Stream-Deserializer-/127.0.0.2:7012-7a348d8f] node1 2024-07-04 05:22:08,384 StreamResultFuture.java:123 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 ID#0] Creating new streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:39270 channel.local /127.0.0.1:7012 channel.id 7a348d8f INFO [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,385 StreamCoordinator.java:268 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050, ID#0] Beginning stream session with /127.0.0.1:7012 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,385 StreamingRepairTask.java:84 - [streaming task #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Performing asymmetric streaming repair of 1 ranges with /127.0.0.1:7012 INFO [node1_Stream-Deserializer-/127.0.0.2:7012-7a348d8f] node1 2024-07-04 05:22:08,385 StreamResultFuture.java:131 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050, ID#0] Received streaming plan for Repair from /127.0.0.2:7012 channel.remote /127.0.0.1:39270 channel.local /127.0.0.1:7012 channel.id 7a348d8f DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-7a348d8f] node1 2024-07-04 05:22:08,385 StreamDeserializingTask.java:132 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 channel: 7a348d8f] Received StreamInitMessage: from = /127.0.0.2:7012, planId = 5bd522d0-39c5-11ef-a51d-eb1859d1d050, session index = 0 DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-7a348d8f] node1 2024-07-04 05:22:08,385 StreamDeserializingTask.java:132 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 channel: 7a348d8f] Received Prepare SYN (1 requests, 0 files} DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-7a348d8f] node1 2024-07-04 05:22:08,385 StreamSession.java:596 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Changing session state from INITIALIZED to PREPARING INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,387 StreamingRepairTask.java:87 - [streaming task #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Stream plan created in 2ms DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,387 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,387 StreamResultFuture.java:187 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,388 StreamResultFuture.java:98 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Executing streaming plan for Repair INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,388 StreamSession.java:396 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Starting streaming to 127.0.0.1:7012 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,388 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.1:7012 as initiator DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,388 StreamSession.java:596 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Changing session state from PREPARING to COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,388 StreamDeserializingTask.java:132 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 channel: 43e81226] Received Prepare SYNACK ( 0 files} INFO [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,388 StreamResultFuture.java:187 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,388 StreamSession.java:596 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Changing session state from COMPLETE to COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,388 StreamSession.java:596 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Changing session state from PREPARING to STREAMING INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,388 StreamResultFuture.java:201 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Session with /127.0.0.2:7012 is complete DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,388 StreamSession.java:596 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Changing session state from STREAMING to WAIT_COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,388 StreamResultFuture.java:260 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] All sessions completed DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,389 StreamDeserializingTask.java:132 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050 channel: 43e81226] Received Complete DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,389 StreamSession.java:1128 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] handling Complete message, state = WAIT_COMPLETE DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,389 StreamSession.java:596 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,389 StreamResultFuture.java:201 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Session with /127.0.0.1:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,389 StreamResultFuture.java:260 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] All sessions completed INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,389 LocalSyncTask.java:168 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Sync complete using session 5bd040d0-39c5-11ef-a51d-eb1859d1d050 between /127.0.0.2:7012 and /127.0.0.1:7012 on x DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,389 StreamSession.java:564 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Will close attached inbound {43e81226=org.apache.cassandra.streaming.async.NettyStreamingChannel@221aebcd} and outbound {43e81226=org.apache.cassandra.streaming.async.NettyStreamingChannel@221aebcd} channels DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,389 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-43e81226] node2 2024-07-04 05:22:08,389 StreamSession.java:712 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-2] node2 2024-07-04 05:22:08,389 StreamingMultiplexedChannel.java:514 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:08,390 StreamingMultiplexedChannel.java:514 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-7a348d8f] node1 2024-07-04 05:22:08,390 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-7a348d8f] node1 2024-07-04 05:22:08,390 StreamSession.java:712 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Socket closed after session completed with state COMPLETE INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:08,391 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:39286)->/127.0.0.1:7012-STREAMING-0940e6f8 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,392 StreamingMultiplexedChannel.java:473 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 channel: 6a40a4f1] Scheduling keep-alive task with 300s period. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,393 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.1/127.0.0.1:7012 channel.local /127.0.0.1:39286 channel.id 6a40a4f1 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,393 StreamSession.java:596 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from INITIALIZED to PREPARING INFO [node1_Stream-Deserializer-/127.0.0.3:7012-0940e6f8] node1 2024-07-04 05:22:08,393 StreamResultFuture.java:123 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 ID#0] Creating new streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:39286 channel.local /127.0.0.1:7012 channel.id 0940e6f8 INFO [node1_Stream-Deserializer-/127.0.0.3:7012-0940e6f8] node1 2024-07-04 05:22:08,393 StreamResultFuture.java:131 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833, ID#0] Received streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:39286 channel.local /127.0.0.1:7012 channel.id 0940e6f8 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-0940e6f8] node1 2024-07-04 05:22:08,393 StreamDeserializingTask.java:132 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 channel: 0940e6f8] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833, session index = 0 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,394 StreamCoordinator.java:268 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833, ID#0] Beginning stream session with /127.0.0.1:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-0940e6f8] node1 2024-07-04 05:22:08,394 StreamDeserializingTask.java:132 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 channel: 0940e6f8] Received Prepare SYN (1 requests, 0 files} DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-0940e6f8] node1 2024-07-04 05:22:08,394 StreamSession.java:596 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from INITIALIZED to PREPARING INFO [node2_RequestResponseStage-1] node2 2024-07-04 05:22:08,394 RepairMessage.java:259 - [#5bbc43a0-39c5-11ef-a51d-eb1859d1d050] SYNC_REQ received by /127.0.0.3:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,395 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,395 StreamResultFuture.java:187 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,395 StreamSession.java:596 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,395 StreamDeserializingTask.java:132 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 channel: 6a40a4f1] Received Prepare SYNACK ( 0 files} INFO [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,395 StreamResultFuture.java:187 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,395 StreamSession.java:596 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from COMPLETE to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,396 StreamSession.java:596 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from PREPARING to STREAMING INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,395 StreamResultFuture.java:201 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Session with /127.0.0.3:7012 is complete DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,396 StreamSession.java:596 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from STREAMING to WAIT_COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,396 StreamResultFuture.java:260 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] All sessions completed DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,396 StreamDeserializingTask.java:132 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833 channel: 6a40a4f1] Received Complete DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,396 StreamSession.java:1128 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] handling Complete message, state = WAIT_COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,396 StreamSession.java:596 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,396 StreamResultFuture.java:201 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Session with /127.0.0.1:7012 is complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,396 StreamResultFuture.java:260 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] All sessions completed INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,396 StreamingRepairTask.java:121 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] streaming task succeed, returning response to /127.0.0.2:7012 DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,398 StreamSession.java:564 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Will close attached inbound {6a40a4f1=org.apache.cassandra.streaming.async.NettyStreamingChannel@3f164ce6} and outbound {6a40a4f1=org.apache.cassandra.streaming.async.NettyStreamingChannel@3f164ce6} channels DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,398 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.1:7012-6a40a4f1] node3 2024-07-04 05:22:08,398 StreamSession.java:712 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Socket closed after session completed with state COMPLETE DEBUG [Streaming-EventLoop-4-1] node3 2024-07-04 05:22:08,399 StreamingMultiplexedChannel.java:514 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,399 RepairSession.java:263 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Repair completed between /127.0.0.3:7012 and /127.0.0.1:7012 on x INFO [node2_RepairJobTask:3] node2 2024-07-04 05:22:08,399 RepairJob.java:210 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] tr.x is fully synced DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:08,399 StreamingMultiplexedChannel.java:514 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-0940e6f8] node1 2024-07-04 05:22:08,399 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.3:7012-0940e6f8] node1 2024-07-04 05:22:08,399 StreamSession.java:712 - [Stream #5bd5bf10-39c5-11ef-a1c9-4b8e7a2da833] Socket closed after session completed with state COMPLETE INFO [node2_RepairJobTask:2] node2 2024-07-04 05:22:08,402 RepairSession.java:355 - [repair #5bd040d0-39c5-11ef-a51d-eb1859d1d050] Session completed successfully INFO [node2_RepairJobTask:2] node2 2024-07-04 05:22:08,402 RepairCoordinator.java:191 - Repair session 5bd040d0-39c5-11ef-a51d-eb1859d1d050 for range [(10,20]] finished DEBUG [node2_RepairJobTask:2] node2 2024-07-04 05:22:08,402 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=5bd040d0-39c5-11ef-a51d-eb1859d1d050, keyspace='tr', ranges=[(10,20]], repairJobResults=[org.apache.cassandra.repair.RepairResult@7fea9a60], skippedReplicas=false}] INFO [node2_RepairJobTask:2] node2 2024-07-04 05:22:08,403 CoordinatorSession.java:242 - Proposing finalization of repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node2_RepairJobTask:2] node2 2024-07-04 05:22:08,404 StreamSession.java:1379 - [Stream #5bd522d0-39c5-11ef-a51d-eb1859d1d050] Stream session with peer /127.0.0.1:7012 is already in a final state on abort. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,405 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.117KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,405 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.121KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,406 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.113KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:08,414 Flushing.java:153 - Writing Memtable-repairs@535241165(950B serialized bytes, 5 ops, 6.117KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:08,415 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=99986) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:08,416 Flushing.java:153 - Writing Memtable-repairs@585891895(950B serialized bytes, 5 ops, 6.121KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:08,416 Flushing.java:153 - Writing Memtable-repairs@1695695243(950B serialized bytes, 5 ops, 6.113KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:08,417 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=82263) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:08,417 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=80912) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:08,493 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.930KiB), biggest 5.930KiB, smallest 5.930KiB DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:08,493 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.930KiB), biggest 5.930KiB, smallest 5.930KiB DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:08,493 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db')] (1 sstables, 5.930KiB), biggest 5.930KiB, smallest 5.930KiB DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,494 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050, responded with FinalizePromise DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,494 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050, responded with FinalizePromise DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,494 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050, responded with FinalizePromise INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,494 CoordinatorSession.java:278 - Finalization proposal for repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 accepted by all participants. DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,494 CoordinatorSession.java:373 - Incremental repair 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 finalization phase completed in 0 seconds INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,495 CoordinatorSession.java:287 - Committing finalization of repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,495 CoordinatorSessions.java:97 - Removing completed session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 with state FINALIZED INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,495 CoordinatorSession.java:294 - Incremental repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 completed DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,495 CoordinatorSession.java:376 - Incremental repair 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 phase completed in 0 seconds DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,496 LocalSessions.java:1010 - Finalized local repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,497 LocalSessions.java:1010 - Finalized local repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,497 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db')] from pending to repaired with repaired at = 1720070528229 and session id = 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,499 RepairCoordinator.java:250 - [repair #5bbc43a0-39c5-11ef-a51d-eb1859d1d050]Repair command #1 finished in 0 seconds DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,499 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 on tr.x DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,500 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,501 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,501 LocalSessions.java:1010 - Finalized local repair session 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,501 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070528229 and session id = 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:08,503 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 5bbc43a0-39c5-11ef-a51d-eb1859d1d050 on tr.x INFO [node3_Repair-Task:1] node3 2024-07-04 05:22:08,581 RepairCoordinator.java:366 - Starting repair command #1 (5bf38040-39c5-11ef-a1c9-4b8e7a2da833), repairing keyspace tr with repair options (parallelism: parallel, primary range: true, incremental: true, job threads: 1, ColumnFamilies: [], dataCenters: [], hosts: [], previewKind: NONE, # of ranges: 1, pull repair: false, force repair: false, optimise streams: false, ignore unreplicated keyspaces: false, repairPaxos: true, paxosOnly: false) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,591 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000a]', ranges=[(20,30]], parentRepairSession=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, isIncremental=true, timestamp=1720070528590, isGlobal=true} DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,591 RepairMessageVerbHandler.java:98 - Preparing, PrepareMessage{tableIds='[1b255f4d-ef25-40a6-0000-00000000000a]', ranges=[(20,30]], parentRepairSession=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, isIncremental=true, timestamp=1720070528590, isGlobal=true} INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:22:08,596 CoordinatorSession.java:344 - Beginning coordination of incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:22:08,596 CoordinatorSession.java:180 - Beginning prepare phase of incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,598 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528590, ranges=[(20,30]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,598 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528590, ranges=[(20,30]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} DEBUG [node1_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node1 2024-07-04 05:22:08,599 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node1_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node1 2024-07-04 05:22:08,599 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node1_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node1 2024-07-04 05:22:08,599 ColumnFamilyStore.java:2899 - Resuming compactions for x DEBUG [node2_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node2 2024-07-04 05:22:08,599 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node2_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node2 2024-07-04 05:22:08,599 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,599 CompactionManager.java:928 - [repair #5bf38040-39c5-11ef-a1c9-4b8e7a2da833] Starting anticompaction for tr.x on 1/2 sstables DEBUG [node2_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node2 2024-07-04 05:22:08,599 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,599 CompactionManager.java:987 - [repair #5bf38040-39c5-11ef-a1c9-4b8e7a2da833] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db') fully contained in range (20,30], mutating repairedAt instead of anticompacting DEBUG [node2_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node2 2024-07-04 05:22:08,599 LocalSessions.java:863 - Prepare phase for incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 completed INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:08,600 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:57862)->/127.0.0.3:7012-SMALL_MESSAGES-0dceafe9 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:08,600 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:57862)->/127.0.0.3:7012-SMALL_MESSAGES-76d57c2b messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,601 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,602 CompactionManager.java:948 - [repair #5bf38040-39c5-11ef-a1c9-4b8e7a2da833] Completed anticompaction successfully DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,601 LocalSessions.java:848 - Beginning local incremental repair session LocalSession{sessionID=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, state=PREPARING, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528590, ranges=[(20,30]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,602 LocalSessions.java:863 - Prepare phase for incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 completed DEBUG [node3_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node3 2024-07-04 05:22:08,602 PendingAntiCompaction.java:224 - acquiring sstables for pending anti compaction on session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node3_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node3 2024-07-04 05:22:08,602 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_Repair-5bf38040-39c5-11ef-a1c9-4b8e7a2da833:1] node3 2024-07-04 05:22:08,603 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,603 CompactionManager.java:928 - [repair #5bf38040-39c5-11ef-a1c9-4b8e7a2da833] Starting anticompaction for tr.x on 1/2 sstables INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,603 CompactionManager.java:987 - [repair #5bf38040-39c5-11ef-a1c9-4b8e7a2da833] SSTable BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db') fully contained in range (20,30], mutating repairedAt instead of anticompacting DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,605 PendingRepairManager.java:118 - Creating tr.x compaction strategy for pending repair: 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,605 CompactionManager.java:948 - [repair #5bf38040-39c5-11ef-a1c9-4b8e7a2da833] Completed anticompaction successfully DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,605 LocalSessions.java:863 - Prepare phase for incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 completed INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,607 CoordinatorSession.java:225 - Incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 successfully prepared. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,608 CoordinatorSession.java:353 - Incremental repair 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 prepare phase completed in 0 seconds INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,608 AbstractRepairTask.java:68 - Starting RepairSession for CommonRange{endpoints=[/127.0.0.1:7012, /127.0.0.2:7012], transEndpoints=[/127.0.0.2:7012], ranges=[(20,30]], hasSkippedReplicas=false} INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,610 RepairSession.java:297 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] parentSessionId = 5bf38040-39c5-11ef-a1c9-4b8e7a2da833: new session: will sync /127.0.0.3:7012, /127.0.0.1:7012, /127.0.0.2:7012 on range CommonRange{endpoints=[/127.0.0.1:7012, /127.0.0.2:7012], transEndpoints=[/127.0.0.2:7012], ranges=[(20,30]], hasSkippedReplicas=false} for tr.[x] INFO [node3_Repair#1:1] node3 2024-07-04 05:22:08,616 RepairJob.java:137 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] tr.x not running paxos repair INFO [node3_RepairJobTask:1] node3 2024-07-04 05:22:08,617 RepairJob.java:504 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Requesting merkle trees for x (to [/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012]) DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,619 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070528} org.apache.cassandra.repair.messages.ValidationRequest@66863180 DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,619 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070528} org.apache.cassandra.repair.messages.ValidationRequest@66863180 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,619 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528590, ranges=[(20,30]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} to REPAIRING DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,619 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528590, ranges=[(20,30]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} to REPAIRING DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,621 RepairMessageVerbHandler.java:182 - Validating ValidationRequest{nowInSec=1720070528} org.apache.cassandra.repair.messages.ValidationRequest@66863180 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,621 LocalSessions.java:929 - Setting local incremental repair session LocalSession{sessionID=5bf38040-39c5-11ef-a1c9-4b8e7a2da833, state=PREPARED, coordinator=/127.0.0.3:7012, tableIds=[1b255f4d-ef25-40a6-0000-00000000000a], repairedAt=1720070528590, ranges=[(20,30]], participants=[/127.0.0.1:7012, /127.0.0.2:7012, /127.0.0.3:7012], startedAt=1720070528, lastUpdate=1720070528} to REPAIRING INFO [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,621 CassandraValidationIterator.java:215 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833], parentSessionId=5bf38040-39c5-11ef-a1c9-4b8e7a2da833: Performing validation compaction on 1 sstables in tr.x INFO [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,621 CassandraValidationIterator.java:215 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833], parentSessionId=5bf38040-39c5-11ef-a1c9-4b8e7a2da833: Performing validation compaction on 1 sstables in tr.x INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:22:08,622 RepairMessage.java:259 - [#5bf38040-39c5-11ef-a1c9-4b8e7a2da833] VALIDATION_REQ received by /127.0.0.3:7012 INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:22:08,622 RepairMessage.java:259 - [#5bf38040-39c5-11ef-a1c9-4b8e7a2da833] VALIDATION_REQ received by /127.0.0.1:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,622 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,622 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 128 partitions, 88 bytes INFO [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,623 CassandraValidationIterator.java:215 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833], parentSessionId=5bf38040-39c5-11ef-a1c9-4b8e7a2da833: Performing validation compaction on 0 sstables in tr.x INFO [node3_RequestResponseStage-2] node3 2024-07-04 05:22:08,623 RepairMessage.java:259 - [#5bf38040-39c5-11ef-a1c9-4b8e7a2da833] VALIDATION_REQ received by /127.0.0.2:7012 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,624 ValidationManager.java:84 - Created 1 merkle trees with merkle trees size 1, 0 partitions, 88 bytes DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,624 Validator.java:158 - Prepared AEService trees of size 1 for [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833 on tr/x, [(20,30]]] DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,624 Validator.java:229 - Validated 0 partitions for 5bf81420-39c5-11ef-a1c9-4b8e7a2da833. Partitions per leaf are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,624 EstimatedHistogram.java:337 - [0..0]: 1 DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,624 Validator.java:231 - Validated 0 partitions for 5bf81420-39c5-11ef-a1c9-4b8e7a2da833. Partition sizes are: DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,624 EstimatedHistogram.java:337 - [0..0]: 1 INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,624 Validator.java:257 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Sending completed merkle tree to /127.0.0.3:7012 for tr.x DEBUG [node2_ValidationExecutor:1] node2 2024-07-04 05:22:08,624 ValidationManager.java:152 - Validation of 0 partitions (~0B) finished in 1 msec, for [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833 on tr/x, [(20,30]]] DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,625 Validator.java:158 - Prepared AEService trees of size 127 for [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833 on tr/x, [(20,30]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,626 Validator.java:158 - Prepared AEService trees of size 127 for [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833 on tr/x, [(20,30]]] WARN 05:22:08 Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. WARN [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:08,626 MerkleTree.java:739 - Configuration requests off-heap merkle trees, but partitioner does not support it. Ignoring. INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,626 RepairSession.java:242 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Received merkle tree for x from /127.0.0.2:7012 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,627 Validator.java:229 - Validated 10 partitions for 5bf81420-39c5-11ef-a1c9-4b8e7a2da833. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 Validator.java:231 - Validated 10 partitions for 5bf81420-39c5-11ef-a1c9-4b8e7a2da833. Partition sizes are: DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,628 Validator.java:229 - Validated 10 partitions for 5bf81420-39c5-11ef-a1c9-4b8e7a2da833. Partitions per leaf are: DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,628 Validator.java:262 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Local completed merkle tree for /127.0.0.3:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [0..0]: 121 DEBUG [node3_ValidationExecutor:1] node3 2024-07-04 05:22:08,628 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 7 msec, for [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833 on tr/x, [(20,30]]] DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,628 EstimatedHistogram.java:337 - [1..4]: 6 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,628 Validator.java:231 - Validated 10 partitions for 5bf81420-39c5-11ef-a1c9-4b8e7a2da833. Partition sizes are: INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,629 RepairSession.java:242 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Received merkle tree for x from /127.0.0.3:7012 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,629 EstimatedHistogram.java:337 - [0..4]: 121 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,629 EstimatedHistogram.java:337 - [5..24]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,629 EstimatedHistogram.java:337 - [25..44]: 0 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,629 EstimatedHistogram.java:337 - [45..64]: 4 DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,629 EstimatedHistogram.java:337 - [65..196]: 2 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,629 Validator.java:257 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Sending completed merkle tree to /127.0.0.3:7012 for tr.x DEBUG [node1_ValidationExecutor:1] node1 2024-07-04 05:22:08,629 ValidationManager.java:152 - Validation of 10 partitions (~120B) finished in 8 msec, for [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833 on tr/x, [(20,30]]] INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,632 RepairSession.java:242 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Received merkle tree for x from /127.0.0.1:7012 INFO [node3_RepairJobTask:3] node3 2024-07-04 05:22:08,633 RepairJob.java:364 - Created 2 sync tasks based on 3 merkle tree responses for 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 (took: 1ms) INFO [node3_RepairJobTask:3] node3 2024-07-04 05:22:08,634 SyncTask.java:93 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Endpoints /127.0.0.1:7012 and /127.0.0.2:7012 have 1 range(s) out of sync for x INFO [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,634 SyncTask.java:93 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Endpoints /127.0.0.3:7012 and /127.0.0.2:7012 have 1 range(s) out of sync for x INFO [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,634 LocalSyncTask.java:118 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Performing streaming repair of 1 ranges with /127.0.0.2:7012 INFO [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,634 StreamResultFuture.java:98 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Executing streaming plan for Repair INFO [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,634 StreamSession.java:396 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Starting streaming to 127.0.0.2:7012 DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,634 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,635 RepairMessageVerbHandler.java:261 - Syncing SyncRequest{initiator=/127.0.0.3:7012, src=/127.0.0.1:7012, dst=/127.0.0.2:7012, ranges=[(20,30]], previewKind=NONE, asymmetric=true} org.apache.cassandra.repair.messages.SyncRequest@d8ec48b4 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,637 StreamingRepairTask.java:84 - [streaming task #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Performing asymmetric streaming repair of 1 ranges with /127.0.0.2:7012 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,637 StreamingRepairTask.java:87 - [streaming task #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Stream plan created in 0ms INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:08,637 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:41222)->/127.0.0.2:7012-STREAMING-8195f82f streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,637 StreamingMultiplexedChannel.java:473 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 channel: 045b9b4d] Scheduling keep-alive task with 300s period. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,637 StreamResultFuture.java:98 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Executing streaming plan for Repair DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,637 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:41222 channel.id 045b9b4d INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,637 StreamSession.java:396 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Starting streaming to 127.0.0.2:7012 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,637 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator DEBUG [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,638 StreamSession.java:596 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from INITIALIZED to PREPARING INFO [node2_Stream-Deserializer-/127.0.0.3:7012-8195f82f] node2 2024-07-04 05:22:08,638 StreamResultFuture.java:123 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 ID#0] Creating new streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:41222 channel.local /127.0.0.2:7012 channel.id 8195f82f INFO [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,638 StreamCoordinator.java:268 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node2_Stream-Deserializer-/127.0.0.3:7012-8195f82f] node2 2024-07-04 05:22:08,638 StreamResultFuture.java:131 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833, ID#0] Received streaming plan for Repair from /127.0.0.3:7012 channel.remote /127.0.0.1:41222 channel.local /127.0.0.2:7012 channel.id 8195f82f DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-8195f82f] node2 2024-07-04 05:22:08,638 StreamDeserializingTask.java:132 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 channel: 8195f82f] Received StreamInitMessage: from = /127.0.0.3:7012, planId = 5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833, session index = 0 DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-8195f82f] node2 2024-07-04 05:22:08,639 StreamDeserializingTask.java:132 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 channel: 8195f82f] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-8195f82f] node2 2024-07-04 05:22:08,639 StreamSession.java:596 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from INITIALIZED to PREPARING INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:08,640 InboundConnectionInitiator.java:450 - /127.0.0.1:7012(/127.0.0.1:41232)->/127.0.0.2:7012-STREAMING-96aecaeb streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,640 StreamingMultiplexedChannel.java:473 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 channel: dad532bd] Scheduling keep-alive task with 300s period. DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,640 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:41232 channel.id dad532bd DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,641 StreamSession.java:596 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Changing session state from INITIALIZED to PREPARING INFO [node2_Stream-Deserializer-/127.0.0.1:7012-96aecaeb] node2 2024-07-04 05:22:08,641 StreamResultFuture.java:123 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 ID#0] Creating new streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:41232 channel.local /127.0.0.2:7012 channel.id 96aecaeb DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,641 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node2_Stream-Deserializer-/127.0.0.1:7012-96aecaeb] node2 2024-07-04 05:22:08,641 StreamResultFuture.java:131 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126, ID#0] Received streaming plan for Repair from /127.0.0.1:7012 channel.remote /127.0.0.1:41232 channel.local /127.0.0.2:7012 channel.id 96aecaeb DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-96aecaeb] node2 2024-07-04 05:22:08,641 StreamDeserializingTask.java:132 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 channel: 96aecaeb] Received StreamInitMessage: from = /127.0.0.1:7012, planId = 5bfc32d0-39c5-11ef-b651-258387aac126, session index = 0 INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,641 StreamCoordinator.java:268 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126, ID#0] Beginning stream session with /127.0.0.2:7012 INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,641 StreamResultFuture.java:187 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-96aecaeb] node2 2024-07-04 05:22:08,641 StreamDeserializingTask.java:132 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 channel: 96aecaeb] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-96aecaeb] node2 2024-07-04 05:22:08,641 StreamSession.java:596 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Changing session state from INITIALIZED to PREPARING DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,642 StreamSession.java:596 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,642 StreamDeserializingTask.java:132 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 channel: 045b9b4d] Received Prepare SYNACK ( 0 files} INFO [node3_RequestResponseStage-1] node3 2024-07-04 05:22:08,642 RepairMessage.java:259 - [#5bf38040-39c5-11ef-a1c9-4b8e7a2da833] SYNC_REQ received by /127.0.0.1:7012 INFO [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,642 StreamResultFuture.java:187 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,642 StreamSession.java:596 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,642 StreamSession.java:596 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,642 StreamDeserializingTask.java:132 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833 channel: 045b9b4d] Received Complete DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,642 StreamSession.java:1128 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] handling Complete message, state = WAIT_COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,642 StreamSession.java:596 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,642 StreamResultFuture.java:201 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Session with /127.0.0.2:7012 is complete DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,642 CassandraStreamManager.java:129 - ViewFilter for 0/2 sstables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,642 StreamResultFuture.java:260 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] All sessions completed INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,643 StreamResultFuture.java:187 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,643 LocalSyncTask.java:168 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Sync complete using session 5bf81420-39c5-11ef-a1c9-4b8e7a2da833 between /127.0.0.3:7012 and /127.0.0.2:7012 on x DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:08,643 StreamSession.java:564 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Will close attached inbound {045b9b4d=org.apache.cassandra.streaming.async.NettyStreamingChannel@76e4cccd} and outbound {045b9b4d=org.apache.cassandra.streaming.async.NettyStreamingChannel@76e4cccd} channels DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,643 StreamSession.java:596 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Changing session state from PREPARING to COMPLETE DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,643 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,643 StreamDeserializingTask.java:132 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 channel: dad532bd] Received Prepare SYNACK ( 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.2:7012-045b9b4d] node3 2024-07-04 05:22:08,643 StreamSession.java:712 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Socket closed after session completed with state COMPLETE INFO [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,643 StreamResultFuture.java:187 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 ID#0] Prepare completed. Receiving 0 files(0B), sending 0 files(0B) DEBUG [Streaming-EventLoop-4-2] node3 2024-07-04 05:22:08,643 StreamingMultiplexedChannel.java:514 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,643 StreamSession.java:596 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Changing session state from PREPARING to STREAMING DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,643 StreamSession.java:596 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Changing session state from COMPLETE to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,643 StreamSession.java:596 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Changing session state from STREAMING to WAIT_COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,643 StreamResultFuture.java:201 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Session with /127.0.0.3:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,643 StreamResultFuture.java:260 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] All sessions completed DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,644 StreamSession.java:596 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Changing session state from COMPLETE to COMPLETE DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,644 StreamDeserializingTask.java:132 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126 channel: dad532bd] Received Complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,644 StreamResultFuture.java:201 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Session with /127.0.0.1:7012 is complete DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,644 StreamSession.java:1128 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] handling Complete message, state = WAIT_COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:08,644 StreamResultFuture.java:260 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] All sessions completed DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,644 StreamSession.java:596 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,644 StreamResultFuture.java:201 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Session with /127.0.0.2:7012 is complete INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,644 StreamResultFuture.java:260 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] All sessions completed INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,644 StreamingRepairTask.java:121 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] streaming task succeed, returning response to /127.0.0.3:7012 DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:08,644 StreamingMultiplexedChannel.java:514 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:08,644 StreamSession.java:564 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Will close attached inbound {dad532bd=org.apache.cassandra.streaming.async.NettyStreamingChannel@5fe27cba} and outbound {dad532bd=org.apache.cassandra.streaming.async.NettyStreamingChannel@5fe27cba} channels DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,644 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_Stream-Deserializer-/127.0.0.2:7012-dad532bd] node1 2024-07-04 05:22:08,644 StreamSession.java:712 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Socket closed after session completed with state COMPLETE DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-8195f82f] node2 2024-07-04 05:22:08,644 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [Streaming-EventLoop-4-2] node1 2024-07-04 05:22:08,644 StreamingMultiplexedChannel.java:514 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.3:7012-8195f82f] node2 2024-07-04 05:22:08,645 StreamSession.java:712 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Socket closed after session completed with state COMPLETE DEBUG [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:08,645 StreamingMultiplexedChannel.java:514 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Closing stream connection channels on /127.0.0.1:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-96aecaeb] node2 2024-07-04 05:22:08,645 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.1:7012-96aecaeb] node2 2024-07-04 05:22:08,645 StreamSession.java:712 - [Stream #5bfc32d0-39c5-11ef-b651-258387aac126] Socket closed after session completed with state COMPLETE DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,645 RepairSession.java:263 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Repair completed between /127.0.0.1:7012 and /127.0.0.2:7012 on x INFO [node3_RepairJobTask:4] node3 2024-07-04 05:22:08,645 RepairJob.java:210 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] tr.x is fully synced INFO [node3_RepairJobTask:3] node3 2024-07-04 05:22:08,648 RepairSession.java:355 - [repair #5bf81420-39c5-11ef-a1c9-4b8e7a2da833] Session completed successfully INFO [node3_RepairJobTask:3] node3 2024-07-04 05:22:08,648 RepairCoordinator.java:191 - Repair session 5bf81420-39c5-11ef-a1c9-4b8e7a2da833 for range [(20,30]] finished DEBUG [node3_RepairJobTask:3] node3 2024-07-04 05:22:08,648 AbstractRepairTask.java:101 - Repair result: [RepairSessionResult{sessionId=5bf81420-39c5-11ef-a1c9-4b8e7a2da833, keyspace='tr', ranges=[(20,30]], repairJobResults=[org.apache.cassandra.repair.RepairResult@7b93d5d0], skippedReplicas=false}] INFO [node3_RepairJobTask:3] node3 2024-07-04 05:22:08,649 CoordinatorSession.java:242 - Proposing finalization of repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node3_RepairJobTask:3] node3 2024-07-04 05:22:08,650 StreamSession.java:1379 - [Stream #5bfbbda0-39c5-11ef-a1c9-4b8e7a2da833] Stream session with peer /127.0.0.2:7012 is already in a final state on abort. INFO [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,651 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.117KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,651 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.121KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,651 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: INTERNALLY_FORCED, Usage: 6.113KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:08,665 Flushing.java:153 - Writing Memtable-repairs@1987675218(950B serialized bytes, 5 ops, 6.117KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:08,665 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070512245, position=102681) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:08,672 Flushing.java:153 - Writing Memtable-repairs@1553168744(950B serialized bytes, 5 ops, 6.121KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:08,672 Flushing.java:153 - Writing Memtable-repairs@1712315310(950B serialized bytes, 5 ops, 6.113KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:08,673 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=84958) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:08,673 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db (366B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=83607) DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:08,762 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.923KiB), biggest 5.923KiB, smallest 5.923KiB DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:08,762 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.923KiB), biggest 5.923KiB, smallest 5.923KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:08,762 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db')] (1 sstables, 5.923KiB), biggest 5.923KiB, smallest 5.923KiB DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,762 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833, responded with FinalizePromise DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,763 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833, responded with FinalizePromise DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,763 LocalSessions.java:965 - Received FinalizePropose message for incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833, responded with FinalizePromise INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,763 CoordinatorSession.java:278 - Finalization proposal for repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 accepted by all participants. DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,763 CoordinatorSession.java:373 - Incremental repair 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 finalization phase completed in 0 seconds INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,764 CoordinatorSession.java:287 - Committing finalization of repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,764 CoordinatorSessions.java:97 - Removing completed session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 with state FINALIZED INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,764 CoordinatorSession.java:294 - Incremental repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 completed DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,764 CoordinatorSession.java:376 - Incremental repair 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 phase completed in 0 seconds DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,765 LocalSessions.java:1010 - Finalized local repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,766 LocalSessions.java:1010 - Finalized local repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,766 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070528590 and session id = 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:08,767 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 on tr.x INFO [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,768 RepairCoordinator.java:250 - [repair #5bf38040-39c5-11ef-a1c9-4b8e7a2da833]Repair command #1 finished in 0 seconds DEBUG [node1_AntiEntropyStage:1] node1 2024-07-04 05:22:08,769 RepairMessageVerbHandler.java:290 - cleaning up repair DEBUG [node3_AntiEntropyStage:1] node3 2024-07-04 05:22:08,770 LocalSessions.java:1010 - Finalized local repair session 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,770 PendingRepairManager.java:530 - Moving [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db')] from pending to repaired with repaired at = 1720070528590 and session id = 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 DEBUG [node2_AntiEntropyStage:1] node2 2024-07-04 05:22:08,770 RepairMessageVerbHandler.java:290 - cleaning up repair INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:22:08,770 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:22:08,771 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:08,772 PendingRepairManager.java:145 - Removing compaction strategy for pending repair 5bf38040-39c5-11ef-a1c9-4b8e7a2da833 on tr.x INFO [node2_GossipStage:1] node2 2024-07-04 05:22:08,773 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:22:08,773 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:22:08,773 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:08,773 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:08,773 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:08,773 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:08,773 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:22:08,773 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:08,773 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:08,774 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:08,808 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:39296)->/127.0.0.1:7012-URGENT_MESSAGES-7b11527d messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:08,808 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:39296)->/127.0.0.1:7012-URGENT_MESSAGES-d62e0b98 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:09,790 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:39312)->/127.0.0.1:7012-URGENT_MESSAGES-9993d7a0 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:09,790 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:39312)->/127.0.0.1:7012-URGENT_MESSAGES-0aa25fa5 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_isolatedExecutor:4] node1 2024-07-04 05:22:10,776 HintsService.java:234 - Paused hints dispatch DEBUG [node1_isolatedExecutor:13] node1 2024-07-04 05:22:10,790 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node1_isolatedExecutor:13] node1 2024-07-04 05:22:10,790 MessagingService.java:643 - Waiting for messaging service to quiesce INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:10,810 NoSpamLogger.java:104 - /127.0.0.2:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:10,810 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:10,810 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:11,793 NoSpamLogger.java:104 - /127.0.0.3:7012->/127.0.0.1:7012-URGENT_MESSAGES-[no-channel] failed to connect io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /127.0.0.1:7012 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at io.netty.channel.unix.Errors.newConnectException0(Errors.java:166) at io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:131) at io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Thread.java:840) DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:11,793 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:11,793 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:11,811 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:11,811 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:12,794 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:12,794 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:22:12,800 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:12,812 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:12,813 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [main] node1 2024-07-04 05:22:13,198 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node1 2024-07-04 05:22:13,202 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node1 2024-07-04 05:22:13,202 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node1 2024-07-04 05:22:13,202 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node1 2024-07-04 05:22:13,203 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node1 2024-07-04 05:22:13,203 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node1 2024-07-04 05:22:13,203 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node1 2024-07-04 05:22:13,204 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node1 2024-07-04 05:22:13,204 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node1 2024-07-04 05:22:13,205 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node1 2024-07-04 05:22:13,206 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node1 2024-07-04 05:22:13,206 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node1 2024-07-04 05:22:13,206 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node1 2024-07-04 05:22:13,207 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node1 2024-07-04 05:22:13,207 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node1 2024-07-04 05:22:13,207 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node1 2024-07-04 05:22:13,208 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node1 2024-07-04 05:22:13,208 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node1 2024-07-04 05:22:13,208 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,242 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,243 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,243 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,243 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,243 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,243 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,247 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,247 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,304 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,313 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,339 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,339 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,340 CassandraDaemon.java:613 - Heap size: 992.000MiB/1.000GiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,340 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,340 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 562583664(549398K) committed = 563871744(550656K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,340 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 74076032(72339K) committed = 74121216(72384K) max = 122912768(120032K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,340 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 73962016(72228K) committed = 74579968(72832K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,340 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 335494696(327631K) committed = 369098752(360448K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,340 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 512286736(500280K) committed = 822083584(802816K) max = 1073741824(1048576K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,341 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 50331648(49152K) committed = 50331648(49152K) max = -1(-1K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,341 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 16381184(15997K) committed = 16384000(16000K) max = 122916864(120036K) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,341 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,341 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node1_ScheduledTasks:1] node1 2024-07-04 05:22:13,415 StorageService.java:294 - Overriding RING_DELAY to 15000ms DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,508 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,509 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,677 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,678 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:13,795 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:13,795 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:13,814 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:13,814 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. WARN 05:22:13 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,843 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:22:13 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,848 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:22:13 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,849 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,861 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,861 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,867 FileUtil.java:74 - Reading file /proc/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,870 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,870 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,870 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,870 FileUtil.java:74 - Reading file /proc/version DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,875 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,878 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,878 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,878 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,878 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,879 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,879 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,879 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,880 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,880 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,880 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,881 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,881 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,881 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,881 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:22:13 Cassandra server running in degraded mode. Swap should be disabled. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,881 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:22:13 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,882 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,883 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,883 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,886 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,886 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,886 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/commitlog DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,887 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/saved_caches DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:13,887 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/hints INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,036 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,039 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,131 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,138 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,146 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node1_SecondaryIndexManagement:1] node1 2024-07-04 05:22:14,158 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,164 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,174 ColumnFamilyStore.java:508 - Initializing system.local INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,196 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,221 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,222 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,223 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,259 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:22:14,290 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big (238B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,290 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big (28B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,303 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big (28B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,343 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,349 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,355 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,361 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,367 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,373 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,379 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,385 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,391 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,396 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,402 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,407 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,413 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,418 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,423 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,428 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,438 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,448 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big (226B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:22:14,448 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big (232B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,450 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big (159B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,457 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,465 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:22:14,470 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big (683B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,470 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big (1.219KiB) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,471 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,472 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,476 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,486 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,615 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,619 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big (369B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:22:14,619 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big (107B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,626 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,632 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-5-big (4.018KiB) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,638 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,642 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-5-big (7.932KiB) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,650 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:22:14,655 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-2-big (27B) INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,658 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big (3.301KiB) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,664 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,668 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/triggers-4df70b666b05325195a132b54005fd48/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,674 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,678 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/oa-1-big (101B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,684 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,688 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/views-9786ac1cdd583201a7cdad556410c985/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,694 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,697 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/types-5a8b1ca866023f77a0459273d308917a/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,703 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,709 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/functions-96489b7980be3e14a70166a0b9159450/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,715 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,721 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/aggregates-924c55872e3a345bb10c12f37c1ba895/oa-1-big (51B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,727 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:14,730 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/oa-1-big (173B) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,745 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,745 CassandraDaemon.java:514 - opening keyspace system DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,746 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,746 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,760 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,760 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,761 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,765 Startup.java:504 - hasAnyEpoch = true, hasBootedBefore = true INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,765 Startup.java:103 - Initializing as non CMS node DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:14,796 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:14,796 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,811 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,811 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,811 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,811 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:14,815 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:14,815 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,817 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6413366862127879887817.so DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,820 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,820 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,822 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,822 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,823 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,826 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,831 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,843 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,846 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node1_Messaging-EventLoop DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:14,846 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,041 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,041 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,043 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,062 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=Epoch{epoch=11}, entries=0: []} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:15,066 LocalLog.java:492 - Enacted ForceSnapshot{epoch=Epoch{epoch=11}}. New tail is Epoch{epoch=11} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,091 StorageService.java:494 - Initializing storage service mbean INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,092 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,102 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=11} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,102 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=11} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,102 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,105 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,105 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=11} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,110 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,114 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,117 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,121 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,124 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,127 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,131 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,134 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,138 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,139 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,139 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,143 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,143 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,144 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,146 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,147 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,147 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,150 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,155 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,159 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,162 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,167 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node1_SSTableBatchOpen:1] node1 2024-07-04 05:22:15,170 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-4-big (109B) INFO [node1_SSTableBatchOpen:2] node1 2024-07-04 05:22:15,170 SortedTableReaderLoadingBuilder.java:55 - Opening /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-2-big (282B) INFO [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:22:15,214 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,238 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 579B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,275 Flushing.java:153 - Writing Memtable-column_masks@812257783(32B serialized bytes, 1 ops, 579B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,277 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,334 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa_txn_flush_5fec0aa0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,356 CompactionManager.java:236 - Autocompaction on system_schema.column_masks is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,356 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-3-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,357 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 59.410KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,370 Flushing.java:153 - Writing Memtable-columns@397089681(12.668KiB serialized bytes, 73 ops, 59.410KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,375 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db (5.229KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,415 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_5ffdbde0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,427 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,427 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-6-big-Data.db')] (1 sstables, 7.404KiB), biggest 7.404KiB, smallest 7.404KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,428 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 42.255KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,434 Flushing.java:153 - Writing Memtable-tables@1166685768(12.824KiB serialized bytes, 16 ops, 42.255KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,436 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db (7.195KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,483 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_60086c40-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,488 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,488 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-6-big-Data.db')] (1 sstables, 8.211KiB), biggest 8.211KiB, smallest 8.211KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,489 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 4.592KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,495 Flushing.java:153 - Writing Memtable-keyspaces@2024856486(932B serialized bytes, 6 ops, 4.592KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,495 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db (676B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=15780) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,539 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_6011bb10-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,544 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,544 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db')] (1 sstables, 5.588KiB), biggest 5.588KiB, smallest 5.588KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,545 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN), (NodeId{id=2},JOIN), (NodeId{id=3},JOIN)] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,568 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.1:7012), nic: lo, encryption: unencrypted INFO [node1_OptionalTasks:1] node1 2024-07-04 05:22:15,573 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 695B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,580 Flushing.java:153 - Writing Memtable-local@1985495226(89B serialized bytes, 2 ops, 695B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,580 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db (37B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=15953) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,586 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,586 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,590 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,590 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,605 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,605 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,605 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,605 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,606 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,614 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,614 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,614 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,624 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_601eb360-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,625 CassandraDaemon.java:514 - opening keyspace distributed_test_keyspace DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,625 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,625 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,626 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,626 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,626 CassandraDaemon.java:514 - opening keyspace tr DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,627 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,629 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,629 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db')] (1 sstables, 5.039KiB), biggest 5.039KiB, smallest 5.039KiB INFO [node1_OptionalTasks:1] node1 2024-07-04 05:22:15,640 SecondaryIndexManager.java:947 - Executing pre-join post-bootstrap tasks for: CFS(Keyspace='tr', ColumnFamily='x') WARN 05:22:15 Using stored Gossip Generation 1720070536 as it is greater than current system time 1720070535. See CASSANDRA-3654 if you experience problems WARN [node1_OptionalTasks:1] node1 2024-07-04 05:22:15,642 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070536 as it is greater than current system time 1720070535. See CASSANDRA-3654 if you experience problems INFO [node1_OptionalTasks:1] node1 2024-07-04 05:22:15,643 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 1.992KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,649 Flushing.java:153 - Writing Memtable-local@971025011(426B serialized bytes, 2 ops, 1.992KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,650 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db (169B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=16405) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,674 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_602961c0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,677 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,677 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db')] (1 sstables, 5.819KiB), biggest 5.819KiB, smallest 5.819KiB DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:15,683 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 14, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,4), DC=Value(dc0,5), RACK=Value(rack0,6), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,7), RPC_ADDRESS=Value(127.0.0.1,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,9), TOKENS=Value(10,10), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,11), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,12), STATUS_WITH_PORT=Value(NORMAL,10,13)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:15,685 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0)} DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:15,692 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,694 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,725 CommitLog.java:205 - Replaying /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/commitlog/CommitLog-9-1720070512245.log DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,735 CommitLogReplayer.java:175 - Global replay position is CommitLogPosition(segmentId=-1, position=0) from columnfamilies 0ecdaa87-f8fb-3e60-88d1-74fb36fe5c0d:{}, b8b43d5f-d6c0-331c-8f7d-765ea658f4c4:{}, 618f817b-005f-3678-b8a4-53f3930b8e86:{}, b7b7f0c2-fd0a-3410-8c05-3ef614bb7c2d:{}, c4325fbb-8e5e-3baf-bd07-0f9250ed818e:{}, 5a8b1ca8-6602-3f77-a045-9273d308917a:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=80007)}, 0feb57ac-311f-382f-ba6d-9024d305702f:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=80554)}, 5a1ff267-ace0-3f12-8563-cfae6103c65e:{}, 4224a088-2ac9-3d0c-889d-fbb5f0facda0:{}, d6123acc-8649-3496-9d4e-f3fe39a6018b:{}, 4df70b66-6b05-3251-95a1-32b54005fd48:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=80007)}, deabd734-b99d-3b9c-92e5-fd92eb5abf14:{}, 176c39cd-b93d-33a5-a218-8eb06a56f66e:{}, ecb86667-40b2-3316-bb91-e612c8047457:{}, 4b3c50a9-ea87-3d76-9101-6dbc9c38494a:{}, 37f71aca-7dc2-383b-a706-72528af04d4f:{}, 24101c25-a2ae-3af7-87c1-b40ee1aca33f:{CommitLogPosition(segmentId=1720070512245, position=21799)=CommitLogPosition(segmentId=1720070512245, position=90064), CommitLogPosition(segmentId=1720070533694, position=28)=CommitLogPosition(segmentId=1720070533694, position=15780)}, 1ff78f1a-7df1-3a2a-a998-6f4932270af5:{}, d885727a-f67b-3a32-951b-78efe9c75732:{}, 7ad54392-bcdd-35a6-8417-4e047860b377:{CommitLogPosition(segmentId=1720070512245, position=66061)=CommitLogPosition(segmentId=1720070512245, position=69735), CommitLogPosition(segmentId=1720070533694, position=28)=CommitLogPosition(segmentId=1720070533694, position=16405)}, 7e5a361c-317c-351f-b15f-ffd8afd3dd4b:{}, afddfb9d-bc1e-3068-8056-eed6c302ba09:{CommitLogPosition(segmentId=1720070512245, position=21799)=CommitLogPosition(segmentId=1720070512245, position=90064), CommitLogPosition(segmentId=1720070533694, position=28)=CommitLogPosition(segmentId=1720070533694, position=15780)}, 5582b59f-8e4e-35e1-b913-3acada51eb04:{}, b4dbb7b4-dc49-3fb5-b3bf-ce6e434832ca:{}, 62efe31f-3be8-310c-8d29-8963439c1288:{}, 8826e8e9-e16a-3728-8753-3bc1fc713c25:{}, 9c48af00-13f6-3059-bb0e-8fcabba6eecb:{}, 9786ac1c-dd58-3201-a7cd-ad556410c985:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=80554)}, 0e65065f-e401-38ed-9507-b9213fae8d11:{}, 919a4bc5-7a33-3573-b03e-13fc3f68b465:{}, 5bc52802-de25-35ed-aeab-188eecebb090:{}, 6c22df66-c3bd-3df6-b74d-21179c6a9fe9:{}, 924c5587-2e3a-345b-b10c-12f37c1ba895:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=80554)}, 738cc5ed-0168-3268-b9d1-853d4bc278af:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=90064), CommitLogPosition(segmentId=1720070533694, position=28)=CommitLogPosition(segmentId=1720070533694, position=15780)}, 0bd47a48-d6ba-3c8e-b442-0f6349329bda:{}, 1b255f4d-ef25-40a6-0000-00000000000a:{CommitLogPosition(segmentId=1720070512245, position=88980)=CommitLogPosition(segmentId=1720070512245, position=95511)}, 9f5c6374-d485-3229-9a0a-5094af9ad1e3:{}, abac5682-dea6-31c5-b535-b3d6cffd0fb6:{CommitLogPosition(segmentId=1720070512245, position=21799)=CommitLogPosition(segmentId=1720070512245, position=90064), CommitLogPosition(segmentId=1720070533694, position=28)=CommitLogPosition(segmentId=1720070533694, position=15780)}, a3d277d1-cfaf-36f5-a2a7-38d5eea9ad6a:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=102681)}, 59dfeaea-8db2-3341-91ef-109974d81484:{}, 6775be21-7f1f-3a2f-90d5-bd313a15ce78:{}, e4ddd16e-bea6-31f4-8361-e88f07af8d4e:{CommitLogPosition(segmentId=1720070512245, position=67241)=CommitLogPosition(segmentId=1720070512245, position=88980)}, 3afbe79f-2194-31a7-add7-f5ab90d8ec9c:{}, c5e99f16-8677-3914-b17e-960613512345:{}, 6cad20f7-d4f5-3af2-b6e2-0da33c6c1f83:{}, 5e7583b5-f3f4-3af1-9a39-b7e1d6f5f11f:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=80007)}, 5f2fbdad-91f1-3946-bd25-d5da3a5c35ec:{}, 759fffad-624b-3181-80ee-fa9a52d1f627:{}, c539fcab-d65a-31d1-8133-d25605643ee3:{}, d46780c2-2f1c-3db9-b4c1-b8d9fbc0cc23:{}, 18a9c257-6a0c-3841-ba71-8cd529849fef:{}, 96489b79-80be-3e14-a701-66a0b9159450:{CommitLogPosition(segmentId=1720070512245, position=28)=CommitLogPosition(segmentId=1720070512245, position=80007)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,757 CommitLogReader.java:266 - Reading /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/commitlog/CommitLog-9-1720070512245.log (CL version 9, messaging version 14, compression null) INFO [node1_MutationStage-2] node1 2024-07-04 05:22:15,788 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:15,816 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:15,817 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:15,817 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@4bab3ae2 DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:15,848 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:15,848 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:15,848 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:15,848 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:15,848 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:15,851 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:48814)->/127.0.0.1:7012-URGENT_MESSAGES-550842b1 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:15,851 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:48830)->/127.0.0.1:7012-URGENT_MESSAGES-39f534c1 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,863 CommitLogReader.java:257 - Finished reading /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/commitlog/CommitLog-9-1720070512245.log INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,864 ColumnFamilyStore.java:1060 - Enqueuing flush of system.compaction_history, Reason: STARTUP, Usage: 9.868KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,864 ColumnFamilyStore.java:1060 - Enqueuing flush of system.paxos, Reason: STARTUP, Usage: 22.344KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity_v2, Reason: STARTUP, Usage: 12.571KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers_v2, Reason: STARTUP, Usage: 3.559KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system.sstable_activity, Reason: STARTUP, Usage: 12.719KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system.repairs, Reason: STARTUP, Usage: 2.887KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,865 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: STARTUP, Usage: 3.570KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,866 ColumnFamilyStore.java:1060 - Enqueuing flush of system.peers, Reason: STARTUP, Usage: 2.926KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,866 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: STARTUP, Usage: 2.164KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,866 ColumnFamilyStore.java:1060 - Enqueuing flush of system_auth.roles, Reason: STARTUP, Usage: 905B (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,866 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: STARTUP, Usage: 10.712KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,867 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: STARTUP, Usage: 58.271KiB (1%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,867 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: STARTUP, Usage: 3.065KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,867 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: STARTUP, Usage: 39.360KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,868 ColumnFamilyStore.java:1060 - Enqueuing flush of system_distributed.parent_repair_history, Reason: STARTUP, Usage: 12.467KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:15,868 ColumnFamilyStore.java:1060 - Enqueuing flush of system_distributed.repair_history, Reason: STARTUP, Usage: 6.188KiB (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,869 Flushing.java:153 - Writing Memtable-compaction_history@768406385(1.959KiB serialized bytes, 7 ops, 9.868KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:15,870 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:48814)->/127.0.0.1:7012-URGENT_MESSAGES-23f5caa9 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,870 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db (990B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:15,870 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:48830)->/127.0.0.1:7012-URGENT_MESSAGES-f254ca97 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,900 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa_txn_flush_604af380-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,902 CompactionManager.java:236 - Autocompaction on system.compaction_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,902 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/oa-1-big-Data.db')] (1 sstables, 6.205KiB), biggest 6.205KiB, smallest 6.205KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,935 Flushing.java:153 - Writing Memtable-paxos@1407148165(5.999KiB serialized bytes, 33 ops, 22.344KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,939 UncommittedTableData.java:516 - flushing generation 0 uncommitted paxos file for system_cluster_metadata.distributed_metadata_log INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:15,941 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db (4.937KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,989 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa_txn_flush_6050bfe0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,994 CompactionManager.java:236 - Autocompaction on system.paxos is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:15,994 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/paxos-b7b7f0c2fd0a34108c053ef614bb7c2d/oa-1-big-Data.db')] (1 sstables, 8.038KiB), biggest 8.038KiB, smallest 8.038KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,001 Flushing.java:153 - Writing Memtable-sstable_activity_v2@1731639252(240B serialized bytes, 30 ops, 12.571KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,003 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db (1.312KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,053 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa_txn_flush_605ec9a0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,062 CompactionManager.java:236 - Autocompaction on system.sstable_activity_v2 is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,062 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/sstable_activity_v2-62efe31f3be8310c8d298963439c1288/oa-1-big-Data.db')] (1 sstables, 6.688KiB), biggest 6.688KiB, smallest 6.688KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,069 Flushing.java:153 - Writing Memtable-peers_v2@1530477171(634B serialized bytes, 14 ops, 3.559KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,070 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db (228B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,114 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa_txn_flush_606929e0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,120 CompactionManager.java:236 - Autocompaction on system.peers_v2 is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,120 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/peers_v2-c4325fbb8e5e3bafbd070f9250ed818e/oa-1-big-Data.db')] (1 sstables, 5.725KiB), biggest 5.725KiB, smallest 5.725KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,130 Flushing.java:153 - Writing Memtable-sstable_activity@295963934(240B serialized bytes, 30 ops, 12.719KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,132 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db (1.396KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,175 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa_txn_flush_60720380-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,186 CompactionManager.java:236 - Autocompaction on system.sstable_activity is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,186 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/oa-1-big-Data.db')] (1 sstables, 6.793KiB), biggest 6.793KiB, smallest 6.793KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,194 Flushing.java:153 - Writing Memtable-repairs@962043111(475B serialized bytes, 1 ops, 2.887KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,195 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db (178B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,223 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa_txn_flush_607c15a0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,226 CompactionManager.java:236 - Autocompaction on system.repairs is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,226 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db')] (1 sstables, 5.823KiB), biggest 5.823KiB, smallest 5.823KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,236 Flushing.java:153 - Writing Memtable-local_metadata_log@1796015118(1.681KiB serialized bytes, 3 ops, 3.570KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,236 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (1.485KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,250 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_60823020-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,252 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,252 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.903KiB), biggest 5.903KiB, smallest 5.903KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,258 Flushing.java:153 - Writing Memtable-peers@2046120382(530B serialized bytes, 14 ops, 2.926KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,259 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db (198B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,392 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa_txn_flush_60864ed0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,414 CompactionManager.java:236 - Autocompaction on system.peers is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,414 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/peers-37f71aca7dc2383ba70672528af04d4f/oa-1-big-Data.db')] (1 sstables, 5.514KiB), biggest 5.514KiB, smallest 5.514KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,433 Flushing.java:153 - Writing Memtable-local@1208516451(462B serialized bytes, 7 ops, 2.164KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,433 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db (217B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,505 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_609edfe0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,513 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,513 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db')] (1 sstables, 5.898KiB), biggest 5.898KiB, smallest 5.898KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,530 Flushing.java:153 - Writing Memtable-roles@1295872545(151B serialized bytes, 3 ops, 905B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,530 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db (83B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,563 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa_txn_flush_60adfb10-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,566 CompactionManager.java:236 - Autocompaction on system_auth.roles is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,566 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db')] (1 sstables, 5.166KiB), biggest 5.166KiB, smallest 5.166KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,576 Flushing.java:153 - Writing Memtable-distributed_metadata_log@1318265596(3.783KiB serialized bytes, 11 ops, 10.712KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,577 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db (3.077KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,669 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa_txn_flush_60b61160-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,674 CompactionManager.java:236 - Autocompaction on system_cluster_metadata.distributed_metadata_log is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,674 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_cluster_metadata/distributed_metadata_log-d885727af67b3a32951b78efe9c75732/oa-1-big-Data.db')] (1 sstables, 6.956KiB), biggest 6.956KiB, smallest 6.956KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,687 Flushing.java:153 - Writing Memtable-columns@498655793(12.513KiB serialized bytes, 72 ops, 58.271KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,690 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db (5.311KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,769 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_60c68c20-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,788 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,788 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-7-big-Data.db')] (1 sstables, 7.449KiB), biggest 7.449KiB, smallest 7.449KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,806 Flushing.java:153 - Writing Memtable-keyspaces@381707650(622B serialized bytes, 4 ops, 3.065KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,807 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db (461B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,830 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_60d7f140-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,838 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,839 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db')] (1 sstables, 5.469KiB), biggest 5.469KiB, smallest 5.469KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,847 Flushing.java:153 - Writing Memtable-tables@818589953(12.069KiB serialized bytes, 15 ops, 39.360KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,848 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db (6.854KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,932 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_60dfb970-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,938 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:16,938 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-7-big-Data.db')] (1 sstables, 8.186KiB), biggest 8.186KiB, smallest 8.186KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,951 Flushing.java:153 - Writing Memtable-parent_repair_history@1729749286(2.112KiB serialized bytes, 6 ops, 12.467KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:16,952 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db (1.010KiB) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,039 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa_txn_flush_60eed4a0-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,045 CompactionManager.java:236 - Autocompaction on system_distributed.parent_repair_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,045 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db')] (1 sstables, 6.089KiB), biggest 6.089KiB, smallest 6.089KiB INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:17,065 Flushing.java:153 - Writing Memtable-repair_history@1038761630(1.180KiB serialized bytes, 6 ops, 6.188KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:17,066 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db (464B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=17419) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,104 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa_txn_flush_60ff4f60-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,107 CompactionManager.java:236 - Autocompaction on system_distributed.repair_history is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,107 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db')] (1 sstables, 6.092KiB), biggest 6.092KiB, smallest 6.092KiB INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,107 CommitLog.java:207 - Log replay complete, 173 replayed mutations INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,109 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,109 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,109 StorageService.java:704 - CQL version: 3.4.8 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,109 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,129 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes WARN 05:22:17 Using stored Gossip Generation 1720070537 as it is greater than current system time 1720070537. See CASSANDRA-3654 if you experience problems WARN [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,205 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070537 as it is greater than current system time 1720070537. See CASSANDRA-3654 if you experience problems INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,206 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 567B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:17,226 Flushing.java:153 - Writing Memtable-local@672379092(53B serialized bytes, 1 ops, 567B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:17,227 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=61220) INFO [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,316 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_6117b960-39c5-11ef-b7b7-07b030bb45ab.log DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,321 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:17,321 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,322 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,322 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 25, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), RPC_ADDRESS=Value(127.0.0.1,19), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,22), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24)} DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,325 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,326 Gossiper.java:511 - Convicting /127.0.0.2:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,326 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,327 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,327 Gossiper.java:511 - Convicting /127.0.0.3:7012 with status NORMAL - alive true INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,327 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:17,327 Gossiper.java:1940 - Waiting for gossip to settle... INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:17,851 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:60846)->/127.0.0.3:7012-URGENT_MESSAGES-8496fbfb messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:17,853 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:60846)->/127.0.0.3:7012-URGENT_MESSAGES-802c652b successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:17,855 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node3_GossipStage:1] node3 2024-07-04 05:22:17,855 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node3_GossipStage:1] node3 2024-07-04 05:22:17,856 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:17,860 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:17,860 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,862 Gossiper.java:1090 - Clearing interval times for /127.0.0.2:7012 due to generation change DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,862 Gossiper.java:1090 - Clearing interval times for /127.0.0.3:7012 due to generation change INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,863 Gossiper.java:1197 - Node /127.0.0.2:7012 has restarted, now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,866 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:17,867 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:48410)->/127.0.0.2:7012-URGENT_MESSAGES-c9c84caa messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:17,868 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:48410)->/127.0.0.2:7012-URGENT_MESSAGES-a220faf0 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,872 Gossiper.java:1197 - Node /127.0.0.3:7012 has restarted, now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,873 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:17,877 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:17,877 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:22:17,877 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node3_BatchlogTasks:1] node3 2024-07-04 05:22:18,186 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 341 KB/s per endpoint DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:18,628 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 60, AppStateMap = {LOAD=Value(136141.0,44), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,33), TOKENS=Value(20,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,36), STATUS_WITH_PORT=Value(NORMAL,20,37), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 60, AppStateMap = {LOAD=Value(62839.0,41), SSTABLE_VERSIONS=Value(big-oa,10), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), TOKENS=Value(30,33), NET_VERSION=Value(14,8), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), DC=Value(dc0,28), STATUS_WITH_PORT=Value(NORMAL,30,36), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), RACK=Value(rack0,29)}} DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:18,802 Gossiper.java:1090 - Clearing interval times for /127.0.0.1:7012 due to generation change INFO [node2_GossipStage:1] node2 2024-07-04 05:22:18,803 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node2_GossipStage:1] node2 2024-07-04 05:22:18,803 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:18,812 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:22:18,812 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:18,929 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 60, AppStateMap = {LOAD=Value(136141.0,44), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,33), TOKENS=Value(20,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,36), STATUS_WITH_PORT=Value(NORMAL,20,37), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 61, AppStateMap = {LOAD=Value(62839.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}} DEBUG [node2_BatchlogTasks:1] node2 2024-07-04 05:22:19,132 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 341 KB/s per endpoint DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,230 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 34, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), INTERNAL_IP=Value(127.0.0.1,29), RPC_ADDRESS=Value(127.0.0.1,19), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 60, AppStateMap = {LOAD=Value(136141.0,44), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,33), TOKENS=Value(20,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,36), STATUS_WITH_PORT=Value(NORMAL,20,37), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 61, AppStateMap = {LOAD=Value(62839.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,230 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,234 Startup.java:400 - NORMAL DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,249 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,249 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,258 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,263 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617883033190 bytes available, checking if we can write 765 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,263 CompactionTask.java:167 - Compacting (6250d5a0-39c5-11ef-b7b7-07b030bb45ab) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big-Data.db:level=0, ] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,269 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,273 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:19,289 SnapshotManager.java:125 - Adding snapshots: . INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,353 CompactionTask.java:258 - Compacted (6250d5a0-39c5-11ef-b7b7-07b030bb45ab) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-5-big,] to level=0. 766B to 239B (~31% of original) in 87ms. Read Throughput = 8.516KiB/s, Write Throughput = 2.657KiB/s, Row Throughput = ~6/s. 6 total partitions merged to 3. Partition merge counts were {2:3, }. Time spent writing keys = 35ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,354 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,355 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,355 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-4-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,357 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617883021517 bytes available, checking if we can write 705 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,357 CompactionTask.java:167 - Compacting (625fc9c0-39c5-11ef-b7b7-07b030bb45ab) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,357 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-3-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,358 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data2/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-2-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,360 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system/repairs-a3d277d1cfaf36f5a2a738d5eea9ad6a/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,443 CompactionTask.java:258 - Compacted (625fc9c0-39c5-11ef-b7b7-07b030bb45ab) 7 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-13-big,] to level=0. 705B to 231B (~32% of original) in 85ms. Read Throughput = 8.079KiB/s, Write Throughput = 2.647KiB/s, Row Throughput = ~2/s. 7 total partitions merged to 1. Partition merge counts were {7:1, }. Time spent writing keys = 25ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,444 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,444 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,444 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,444 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,445 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,445 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,445 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-12-big DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,446 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617883103232 bytes available, checking if we can write 996 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,446 CompactionTask.java:167 - Compacting (626d5e50-39c5-11ef-b7b7-07b030bb45ab) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big-Data.db:level=0, ] INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,447 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-11-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,450 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,452 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,457 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-10-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,464 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-9-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,467 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:19,495 CompactionTask.java:258 - Compacted (626d5e50-39c5-11ef-b7b7-07b030bb45ab) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-9-big,] to level=0. 996B to 351B (~35% of original) in 47ms. Read Throughput = 20.543KiB/s, Write Throughput = 7.239KiB/s, Row Throughput = ~16/s. 19 total partitions merged to 8. Partition merge counts were {1:2, 2:1, 3:5, }. Time spent writing keys = 11ms INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,502 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-8-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,503 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,505 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-7-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:19,506 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big DEBUG [main] node4 2024-07-04 05:22:19,535 InternalLoggerFactory.java:63 - Using SLF4J as the default logging framework DEBUG [main] node4 2024-07-04 05:22:19,539 PlatformDependent0.java:497 - -Dio.netty.noUnsafe: false DEBUG [main] node4 2024-07-04 05:22:19,539 PlatformDependent0.java:1001 - Java version: 17 DEBUG [main] node4 2024-07-04 05:22:19,539 PlatformDependent0.java:137 - sun.misc.Unsafe.theUnsafe: available DEBUG [main] node4 2024-07-04 05:22:19,539 PlatformDependent0.java:161 - sun.misc.Unsafe.copyMemory: available DEBUG [main] node4 2024-07-04 05:22:19,540 PlatformDependent0.java:193 - sun.misc.Unsafe.storeFence: available DEBUG [main] node4 2024-07-04 05:22:19,540 PlatformDependent0.java:236 - java.nio.Buffer.address: available DEBUG [main] node4 2024-07-04 05:22:19,540 PlatformDependent0.java:308 - direct buffer constructor: available DEBUG [main] node4 2024-07-04 05:22:19,541 PlatformDependent0.java:386 - java.nio.Bits.unaligned: available, true DEBUG [main] node4 2024-07-04 05:22:19,541 PlatformDependent0.java:457 - jdk.internal.misc.Unsafe.allocateUninitializedArray(int): available DEBUG [main] node4 2024-07-04 05:22:19,541 PlatformDependent0.java:483 - java.nio.DirectByteBuffer.<init>(long, {int,long}): available DEBUG [main] node4 2024-07-04 05:22:19,541 PlatformDependent.java:1159 - sun.misc.Unsafe: available DEBUG [main] node4 2024-07-04 05:22:19,541 PlatformDependent.java:1270 - maxDirectMemory: 1073741824 bytes (maybe) DEBUG [main] node4 2024-07-04 05:22:19,542 PlatformDependent.java:1289 - -Dio.netty.tmpdir: /home/cassandra/cassandra/build/tmp (java.io.tmpdir) DEBUG [main] node4 2024-07-04 05:22:19,542 PlatformDependent.java:1368 - -Dio.netty.bitMode: 64 (sun.arch.data.model) DEBUG [main] node4 2024-07-04 05:22:19,542 PlatformDependent.java:178 - -Dio.netty.maxDirectMemory: 1073741824 bytes DEBUG [main] node4 2024-07-04 05:22:19,542 PlatformDependent.java:185 - -Dio.netty.uninitializedArrayAllocationThreshold: 1024 DEBUG [main] node4 2024-07-04 05:22:19,543 CleanerJava9.java:71 - java.nio.ByteBuffer.cleaner(): available DEBUG [main] node4 2024-07-04 05:22:19,543 PlatformDependent.java:205 - -Dio.netty.noPreferDirect: false INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,574 DatabaseDescriptor.java:1598 - Supported sstable formats are: big -> org.apache.cassandra.io.sstable.format.big.BigFormat with singleton components: [Data.db, Index.db, Statistics.db, CompressionInfo.db, Filter.db, Summary.db, Digest.crc32, CRC.db, TOC.txt], bti -> org.apache.cassandra.io.sstable.format.bti.BtiFormat with singleton components: [Data.db, Partitions.db, Rows.db, Statistics.db, CompressionInfo.db, Filter.db, Digest.crc32, CRC.db, TOC.txt] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,575 AbstractCryptoProvider.java:104 - Installation of a crypto provider was skipped as org.apache.cassandra.security.JREProvider was used. DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,575 DatabaseDescriptor.java:512 - Syncing log with batch mode INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,575 DatabaseDescriptor.java:554 - DiskAccessMode is standard, indexAccessMode is mmap INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,576 DatabaseDescriptor.java:593 - Global memtable on-heap threshold is enabled at 10MiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,576 DatabaseDescriptor.java:597 - Global memtable off-heap threshold is enabled at 256MiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,578 DatabaseDescriptor.java:645 - commitlog_disk_access_mode resolved to: mmap INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,578 DatabaseDescriptor.java:665 - Native transport rate-limiting disabled. DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,613 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,618 SSLFactory.java:264 - Initializing hot reloading SSLContext INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,635 CassandraDaemon.java:605 - Hostname: 9fc94e9cb01c:7012:7001 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,635 CassandraDaemon.java:612 - JVM vendor/version: OpenJDK 64-Bit Server VM/17.0.10 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,635 CassandraDaemon.java:613 - Heap size: 1.000GiB/1.000GiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,635 CassandraDaemon.java:618 - CodeHeap 'non-nmethods' Non-heap memory: init = 2555904(2496K) used = 1579648(1542K) committed = 2555904(2496K) max = 5828608(5692K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:618 - Metaspace Non-heap memory: init = 0(0K) used = 599702624(585647K) committed = 600899584(586816K) max = -1(-1K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:618 - CodeHeap 'profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 78889472(77040K) committed = 78905344(77056K) max = 122912768(120032K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:618 - Compressed Class Space Non-heap memory: init = 0(0K) used = 78789616(76942K) committed = 79364096(77504K) max = 1073741824(1048576K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:618 - G1 Eden Space Heap memory: init = 33554432(32768K) used = 335494696(327631K) committed = 369098752(360448K) max = -1(-1K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:618 - G1 Old Gen Heap memory: init = 50331648(49152K) used = 545597968(532810K) committed = 822083584(802816K) max = 1073741824(1048576K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:618 - G1 Survivor Space Heap memory: init = 0(0K) used = 50331648(49152K) committed = 50331648(49152K) max = -1(-1K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:618 - CodeHeap 'non-profiled nmethods' Non-heap memory: init = 2555904(2496K) used = 17123328(16722K) committed = 17170432(16768K) max = 122916864(120036K) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:620 - Classpath: /usr/share/ant/lib/ant-launcher.jar:/usr/share/ant/lib/ant-jdepend.jar:/usr/share/ant/lib/ant-apache-oro.jar:/usr/share/ant/lib/ant-jsch.jar:/usr/share/ant/lib/ant-apache-log4j.jar:/usr/share/ant/lib/ant-apache-bsf.jar:/usr/share/ant/lib/ant-swing.jar:/usr/share/ant/lib/ant-junit4.jar:/usr/share/ant/lib/ant-antlr.jar:/usr/share/ant/lib/ant-testutil.jar:/usr/share/ant/lib/ant.jar:/usr/share/ant/lib/ant-jmf.jar:/usr/share/ant/lib/ant-junit.jar:/usr/share/ant/lib/ant-apache-bcel.jar:/usr/share/ant/lib/ant-apache-xalan2.jar:/usr/share/ant/lib/ant-commons-logging.jar:/usr/share/ant/lib/ant-apache-resolver.jar:/usr/share/ant/lib/ant-javamail.jar:/usr/share/ant/lib/ant-commons-net.jar:/usr/share/ant/lib/ant-xz.jar:/usr/share/ant/lib/ant-apache-regexp.jar:/home/cassandra/cassandra/build/classes/stress:/home/cassandra/cassandra/build/classes/fqltool:/home/cassandra/cassandra/build/test/classes:/home/cassandra/cassandra/build/apache-cassandra-5.1-SNAPSHOT.jar:/home/cassandra/cassandra/build/lib/jars/AmazonCorrettoCryptoProvider-2.2.0-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/HdrHistogram-2.1.12.jar:/home/cassandra/cassandra/build/lib/jars/ST4-4.0.8.jar:/home/cassandra/cassandra/build/lib/jars/affinity-3.23.3.jar:/home/cassandra/cassandra/build/lib/jars/agrona-1.17.1.jar:/home/cassandra/cassandra/build/lib/jars/airline-0.8.jar:/home/cassandra/cassandra/build/lib/jars/antlr-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/antlr-runtime-3.5.2.jar:/home/cassandra/cassandra/build/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/lib/jars/big-math-2.3.0.jar:/home/cassandra/cassandra/build/lib/jars/byteman-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-bmunit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-install-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/byteman-submit-4.0.20.jar:/home/cassandra/cassandra/build/lib/jars/caffeine-3.1.8.jar:/home/cassandra/cassandra/build/lib/jars/cassandra-driver-core-3.11.5-shaded.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-bytes-2.23.33.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-core-2.23.36.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-queue-5.23.37.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-threads-2.23.25.jar:/home/cassandra/cassandra/build/lib/jars/chronicle-wire-2.23.39.jar:/home/cassandra/cassandra/build/lib/jars/commons-cli-1.5.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-lang3-3.13.0.jar:/home/cassandra/cassandra/build/lib/jars/commons-math3-3.2.jar:/home/cassandra/cassandra/build/lib/jars/compile-command-annotations-1.2.0.jar:/home/cassandra/cassandra/build/lib/jars/concurrent-trees-2.4.0.jar:/home/cassandra/cassandra/build/lib/jars/ecj-3.33.0.jar:/home/cassandra/cassandra/build/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/lib/jars/high-scale-lib-1.0.6.jar:/home/cassandra/cassandra/build/lib/jars/hppc-0.8.1.jar:/home/cassandra/cassandra/build/lib/jars/ipaddress-5.3.3.jar:/home/cassandra/cassandra/build/lib/jars/j2objc-annotations-1.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-annotations-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jackson-datatype-jsr310-2.15.3.jar:/home/cassandra/cassandra/build/lib/jars/jacocoagent.jar:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar:/home/cassandra/cassandra/build/lib/jars/javax.inject-1.jar:/home/cassandra/cassandra/build/lib/jars/jbcrypt-0.4.jar:/home/cassandra/cassandra/build/lib/jars/jcl-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/jcommander-1.30.jar:/home/cassandra/cassandra/build/lib/jars/jctools-core-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11-native.jar:/home/cassandra/cassandra/build/lib/jars/jffi-1.3.11.jar:/home/cassandra/cassandra/build/lib/jars/jna-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jna-platform-5.13.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-a64asm-1.0.0.jar:/home/cassandra/cassandra/build/lib/jars/jnr-constants-0.10.4.jar:/home/cassandra/cassandra/build/lib/jars/jnr-ffi-2.2.13.jar:/home/cassandra/cassandra/build/lib/jars/jnr-x86asm-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jsr305-2.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvector-1.0.2.jar:/home/cassandra/cassandra/build/lib/jars/jvm-attach-api-1.5.jar:/home/cassandra/cassandra/build/lib/jars/log4j-over-slf4j-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/logback-classic-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/logback-core-1.2.12.jar:/home/cassandra/cassandra/build/lib/jars/lucene-analysis-common-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lucene-core-9.7.0.jar:/home/cassandra/cassandra/build/lib/jars/lz4-java-1.8.0.jar:/home/cassandra/cassandra/build/lib/jars/metrics-core-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-jvm-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/metrics-logback-4.2.19.jar:/home/cassandra/cassandra/build/lib/jars/mxdump-0.14.jar:/home/cassandra/cassandra/build/lib/jars/netty-all-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-buffer-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-codec-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-proxy-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-handler-ssl-ocsp-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-resolver-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final-osx-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-boringssl-static-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-tcnative-classes-2.0.61.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-classes-kqueue-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-epoll-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/netty-transport-native-unix-common-4.1.96.Final.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/ohc-core-j8-0.5.1.jar:/home/cassandra/cassandra/build/lib/jars/oshi-core-6.4.8.jar:/home/cassandra/cassandra/build/lib/jars/posix-2.24ea4.jar:/home/cassandra/cassandra/build/lib/jars/psjava-0.1.19.jar:/home/cassandra/cassandra/build/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/lib/jars/sjk-cli-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-core-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-json-0.14.jar:/home/cassandra/cassandra/build/lib/jars/sjk-stacktrace-0.14.jar:/home/cassandra/cassandra/build/lib/jars/slf4j-api-1.7.36.jar:/home/cassandra/cassandra/build/lib/jars/snakeyaml-2.1.jar:/home/cassandra/cassandra/build/lib/jars/snappy-java-1.1.10.4.jar:/home/cassandra/cassandra/build/lib/jars/stream-2.5.2.jar:/home/cassandra/cassandra/build/lib/jars/zstd-jni-1.5.5-1.jar:/home/cassandra/cassandra/build/test/lib/jars/Saxon-HE-12.2.jar:/home/cassandra/cassandra/build/test/lib/jars/accessors-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/antlr4-runtime-4.11.1.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-analysis-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-commons-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-tree-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-util-9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/asm-xml-6.0.jar:/home/cassandra/cassandra/build/test/lib/jars/assertj-core-3.24.2.jar:/home/cassandra/cassandra/build/test/lib/jars/awaitility-4.0.3.jar:/home/cassandra/cassandra/build/test/lib/jars/bcpkix-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcprov-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/bcutil-jdk18on-1.78.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-1.12.21.jar:/home/cassandra/cassandra/build/test/lib/jars/byte-buddy-agent-1.12.13.jar:/home/cassandra/cassandra/build/test/lib/jars/checker-qual-3.27.0.jar:/home/cassandra/cassandra/build/test/lib/jars/checkstyle-10.12.1.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-beanutils-1.9.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-codec-1.15.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-collections-3.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-fileupload-1.4.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-io-2.11.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-lang3-3.12.0.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-logging-1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/commons-math3-3.6.1.jar:/home/cassandra/cassandra/build/test/lib/jars/dtest-api-0.0.16.jar:/home/cassandra/cassandra/build/test/lib/jars/error_prone_annotations-2.2.0.jar:/home/cassandra/cassandra/build/test/lib/jars/failureaccess-1.0.1.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-32.0.1-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/guava-testlib-27.0-jre.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/hamcrest-core-2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/handlebars-helpers-4.3.1.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-common-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-hpack-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/http2-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/httpclient5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/httpcore5-h2-5.1.3.jar:/home/cassandra/cassandra/build/test/lib/jars/j2objc-annotations-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-annotations-2.13.4.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-core-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-databind-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jackson-dataformat-yaml-2.15.3.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.activation-api-1.2.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jakarta.xml.bind-api-2.3.3.jar:/home/cassandra/cassandra/build/test/lib/jars/java-allocation-instrumenter-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/java-cup-runtime-11b-20160615.jar:/home/cassandra/cassandra/build/test/lib/jars/javassist-3.28.0-GA.jar:/home/cassandra/cassandra/build/test/lib/jars/javax.servlet-api-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-java-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-openjdk8-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-alpn-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-client-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-continuation-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-http-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-io-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-proxy-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-security-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-server-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlet-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-servlets-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-util-ajax-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-webapp-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jetty-xml-9.4.49.v20220914.jar:/home/cassandra/cassandra/build/test/lib/jars/jflex-1.8.2.jar:/home/cassandra/cassandra/build/test/lib/jars/jimfs-1.1.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-core-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jmh-generator-annprocess-1.37.jar:/home/cassandra/cassandra/build/test/lib/jars/jopt-simple-5.0.4.jar:/home/cassandra/cassandra/build/test/lib/jars/json-path-2.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/json-smart-2.4.7.jar:/home/cassandra/cassandra/build/test/lib/jars/json-unit-core-2.36.0.jar:/home/cassandra/cassandra/build/test/lib/jars/jsr305-3.0.2.jar:/home/cassandra/cassandra/build/test/lib/jars/junit-4.12.jar:/home/cassandra/cassandra/build/test/lib/jars/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-core-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/mockito-inline-4.7.0.jar:/home/cassandra/cassandra/build/test/lib/jars/objenesis-3.2.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.agent-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.ant-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.core-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/org.jacoco.report-0.8.8.jar:/home/cassandra/cassandra/build/test/lib/jars/picocli-4.7.4.jar:/home/cassandra/cassandra/build/test/lib/jars/quicktheories-0.26.jar:/home/cassandra/cassandra/build/test/lib/jars/randomizedtesting-runner-2.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/reflections-0.10.2.jar:/home/cassandra/cassandra/build/test/lib/jars/semver4j-3.1.0.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-asm.jar:/home/cassandra/cassandra/build/test/lib/jars/simulator-bootstrap.jar:/home/cassandra/cassandra/build/test/lib/jars/slf4j-api-1.7.32.jar:/home/cassandra/cassandra/build/test/lib/jars/wiremock-jre8-2.35.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2-data.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlresolver-5.1.2.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-core-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-legacy-2.9.0.jar:/home/cassandra/cassandra/build/test/lib/jars/xmlunit-placeholders-2.9.0.jar:/home/cassandra/cassandra/build/test/stress-classes:/home/cassandra/cassandra/build/test/fqltool-classes:/home/cassandra/cassandra/test/conf:/home/cassandra/cassandra/build/classes/main:/usr/share/java/ant-launcher-1.10.7.jar INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,636 CassandraDaemon.java:622 - JVM Arguments: [-Dstorage-config=/home/cassandra/cassandra/test/conf, -Djava.awt.headless=true, -javaagent:/home/cassandra/cassandra/build/lib/jars/jamm-0.4.0.jar, -ea, -Djava.io.tmpdir=/home/cassandra/cassandra/build/tmp, -Dcassandra.debugrefcount=true, -Xss384k, -XX:SoftRefLRUPolicyMSPerMB=0, -XX:ActiveProcessorCount=2, -XX:HeapDumpPath=/home/cassandra/cassandra/build/test, -Dcassandra.test.driver.connection_timeout_ms=10000, -Dcassandra.test.driver.read_timeout_ms=24000, -Dcassandra.memtable_row_overhead_computation_step=100, -Dcassandra.test.use_prepared=true, -Dcassandra.test.sstableformatdevelopment=true, -Djava.security.egd=file:/dev/urandom, -Dcassandra.testtag=_jdk17_x86_64, -Dcassandra.keepBriefBrief=true, -Dcassandra.strict.runtime.checks=true, -Dcassandra.reads.thresholds.coordinator.defensive_checks_enabled=true, -Dcassandra.test.flush_local_schema_changes=false, -Dcassandra.test.messagingService.nonGracefulShutdown=true, -Dcassandra.use_nix_recursive_delete=true, -Dio.netty.allocator.useCacheForAllThreads=true, -Dio.netty.allocator.maxOrder=11, -Djdk.attach.allowAttachSelf=true, -XX:+UseG1GC, -XX:+ParallelRefProcEnabled, -XX:MaxTenuringThreshold=1, -XX:G1HeapRegionSize=16m, --add-exports=java.base/jdk.internal.misc=ALL-UNNAMED, --add-exports=java.management.rmi/com.sun.jmx.remote.internal.rmi=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.server=ALL-UNNAMED, --add-exports=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, --add-exports=java.sql/java.sql=ALL-UNNAMED, --add-exports=java.base/java.lang.ref=ALL-UNNAMED, --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED, --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED, --add-exports=jdk.attach/sun.tools.attach=ALL-UNNAMED, --add-opens=java.base/java.lang.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED, --add-opens=java.base/jdk.internal.math=ALL-UNNAMED, --add-opens=java.base/jdk.internal.module=ALL-UNNAMED, --add-opens=java.base/jdk.internal.util.jar=ALL-UNNAMED, --add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED, --add-opens=java.base/sun.nio.ch=ALL-UNNAMED, --add-opens=java.base/java.io=ALL-UNNAMED, --add-opens=java.base/java.lang.reflect=ALL-UNNAMED, --add-opens=jdk.compiler/com.sun.tools.javac=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.rmi/sun.rmi.transport.tcp=ALL-UNNAMED, -DQT_SHRINKS=0, -Dio.netty.tryReflectionSetAccessible=true, -Dlegacy-sstable-root=/home/cassandra/cassandra/test/data/legacy-sstables, -Dinvalid-legacy-sstable-root=/home/cassandra/cassandra/test/data/invalid-legacy-sstables, -Dcassandra.ring_delay_ms=1000, -Dcassandra.tolerate_sstable_size=true, -Dcassandra.skip_sync=true, -Xmx8G, -Xmx1024m] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,646 MonotonicClock.java:208 - Scheduling approximate time conversion task with an interval of 10000 milliseconds INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,646 MonotonicClock.java:344 - Scheduling approximate time-check task with a precision of 2 milliseconds INFO [node4_ScheduledTasks:1] node4 2024-07-04 05:22:19,714 StorageService.java:294 - Overriding RING_DELAY to 15000ms WARN 05:22:19 jemalloc shared library could not be preloaded to speed up memory allocations WARN [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,778 StartupChecks.java:259 - jemalloc shared library could not be preloaded to speed up memory allocations WARN 05:22:19 JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,782 StartupChecks.java:317 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info. WARN 05:22:19 The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" WARN [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,782 StartupChecks.java:374 - The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError="<cmd args>;<cmd args>" DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,790 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,790 FileUtil.java:113 - Reading file /proc/self/auxv DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,795 FileUtil.java:74 - Reading file /proc/stat DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,797 FileUtil.java:74 - Reading file /etc/os-release DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,798 LinuxOperatingSystem.java:438 - os-release: NAME="Ubuntu" DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,798 LinuxOperatingSystem.java:421 - os-release: VERSION="20.04.6 LTS (Focal Fossa)" DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,798 FileUtil.java:74 - Reading file /proc/version DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,802 FileUtil.java:74 - Reading file /proc/meminfo DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,804 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,805 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,805 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,805 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,805 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,805 FileUtil.java:74 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,806 FileUtil.java:319 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,806 FileUtil.java:74 - Reading file /proc/self/stat DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,806 FileUtil.java:344 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,806 FileUtil.java:74 - Reading file /proc/5322/io DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,806 FileUtil.java:344 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,806 FileUtil.java:74 - Reading file /proc/5322/status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,807 FileUtil.java:319 - Reading file /proc/5322/stat DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,807 FileUtil.java:74 - Reading file /proc/5322/stat WARN 05:22:19 Cassandra server running in degraded mode. Swap should be disabled. WARN [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,807 StartupChecks.java:427 - Cassandra server running in degraded mode. Swap should be disabled. WARN 05:22:19 Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. WARN [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,807 StartupChecks.java:555 - Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl. DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,808 StartupChecks.java:487 - No 'read_ahead_kb' setting found for device /dev/md1p1 of data directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data2. DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,810 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data1 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data2 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/commitlog DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/saved_caches DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,813 StartupChecks.java:575 - Checking directory /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/hints DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,916 InternalThreadLocalMap.java:100 - -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:19,916 InternalThreadLocalMap.java:101 - -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,117 ColumnFamilyStore.java:508 - Initializing system.IndexInfo DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,120 AbstractAllocatorMemtable.java:102 - Memtables allocating with on-heap slabs INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,199 ColumnFamilyStore.java:508 - Initializing system.batches INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,205 ColumnFamilyStore.java:508 - Initializing system.paxos INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,211 SecondaryIndexManager.java:227 - Index [PaxosUncommittedIndex] registered and writable. INFO [node4_SecondaryIndexManagement:1] node4 2024-07-04 05:22:20,219 SecondaryIndexManager.java:1862 - Index [PaxosUncommittedIndex] became queryable after successful build. INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,241 ColumnFamilyStore.java:508 - Initializing system.paxos_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,244 ColumnFamilyStore.java:508 - Initializing system.local INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,247 ColumnFamilyStore.java:508 - Initializing system.peers_v2 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,250 ColumnFamilyStore.java:508 - Initializing system.peers INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,253 ColumnFamilyStore.java:508 - Initializing system.peer_events_v2 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,256 ColumnFamilyStore.java:508 - Initializing system.peer_events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,261 ColumnFamilyStore.java:508 - Initializing system.compaction_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,265 ColumnFamilyStore.java:508 - Initializing system.sstable_activity INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,268 ColumnFamilyStore.java:508 - Initializing system.sstable_activity_v2 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,271 ColumnFamilyStore.java:508 - Initializing system.size_estimates INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,276 ColumnFamilyStore.java:508 - Initializing system.table_estimates INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,280 ColumnFamilyStore.java:508 - Initializing system.available_ranges_v2 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,283 ColumnFamilyStore.java:508 - Initializing system.available_ranges INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,287 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges_v2 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,291 ColumnFamilyStore.java:508 - Initializing system.transferred_ranges INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,295 ColumnFamilyStore.java:508 - Initializing system.view_builds_in_progress INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,298 ColumnFamilyStore.java:508 - Initializing system.built_views INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,302 ColumnFamilyStore.java:508 - Initializing system.prepared_statements INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,305 ColumnFamilyStore.java:508 - Initializing system.repairs INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,307 ColumnFamilyStore.java:508 - Initializing system.top_partitions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,310 ColumnFamilyStore.java:508 - Initializing system.local_metadata_log DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,310 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,311 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,313 ColumnFamilyStore.java:508 - Initializing system.metadata_snapshots INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,332 QueryProcessor.java:156 - Initialized prepared statement caches with 10 MiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,408 ColumnFamilyStore.java:508 - Initializing system_schema.keyspaces INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,410 ColumnFamilyStore.java:508 - Initializing system_schema.tables INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,413 ColumnFamilyStore.java:508 - Initializing system_schema.columns INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,416 ColumnFamilyStore.java:508 - Initializing system_schema.column_masks INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,419 ColumnFamilyStore.java:508 - Initializing system_schema.triggers INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,421 ColumnFamilyStore.java:508 - Initializing system_schema.dropped_columns INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,424 ColumnFamilyStore.java:508 - Initializing system_schema.views INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,426 ColumnFamilyStore.java:508 - Initializing system_schema.types INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,429 ColumnFamilyStore.java:508 - Initializing system_schema.functions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,431 ColumnFamilyStore.java:508 - Initializing system_schema.aggregates INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,434 ColumnFamilyStore.java:508 - Initializing system_schema.indexes INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,439 FileSystemOwnershipCheck.java:125 - Filesystem ownership check is not enabled. DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,439 CassandraDaemon.java:514 - opening keyspace system DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,440 CassandraDaemon.java:514 - opening keyspace system_schema DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,440 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,446 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,446 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,447 Startup.java:504 - hasAnyEpoch = false, hasBootedBefore = false INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,447 Startup.java:108 - Initializing for discovery DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,494 NativeLibraryLoader.java:78 - -Dio.netty.native.workdir: /home/cassandra/cassandra/build/tmp (io.netty.tmpdir) DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,494 NativeLibraryLoader.java:83 - -Dio.netty.native.deleteLibAfterLoading: true DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,494 NativeLibraryLoader.java:87 - -Dio.netty.native.tryPatchShadedId: true DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,494 NativeLibraryLoader.java:91 - -Dio.netty.native.detectNativeLibraryDuplicates: true DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,498 NativeLibraryLoader.java:389 - Successfully loaded the library /home/cassandra/cassandra/build/tmp/libnetty_transport_native_epoll_x86_6414911643716341877396.so DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,500 NetUtil.java:148 - -Djava.net.preferIPv4Stack: false DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,500 NetUtil.java:149 - -Djava.net.preferIPv6Addresses: false DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,501 NetUtilInitializations.java:145 - Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,501 NetUtil.java:188 - /proc/sys/net/core/somaxconn: 4096 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,501 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Messaging-AcceptLoop DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,504 MultithreadEventLoopGroup.java:44 - -Dio.netty.eventLoopThreads: 4 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,508 GlobalEventExecutor.java:53 - -Dio.netty.globalEventExecutor.quietPeriodSeconds: 1 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,518 PlatformDependent.java:1010 - org.jctools-core.MpscChunkedArrayQueue: available DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,521 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix node4_Messaging-EventLoop DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,521 SocketFactory.java:154 - using netty EPOLL event loop for pool prefix Streaming-EventLoop DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,567 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=0: []} INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,569 StorageService.java:494 - Initializing storage service mbean INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,570 StreamManager.java:267 - Storing streaming state for 3d or for size 41943040 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,578 LocalLog.java:621 - Marking LocalLog ready at epoch Epoch{epoch=0} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,578 LocalLog.java:626 - Marking LocalLog ready at epoch Epoch{epoch=0} INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,578 LocalLog.java:629 - Adding default listeners to LocalLog INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,583 LocalLog.java:640 - Notifying all registered listeners of both pre and post commit event INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,583 LocalLog.java:579 - Notifying listeners, prev epoch = Epoch{epoch=0}, current epoch = Epoch{epoch=0} INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,587 ColumnFamilyStore.java:508 - Initializing system_cluster_metadata.distributed_metadata_log DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,588 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,588 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_COMMIT-LOG-WRITER] node4 2024-07-04 05:22:20,607 SyncUtil.java:56 - Skip fsync enabled due to property true and environment false INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,611 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 3.577KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:20,679 Flushing.java:153 - Writing Memtable-columns@1423622747(735B serialized bytes, 4 ops, 3.577KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:20,683 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db (334B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=1479) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,749 CacheService.java:121 - Initializing key cache with capacity of 50 MiBs. INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,756 CacheService.java:143 - Initializing row cache with capacity of 0 MiBs INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,757 CacheService.java:172 - Initializing counter cache with capacity of 50 MiBs INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,757 CacheService.java:183 - Scheduling counter cache save to every 7200 seconds (going to save all keys). INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,770 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_631fe570-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,789 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,790 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-1-big-Data.db')] (1 sstables, 5.661KiB), biggest 5.661KiB, smallest 5.661KiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,791 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 3.007KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:20,804 Flushing.java:153 - Writing Memtable-tables@1561534587(868B serialized bytes, 1 ops, 3.007KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:20,804 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db (524B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=1479) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,826 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_633ac070-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,828 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,828 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-1-big-Data.db')] (1 sstables, 7.204KiB), biggest 7.204KiB, smallest 7.204KiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,828 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 790B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:20,832 Flushing.java:153 - Writing Memtable-keyspaces@130474988(151B serialized bytes, 1 ops, 790B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:20,833 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db (116B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=1479) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,846 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_63408cd0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,848 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:20,849 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db')] (1 sstables, 5.336KiB), biggest 5.336KiB, smallest 5.336KiB DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,849 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,869 InboundConnectionInitiator.java:160 - Listening on address: (/127.0.0.4:7012), nic: null, encryption: unencrypted DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,882 ResourceLeakDetector.java:129 - -Dio.netty.leakDetection.level: simple DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,882 ResourceLeakDetector.java:130 - -Dio.netty.leakDetection.targetRecords: 4 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,885 BufferPools.java:49 - Global buffer pool limit is 256.000MiB for chunk-cache and 64.000MiB for networking DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,888 DefaultChannelId.java:79 - -Dio.netty.processId: 5322 (auto-detected) DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,888 DefaultChannelId.java:101 - -Dio.netty.machineId: 02:42:ac:ff:fe:11:00:03 (auto-detected) DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,899 PooledByteBufAllocator.java:157 - -Dio.netty.allocator.numHeapArenas: 4 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,899 PooledByteBufAllocator.java:158 - -Dio.netty.allocator.numDirectArenas: 4 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:160 - -Dio.netty.allocator.pageSize: 8192 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:165 - -Dio.netty.allocator.maxOrder: 11 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:169 - -Dio.netty.allocator.chunkSize: 16777216 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:170 - -Dio.netty.allocator.smallCacheSize: 256 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:171 - -Dio.netty.allocator.normalCacheSize: 64 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:172 - -Dio.netty.allocator.maxCachedBufferCapacity: 32768 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:173 - -Dio.netty.allocator.cacheTrimInterval: 8192 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:174 - -Dio.netty.allocator.cacheTrimIntervalMillis: 0 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:175 - -Dio.netty.allocator.useCacheForAllThreads: true DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,900 PooledByteBufAllocator.java:176 - -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,906 ByteBufUtil.java:89 - -Dio.netty.allocator.type: pooled DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,906 ByteBufUtil.java:98 - -Dio.netty.threadLocalDirectBufferSize: 0 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,906 ByteBufUtil.java:101 - -Dio.netty.maxThreadLocalCharBufferSize: 16384 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,914 Startup.java:205 - Discovering other nodes in the system DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,914 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:20,915 MessageDelivery.java:66 - Election for metadata migration sending TCM_DISCOVER_REQ (org.apache.cassandra.net.NoPayload@68c6e508) to /127.0.0.1:7012 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,956 AbstractByteBuf.java:63 - -Dio.netty.buffer.checkAccessible: true DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,956 AbstractByteBuf.java:64 - -Dio.netty.buffer.checkBounds: true DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,956 ResourceLeakDetectorFactory.java:196 - Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@5ff8df2a DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,958 Recycler.java:96 - -Dio.netty.recycler.maxCapacityPerThread: 4096 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,958 Recycler.java:97 - -Dio.netty.recycler.ratio: 8 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,958 Recycler.java:98 - -Dio.netty.recycler.chunkSize: 32 DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,958 Recycler.java:99 - -Dio.netty.recycler.blocking: false DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,958 Recycler.java:100 - -Dio.netty.recycler.batchFastThreadLocalOnly: true INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:20,960 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:48840)->/127.0.0.1:7012-URGENT_MESSAGES-2a79f9ea messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:20,972 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:48840)->/127.0.0.1:7012-URGENT_MESSAGES-f447d29a successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:20,974 Discovery.java:182 - Responding to discovery request from /127.0.0.4:7012: [/127.0.0.1:7012] INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:20,981 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:36968)->/127.0.0.4:7012-URGENT_MESSAGES-6c19bf7e successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:22:20,987 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:36968)->/127.0.0.4:7012-URGENT_MESSAGES-b18d0fb8 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_InternalMetadataStage:1] node4 2024-07-04 05:22:20,990 MessageDelivery.java:52 - Received a TCM_DISCOVER_RSP response from /127.0.0.1:7012: DiscoveredNodes{nodes=[/127.0.0.1:7012], kind=CMS_ONLY} INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:21,008 FetchCMSLog.java:119 - Responding to /127.0.0.4:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=0}}) with log delta: LogState{baseState=none , entries=11: Epoch{epoch=1} -> Epoch{epoch=11}} INFO [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:22:21,027 RemoteProcessor.java:178 - Replay request returned replay data: LogState{baseState=none , entries=11: Epoch{epoch=1} -> Epoch{epoch=11}} DEBUG [node4_MetadataFetchLogStage:1] node4 2024-07-04 05:22:21,027 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=11: Epoch{epoch=1} -> Epoch{epoch=11}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,030 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 747B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,035 Flushing.java:153 - Writing Memtable-local_metadata_log@782397094(103B serialized bytes, 1 ops, 747B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,036 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db (34B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=1679) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,078 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_635f3860-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,084 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,084 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db')] (1 sstables, 5.079KiB), biggest 5.079KiB, smallest 5.079KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,084 LocalLog.java:492 - Enacted PreInitialize{addr=null}. New tail is Epoch{epoch=1} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,084 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,096 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 2.038KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,103 Flushing.java:153 - Writing Memtable-local_metadata_log@573984964(1.409KiB serialized bytes, 1 ops, 2.038KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,103 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db (1.344KiB) for commitlog position CommitLogPosition(segmentId=1720070539656, position=3129) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,151 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63697190-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,157 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,157 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db')] (1 sstables, 5.754KiB), biggest 5.754KiB, smallest 5.754KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,160 ColumnFamilyStore.java:508 - Initializing system_auth.roles INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,163 ColumnFamilyStore.java:508 - Initializing system_auth.role_members INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,166 ColumnFamilyStore.java:508 - Initializing system_auth.role_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,170 ColumnFamilyStore.java:508 - Initializing system_auth.resource_role_permissons_index INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,173 ColumnFamilyStore.java:508 - Initializing system_auth.network_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,176 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_permissions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,179 ColumnFamilyStore.java:508 - Initializing system_auth.cidr_groups INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,181 ColumnFamilyStore.java:508 - Initializing system_auth.identity_to_role INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,185 ColumnFamilyStore.java:508 - Initializing system_distributed.repair_history DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,185 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,185 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,188 ColumnFamilyStore.java:508 - Initializing system_distributed.parent_repair_history DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,188 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,188 TimeWindowCompactionStrategy.java:77 - Disabling tombstone compactions for TWCS INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,191 ColumnFamilyStore.java:508 - Initializing system_distributed.view_build_status INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,194 ColumnFamilyStore.java:508 - Initializing system_distributed.partition_denylist INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,197 ColumnFamilyStore.java:508 - Initializing system_traces.sessions INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,200 ColumnFamilyStore.java:508 - Initializing system_traces.events INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,230 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 54.690KiB (1%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,240 Flushing.java:153 - Writing Memtable-columns@1717742593(11.795KiB serialized bytes, 68 ops, 54.690KiB (1%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,246 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db (4.852KiB) for commitlog position CommitLogPosition(segmentId=1720070539656, position=16149) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,292 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_637dbce0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,297 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,297 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-2-big-Data.db')] (1 sstables, 7.229KiB), biggest 7.229KiB, smallest 7.229KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,298 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 36.350KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,308 Flushing.java:153 - Writing Memtable-tables@1443621538(11.222KiB serialized bytes, 14 ops, 36.350KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,309 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db (6.287KiB) for commitlog position CommitLogPosition(segmentId=1720070539656, position=16149) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,349 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_63881d20-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,351 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,351 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-2-big-Data.db')] (1 sstables, 8.058KiB), biggest 8.058KiB, smallest 8.058KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,351 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 2.290KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,355 Flushing.java:153 - Writing Memtable-keyspaces@1809934747(471B serialized bytes, 3 ops, 2.290KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,356 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db (339B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=16149) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,369 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_63905a80-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,372 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,372 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db')] (1 sstables, 5.359KiB), biggest 5.359KiB, smallest 5.359KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,372 LocalLog.java:492 - Enacted Initialize{baseState = Epoch{epoch=1}}. New tail is Epoch{epoch=2} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,374 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,380 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,388 Flushing.java:153 - Writing Memtable-local_metadata_log@2067899475(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,388 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=16414) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,411 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_6394a040-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,416 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,416 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db')] (1 sstables, 5.138KiB), biggest 5.138KiB, smallest 5.138KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,417 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.1:7012, localAddress=/127.0.0.1:7012, nativeAddress=/127.0.0.1:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=3} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,417 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:21,425 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0)} DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:22:21,426 PeersTable.java:154 - NodeId{id=1} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,435 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,442 Flushing.java:153 - Writing Memtable-local_metadata_log@145755550(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,442 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=16535) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,497 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_639d04b0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,509 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,509 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,509 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=1}, tokens=[10], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=4} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,510 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=1},JOIN)] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:21,513 Gossiper.java:2197 - Updated epstates for /127.0.0.1:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.1,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,0), TOKENS=Value(10,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,0), STATUS_WITH_PORT=Value(NORMAL,10,0)} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,513 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,527 Flushing.java:153 - Writing Memtable-local_metadata_log@31963344(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,527 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=16709) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,601 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63a912a0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,617 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,617 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,617 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.3:7012, localAddress=/127.0.0.3:7012, nativeAddress=/127.0.0.3:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=5} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,617 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:21,618 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0)} DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:22:21,618 PeersTable.java:154 - NodeId{id=2} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,634 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,649 Flushing.java:153 - Writing Memtable-local_metadata_log@1630188742(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,649 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=17337) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,666 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63bb6220-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,669 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,670 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,670 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=2}, tokens=[30], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=6} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,670 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=2},JOIN)] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:21,673 Gossiper.java:2197 - Updated epstates for /127.0.0.3:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.3,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,0), TOKENS=Value(30,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,0), STATUS_WITH_PORT=Value(NORMAL,30,0)} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,674 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,683 Flushing.java:153 - Writing Memtable-local_metadata_log@390068108(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,684 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=17779) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,729 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63c1a3b0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,734 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,734 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,735 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.2:7012, localAddress=/127.0.0.2:7012, nativeAddress=/127.0.0.2:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=7} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,735 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:21,736 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0)} DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:22:21,736 PeersTable.java:154 - NodeId{id=3} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,748 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,755 Flushing.java:153 - Writing Memtable-local_metadata_log@535544840(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,756 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=18139) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,800 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63ccc740-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,805 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,806 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db')] (1 sstables, 5.096KiB), biggest 5.096KiB, smallest 5.096KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,806 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=3}, tokens=[20], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=8} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,806 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=3},JOIN)] DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:21,808 Gossiper.java:2197 - Updated epstates for /127.0.0.2:7012: EndpointState: HeartBeatState = HeartBeat: generation = 0, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-000000000002,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.2,0), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,0), TOKENS=Value(20,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,0), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,0), STATUS_WITH_PORT=Value(NORMAL,20,0)} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,811 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 919B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,821 Flushing.java:153 - Writing Memtable-local_metadata_log@594988573(275B serialized bytes, 1 ops, 919B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,822 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db (208B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=18928) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,864 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63d66430-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,873 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,873 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db')] (1 sstables, 5.227KiB), biggest 5.227KiB, smallest 5.227KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,876 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 806B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,885 Flushing.java:153 - Writing Memtable-keyspaces@391037489(157B serialized bytes, 1 ops, 806B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,886 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db (124B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=19125) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,931 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_63e04f40-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,936 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,936 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db')] (1 sstables, 5.355KiB), biggest 5.355KiB, smallest 5.355KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,936 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (distributed_test_keyspace)}. New tail is Epoch{epoch=9} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,937 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,940 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,941 NetworkTopologyStrategy.java:369 - Configured datacenter replicas are dc0:rf(3/1) DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,941 AlterSchema.java:192 - Schema change affects data placements, relevant keyspaces: [KeyspaceMetadata{name=tr, kind=REGULAR, params=KeyspaceParams{durable_writes=true, replication=ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}}, tables=[], views=[], functions=[], types=[]}] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,946 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 869B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,956 Flushing.java:153 - Writing Memtable-local_metadata_log@2141570243(225B serialized bytes, 1 ops, 869B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,956 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db (157B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=19447) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,972 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63eafda0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,974 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,974 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db')] (1 sstables, 5.204KiB), biggest 5.204KiB, smallest 5.204KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,977 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,984 Flushing.java:153 - Writing Memtable-keyspaces@1051694267(153B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:21,985 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=19617) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,995 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_63efb890-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,997 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:21,997 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db')] (1 sstables, 5.194KiB), biggest 5.194KiB, smallest 5.194KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,997 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateKeyspaceStatement (tr)}. New tail is Epoch{epoch=10} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:21,998 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,007 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 1.585KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,032 Flushing.java:153 - Writing Memtable-local_metadata_log@725398357(979B serialized bytes, 1 ops, 1.585KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,032 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db (912B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=20694) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,084 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_63f44c70-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,096 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,096 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db')] (1 sstables, 5.709KiB), biggest 5.709KiB, smallest 5.709KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,099 ColumnFamilyStore.java:508 - Initializing tr.x INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,113 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.column_masks, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,119 Flushing.java:153 - Writing Memtable-column_masks@1250079561(32B serialized bytes, 1 ops, 578B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,120 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db (17B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=21778) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,162 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa_txn_flush_64047910-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,168 CompactionManager.java:236 - Autocompaction on system_schema.column_masks is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,168 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/column_masks-738cc5ed01683268b9d1853d4bc278af/oa-1-big-Data.db')] (1 sstables, 5.074KiB), biggest 5.074KiB, smallest 5.074KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,168 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.columns, Reason: INTERNALLY_FORCED, Usage: 1.138KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,181 Flushing.java:153 - Writing Memtable-columns@466674950(159B serialized bytes, 1 ops, 1.138KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,181 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db (52B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=21778) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,222 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa_txn_flush_640cdd80-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,233 CompactionManager.java:236 - Autocompaction on system_schema.columns is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,233 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/oa-3-big-Data.db')] (1 sstables, 5.344KiB), biggest 5.344KiB, smallest 5.344KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,234 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.tables, Reason: INTERNALLY_FORCED, Usage: 2.894KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,247 Flushing.java:153 - Writing Memtable-tables@1503178891(773B serialized bytes, 1 ops, 2.894KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,247 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db (406B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=21778) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,296 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa_txn_flush_6416efa0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,303 CompactionManager.java:236 - Autocompaction on system_schema.tables is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,303 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/oa-3-big-Data.db')] (1 sstables, 6.947KiB), biggest 6.947KiB, smallest 6.947KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,304 ColumnFamilyStore.java:1060 - Enqueuing flush of system_schema.keyspaces, Reason: INTERNALLY_FORCED, Usage: 755B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,308 Flushing.java:153 - Writing Memtable-keyspaces@393221878(153B serialized bytes, 1 ops, 755B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:22,308 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db (97B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=21778) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,328 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa_txn_flush_64219e00-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,330 CompactionManager.java:236 - Autocompaction on system_schema.keyspaces is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:22,330 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db')] (1 sstables, 5.194KiB), biggest 5.194KiB, smallest 5.194KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,331 LocalLog.java:492 - Enacted AlterSchema{schemaTransformation=CreateTableStatement (tr, x)}. New tail is Epoch{epoch=11} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:22,331 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,337 CassandraDaemon.java:514 - opening keyspace distributed_test_keyspace DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,337 CassandraDaemon.java:514 - opening keyspace system_auth DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,337 CassandraDaemon.java:514 - opening keyspace system_cluster_metadata DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,337 CassandraDaemon.java:514 - opening keyspace system_distributed DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,338 CassandraDaemon.java:514 - opening keyspace system_traces DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,338 CassandraDaemon.java:514 - opening keyspace tr DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,340 TestChangeListener.java:42 - Registered TestChangeListener DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,404 LogMessagesTable.java:90 - capacity of virtual table system_views.system_logs is set to be at most 50000 rows INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,423 CommitLog.java:200 - No commitlog files found; skipping replay INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,429 PaxosStateTracker.java:165 - Beginning uncommitted paxos data rebuild. Set -Dcassandra.skip_paxos_state_rebuild=true and restart to skip INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,430 PaxosUncommittedTracker.java:225 - truncating paxos uncommitted info INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,430 PaxosUncommittedTracker.java:235 - enabling PaxosUncommittedTracker DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,431 PaxosBallotTracker.java:184 - Not updating lower bound with earlier or equal ballot from 13814000-1dd2-11b2-0000-000000000000 to null INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,431 PaxosStateTracker.java:304 - Uncommitted paxos data rebuild completed INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,433 StorageService.java:702 - Cassandra version: 5.1-SNAPSHOT INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,433 StorageService.java:703 - Git SHA: e7cf38b5de6f804ce121e7a676576135db0c4bb1 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,433 StorageService.java:704 - CQL version: 3.4.8 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,433 StorageService.java:705 - Native protocol supported versions: 3/v3, 4/v4, 5/v5, 6/v6-beta (default: 5/v5) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,450 IndexSummaryManager.java:105 - Initializing index summary manager with a memory pool size of 50 MB and a resize interval of 60 minutes INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,507 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 2.163KiB (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:23,514 Flushing.java:153 - Writing Memtable-local@1211623338(462B serialized bytes, 7 ops, 2.163KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:23,514 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db (230B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=66040) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:23,559 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_64d95540-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:23,564 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:23,564 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db')] (1 sstables, 5.886KiB), biggest 5.886KiB, smallest 5.886KiB DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,564 SimpleSeedProvider.java:99 - Only resolving one IP per DNS record - 127.0.0.1:7012 resolves to /127.0.0.1:7012 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,565 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,566 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,566 Gossiper.java:2216 - Triggering gossip round with CMS Epoch{epoch=11} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,569 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,571 Gossiper.java:1197 - Node /127.0.0.2:7012 has restarted, now UP INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,575 StorageService.java:2121 - Node /127.0.0.2:7012 state jump to NORMAL INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:23,576 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:45130)->/127.0.0.2:7012-URGENT_MESSAGES-c262dc4d successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:23,576 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:45130)->/127.0.0.2:7012-URGENT_MESSAGES-818a9e49 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:22:23,578 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:39180)->/127.0.0.4:7012-URGENT_MESSAGES-193e9c64 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:23,578 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:39180)->/127.0.0.4:7012-URGENT_MESSAGES-e4942fac successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,581 Gossiper.java:1197 - Node /127.0.0.3:7012 has restarted, now UP INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,582 StorageService.java:2121 - Node /127.0.0.3:7012 state jump to NORMAL INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:23,584 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:41442)->/127.0.0.3:7012-URGENT_MESSAGES-888f5bd5 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:23,584 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:41442)->/127.0.0.3:7012-URGENT_MESSAGES-e4f46ff0 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,586 Gossiper.java:1197 - Node /127.0.0.1:7012 has restarted, now UP INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,587 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:23,587 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:39192)->/127.0.0.4:7012-URGENT_MESSAGES-a9b687cf successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:22:23,587 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:39192)->/127.0.0.4:7012-URGENT_MESSAGES-2c79cdac messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,587 StorageService.java:2121 - Node /127.0.0.1:7012 state jump to NORMAL INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:23,590 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:45726)->/127.0.0.1:7012-URGENT_MESSAGES-d3a59821 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:23,590 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:45726)->/127.0.0.1:7012-URGENT_MESSAGES-d7099e76 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,593 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:22:23,593 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:23,593 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,593 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:23,593 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:23,593 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:23,593 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:23,593 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,593 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:23,593 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,593 Gossiper.java:1139 - InetAddress /127.0.0.1:7012 is now UP DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:23,593 Gossiper.java:511 - Convicting /127.0.0.2:7012 with status NORMAL - alive true INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,594 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,594 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,594 FailureDetector.java:389 - Forcing conviction of /127.0.0.3:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:23,594 Gossiper.java:511 - Convicting /127.0.0.3:7012 with status NORMAL - alive true INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,594 Gossiper.java:1154 - InetAddress /127.0.0.3:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:22:23,594 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.3:7012 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:23,594 Gossiper.java:1940 - Waiting for gossip to settle... DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:23,594 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node1_GossipStage:1] node1 2024-07-04 05:22:23,594 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP INFO [node3_GossipStage:1] node3 2024-07-04 05:22:24,332 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:24,333 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:24,333 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:24,333 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:24,337 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:41448)->/127.0.0.3:7012-URGENT_MESSAGES-2b0254ce successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-2] node3 2024-07-04 05:22:24,337 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:41448)->/127.0.0.3:7012-URGENT_MESSAGES-3f19d068 messaging connection established, version = 14, framing = CRC, encryption = unencrypted DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:24,339 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:24,339 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:24,570 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:45140)->/127.0.0.2:7012-URGENT_MESSAGES-79f04ec6 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:24,570 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:45140)->/127.0.0.2:7012-URGENT_MESSAGES-2fa632a4 successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:24,575 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:24,575 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:24,575 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:24,575 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:24,577 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:24,577 Gossiper.java:1139 - InetAddress /127.0.0.2:7012 is now UP INFO [node2_GossipStage:1] node2 2024-07-04 05:22:24,577 Gossiper.java:1199 - Node /127.0.0.4:7012 is now part of the cluster DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:24,577 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.3:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:24,578 Gossiper.java:1139 - InetAddress /127.0.0.3:7012 is now UP DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:24,578 StorageService.java:2130 - Ignoring application state NET_VERSION from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:24,578 StorageService.java:2130 - Ignoring application state INTERNAL_ADDRESS_AND_PORT from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:24,578 StorageService.java:2130 - Ignoring application state SSTABLE_VERSIONS from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:24,580 Gossiper.java:1138 - removing expire time for endpoint : /127.0.0.4:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:22:24,580 Gossiper.java:1139 - InetAddress /127.0.0.4:7012 is now UP DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:24,895 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 42, AppStateMap = {LOAD=Value(226436.0,38), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 66, AppStateMap = {LOAD=Value(136141.0,44), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,33), TOKENS=Value(20,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,36), STATUS_WITH_PORT=Value(NORMAL,20,37), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 66, AppStateMap = {LOAD=Value(62839.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 14, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,9), NET_VERSION=Value(14,11), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), SSTABLE_VERSIONS=Value(big-oa,13)}} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,196 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 42, AppStateMap = {LOAD=Value(226436.0,38), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 66, AppStateMap = {LOAD=Value(136141.0,44), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,33), TOKENS=Value(20,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,36), STATUS_WITH_PORT=Value(NORMAL,20,37), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 66, AppStateMap = {LOAD=Value(62839.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 14, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,9), NET_VERSION=Value(14,11), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), SSTABLE_VERSIONS=Value(big-oa,13)}} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,496 Gossiper.java:1952 - Gossip looks settled. {/127.0.0.1:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070535, version = 42, AppStateMap = {LOAD=Value(226436.0,38), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,15), DC=Value(dc0,16), RACK=Value(rack0,17), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,18), NET_VERSION=Value(14,31), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000001,20), TOKENS=Value(10,21), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.1:7012,27), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.1:9042,23), STATUS_WITH_PORT=Value(NORMAL,10,24), SSTABLE_VERSIONS=Value(big-oa,33)}, /127.0.0.2:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 66, AppStateMap = {LOAD=Value(136141.0,44), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,29), RACK=Value(rack0,30), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,31), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000003,33), TOKENS=Value(20,34), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.2:7012,35), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.2:9042,36), STATUS_WITH_PORT=Value(NORMAL,20,37), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.3:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070520, version = 66, AppStateMap = {LOAD=Value(62839.0,41), SCHEMA=Value(00000000-0000-0000-0000-00000000000b,49), DC=Value(dc0,28), RACK=Value(rack0,29), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,30), NET_VERSION=Value(14,8), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000002,32), TOKENS=Value(30,33), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.3:7012,34), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.3:9042,35), STATUS_WITH_PORT=Value(NORMAL,30,36), SSTABLE_VERSIONS=Value(big-oa,10)}, /127.0.0.4:7012=EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 14, AppStateMap = {INTERNAL_IP=Value(127.0.0.4,9), NET_VERSION=Value(14,11), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), SSTABLE_VERSIONS=Value(big-oa,13)}} INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,497 Gossiper.java:1971 - No gossip backlog; proceeding INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:25,562 Commit.java:366 - Received commit request Commit{transformation=Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}, lastKnown=Epoch{epoch=11}} from /127.0.0.4:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:25,593 AbstractLocalProcessor.java:98 - Committed Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New epoch is Epoch{epoch=12} DEBUG [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:25,593 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=12} INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:25,595 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 813B (0%) on-heap, 0B (0%) off-heap INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:25,616 Flushing.java:153 - Writing Memtable-local_metadata_log@1303666286(168B serialized bytes, 1 ops, 813B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:25,617 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=66890) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:25,656 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,656 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,656 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:25,656 LocalLog.java:492 - Enacted EXECUTED {Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}}. New tail is Epoch{epoch=12} DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,656 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db'),832), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),1248)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:25,656 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:25,657 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,13)} DEBUG [node1_OptionalTasks:1] node1 2024-07-04 05:22:25,657 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,657 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617894239846 bytes available, checking if we can write 2861 bytes INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,657 CompactionTask.java:167 - Compacting (66211780-39c5-11ef-b7b7-07b030bb45ab) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db:level=0, ] INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:25,658 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:25,658 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} to /127.0.0.2:7012 INFO [node1_InternalMetadataStage:2] node1 2024-07-04 05:22:25,658 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=12}, logState=LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}}} to sender /127.0.0.4:7012 INFO [node3_InternalMetadataStage:1] node3 2024-07-04 05:22:25,659 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:1] node3 2024-07-04 05:22:25,659 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node2_InternalMetadataStage:1] node2 2024-07-04 05:22:25,659 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:1] node2 2024-07-04 05:22:25,659 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:25,660 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 814B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:25,660 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 810B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,660 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=12} -> Epoch{epoch=12}} INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:25,662 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 812B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:25,669 Flushing.java:153 - Writing Memtable-local_metadata_log@1989855296(168B serialized bytes, 1 ops, 814B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:25,669 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=87557) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:25,670 Flushing.java:153 - Writing Memtable-local_metadata_log@1066461032(168B serialized bytes, 1 ops, 810B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,670 Flushing.java:153 - Writing Memtable-local_metadata_log@1423168383(168B serialized bytes, 1 ops, 812B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:25,671 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=86206) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,671 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db (99B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=67855) INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,731 CompactionTask.java:258 - Compacted (66211780-39c5-11ef-b7b7-07b030bb45ab) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-17-big,] to level=0. 2.794KiB to 1.776KiB (~63% of original) in 71ms. Read Throughput = 38.806KiB/s, Write Throughput = 24.672KiB/s, Row Throughput = ~24/s. 15 total partitions merged to 12. Partition merge counts were {1:9, 2:3, }. Time spent writing keys = 14ms DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,731 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,731 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:25,731 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:25,733 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:25,734 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:25,735 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,737 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_662228f0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:25,748 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:25,748 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:25,749 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:25,749 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=12} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:25,749 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:25,750 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,13)} DEBUG [node2_OptionalTasks:1] node2 2024-07-04 05:22:25,750 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,756 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,756 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db')] (1 sstables, 5.140KiB), biggest 5.140KiB, smallest 5.140KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:25,756 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=12} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:25,756 ClientNotificationListener.java:55 - Maybe notify listeners about [] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,757 Register.java:122 - Registering with endpoint /127.0.0.4:7012 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,758 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:25,760 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db')] (1 sstables, 5.155KiB), biggest 5.155KiB, smallest 5.155KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,760 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_OptionalTasks:1] node4 2024-07-04 05:22:25,759 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,760 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:25,760 LocalLog.java:492 - Enacted Register{addresses=NodeAddresses{broadcastAddress=/127.0.0.4:7012, localAddress=/127.0.0.4:7012, nativeAddress=/127.0.0.4:9042}, location=dc0/rack0, version=NodeVersion{cassandraVersion=5.1.0-SNAPSHOT, serializationVersion=2}}. New tail is Epoch{epoch=12} DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,760 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),1169), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),164)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:25,760 ClientNotificationListener.java:55 - Maybe notify listeners about [] DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,760 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617894204826 bytes available, checking if we can write 2114 bytes INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,761 CompactionTask.java:167 - Compacting (6630f600-39c5-11ef-a1c9-4b8e7a2da833) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big-Data.db:level=0, ] DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:25,761 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), SSTABLE_VERSIONS=Value(big-oa,13)} DEBUG [node3_OptionalTasks:1] node3 2024-07-04 05:22:25,761 PeersTable.java:154 - NodeId{id=4} is in pre-join state REGISTERED, not updating system.peers_v2 table INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,771 Flushing.java:153 - Writing Memtable-local@1221803398(65B serialized bytes, 1 ops, 578B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,771 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db (30B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=67939) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,847 CompactionTask.java:258 - Compacted (6630f600-39c5-11ef-a1c9-4b8e7a2da833) 4 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big,] to level=0. 2.064KiB to 1.771KiB (~85% of original) in 85ms. Read Throughput = 24.217KiB/s, Write Throughput = 20.780KiB/s, Row Throughput = ~24/s. 12 total partitions merged to 12. Partition merge counts were {1:12, }. Time spent writing keys = 17ms DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,847 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:25,847 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:25,847 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:25,849 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:25,850 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:25,852 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,859 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_6630a7e0-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,862 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,862 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db')] (1 sstables, 4.977KiB), biggest 4.977KiB, smallest 4.977KiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,862 Register.java:136 - New node ID obtained 6d194555-f6eb-41d0-c000-000000000004, (Note: This should happen exactly once per node) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,865 BootStrapper.java:256 - tokens manually specified as [40] INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,866 Flushing.java:153 - Writing Memtable-local@1594049996(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,866 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=68021) INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:25,866 Commit.java:366 - Received commit request Commit{transformation=UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}, lastKnown=Epoch{epoch=12}} from /127.0.0.4:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:25,886 AbstractLocalProcessor.java:98 - Committed UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New epoch is Epoch{epoch=13} DEBUG [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:25,887 LocalLog.java:363 - Appending entry to the pending buffer: Epoch{epoch=13} INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,887 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_66408660-39c5-11ef-9de9-b702fa1dc4ae.log INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:25,888 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 760B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,889 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:25,889 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db')] (1 sstables, 4.976KiB), biggest 4.976KiB, smallest 4.976KiB DEBUG [node4_OptionalTasks:1] node4 2024-07-04 05:22:25,890 StorageService.java:2130 - Ignoring application state SCHEMA from /127.0.0.4:7012 because it is not a member in token metadata DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:25,890 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 27, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,18), DC=Value(dc0,19), RACK=Value(rack0,20), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,21), INTERNAL_IP=Value(127.0.0.4,9), RPC_ADDRESS=Value(127.0.0.4,22), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,23), TOKENS=Value(,24), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,25), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,26), SSTABLE_VERSIONS=Value(big-oa,13)} INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:25,891 Flushing.java:153 - Writing Memtable-local_metadata_log@1703712303(115B serialized bytes, 1 ops, 760B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node1_PerDiskMemtableFlushWriter_0:1] node1 2024-07-04 05:22:25,892 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070533694, position=68905) DEBUG [node1_MemtableFlushWriter:1] node1 2024-07-04 05:22:25,935 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-18-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,935 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node1_CompactionExecutor:1] node1 2024-07-04 05:22:25,935 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node1_GlobalLogFollower] node1 2024-07-04 05:22:25,935 LocalLog.java:492 - Enacted EXECUTED {UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}}. New tail is Epoch{epoch=13} DEBUG [node1_GlobalLogFollower] node1 2024-07-04 05:22:25,935 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:25,936 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.3:7012 INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:25,937 Commit.java:450 - Replicating newly committed transformations up to LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} to /127.0.0.2:7012 DEBUG [node1_GossipStage:1] node1 2024-07-04 05:22:25,937 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,13)} INFO [node1_InternalMetadataStage:1] node1 2024-07-04 05:22:25,937 Commit.java:373 - Responding with full result Success{epoch=Epoch{epoch=13}, logState=LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}}} to sender /127.0.0.4:7012 INFO [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:25,937 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node3_InternalMetadataStage:2] node3 2024-07-04 05:22:25,937 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} INFO [node2_InternalMetadataStage:2] node2 2024-07-04 05:22:25,937 LogState.java:270 - Received logstate LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} from /127.0.0.1:7012 DEBUG [node2_InternalMetadataStage:2] node2 2024-07-04 05:22:25,937 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:25,938 LocalLog.java:373 - Appending log state with snapshot to the pending buffer: LogState{baseState=none , entries=1: Epoch{epoch=13} -> Epoch{epoch=13}} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:25,957 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 761B (0%) on-heap, 0B (0%) off-heap INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:25,957 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 759B (0%) on-heap, 0B (0%) off-heap INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:25,958 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local_metadata_log, Reason: INTERNALLY_FORCED, Usage: 757B (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:25,966 Flushing.java:153 - Writing Memtable-local_metadata_log@1023592767(115B serialized bytes, 1 ops, 761B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:25,967 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=87678) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,970 Flushing.java:153 - Writing Memtable-local_metadata_log@679404337(115B serialized bytes, 1 ops, 759B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:25,970 Flushing.java:153 - Writing Memtable-local_metadata_log@2008413792(115B serialized bytes, 1 ops, 757B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:25,971 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=87361) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:25,971 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db (46B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=68142) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,051 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa_txn_flush_664f2c60-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:26,056 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-16-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:26,056 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-15-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:26,056 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:26,056 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node2_CompactionExecutor:1] node2 2024-07-04 05:22:26,056 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node3_CompactionExecutor:1] node3 2024-07-04 05:22:26,056 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node3_GlobalLogFollower] node3 2024-07-04 05:22:26,056 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=13} INFO [node2_GlobalLogFollower] node2 2024-07-04 05:22:26,056 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=13} DEBUG [node2_GlobalLogFollower] node2 2024-07-04 05:22:26,057 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] DEBUG [node3_GlobalLogFollower] node3 2024-07-04 05:22:26,058 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:26,058 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,13)} DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:26,058 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 0, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,0), DC=Value(dc0,0), RACK=Value(rack0,0), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,0), RPC_ADDRESS=Value(127.0.0.4,0), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,0), TOKENS=Value(40,0), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,7), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,0), STATUS_WITH_PORT=Value(NORMAL,40,0), SSTABLE_VERSIONS=Value(big-oa,13)} DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,061 CompactionManager.java:236 - Autocompaction on system.local_metadata_log is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,061 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db')] (1 sstables, 5.110KiB), biggest 5.110KiB, smallest 5.110KiB INFO [node4_GlobalLogFollower] node4 2024-07-04 05:22:26,061 LocalLog.java:492 - Enacted UnsafeJoin{nodeId=NodeId{id=4}, tokens=[40], joinTokenRing=true, streamData=false}. New tail is Epoch{epoch=13} DEBUG [node4_GlobalLogFollower] node4 2024-07-04 05:22:26,062 ClientNotificationListener.java:55 - Maybe notify listeners about [(NodeId{id=4},JOIN)] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,080 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 578B (0%) on-heap, 0B (0%) off-heap INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:26,093 Flushing.java:153 - Writing Memtable-local@1652331882(92B serialized bytes, 2 ops, 828B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:26,094 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db (32B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=68294) INFO [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,137 LogTransaction.java:249 - Unfinished transaction log, deleting /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa_txn_flush_6661f110-39c5-11ef-9de9-b702fa1dc4ae.log DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,146 CompactionManager.java:236 - Autocompaction on system.local is disabled (disabled: true, paused: false) DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,146 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db')] (1 sstables, 5.090KiB), biggest 5.090KiB, smallest 5.090KiB INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,146 Startup.java:400 - NORMAL WARN 05:22:26 Using stored Gossip Generation 1720070546 as it is greater than current system time 1720070546. See CASSANDRA-3654 if you experience problems WARN [node4_OptionalTasks:1] node4 2024-07-04 05:22:26,148 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070546 as it is greater than current system time 1720070546. See CASSANDRA-3654 if you experience problems INFO [node4_OptionalTasks:1] node4 2024-07-04 05:22:26,149 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,157 SnapshotManager.java:125 - Adding snapshots: . INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,157 SnapshotManager.java:135 - Scheduling expired snapshot cleanup with initialDelaySeconds=5 and cleanupPeriodSeconds=60 DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,161 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:26,162 Flushing.java:153 - Writing Memtable-local@856865710(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:26,162 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=68376) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,163 ColumnFamilyStore.java:1060 - Enqueuing flush of system_cluster_metadata.distributed_metadata_log, Reason: SCHEMA_CHANGE, Usage: 0B (0%) on-heap, 0B (0%) off-heap DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,163 TimeWindowCompactionStrategy.java:127 - TWCS expired check sufficiently far in the past, checking for fully expired SSTables INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,164 AuditLogManager.java:80 - Audit logging is disabled. DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,165 TimeWindowCompactionStrategy.java:334 - Using STCS compaction for first window of bucket: data files [(BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db'),187), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db'),683), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db'),164), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db'),53), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db'),36), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db'),727), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db'),98), (BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db'),53)] , options Min sstable size: 52428800, bucket low: 0.500000, bucket high: 1.500000 INFO [node1_MetadataFetchLogStage:1] node1 2024-07-04 05:22:26,167 FetchCMSLog.java:119 - Responding to /127.0.0.4:7012(FetchCMSLog{consistentFetch=true, lowerBound=Epoch{epoch=13}}) with log delta: LogState{baseState=none , entries=0: []} DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,170 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617894018048 bytes available, checking if we can write 2401 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,170 CompactionTask.java:167 - Compacting (666ec250-39c5-11ef-9de9-b702fa1dc4ae) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big-Data.db:level=0, ] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,171 ActiveRepairService.java:259 - Storing repair state for 3d or for 100000 elements DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,181 SnapshotManager.java:125 - Adding snapshots: . DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,194 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB INFO [node4_OptionalTasks:1] node4 2024-07-04 05:22:26,198 SecondaryIndexManager.java:947 - Executing pre-join post-bootstrap tasks for: CFS(Keyspace='tr', ColumnFamily='x') WARN 05:22:26 Using stored Gossip Generation 1720070547 as it is greater than current system time 1720070546. See CASSANDRA-3654 if you experience problems WARN [node4_OptionalTasks:1] node4 2024-07-04 05:22:26,199 SystemKeyspace.java:1196 - Using stored Gossip Generation 1720070547 as it is greater than current system time 1720070546. See CASSANDRA-3654 if you experience problems INFO [node4_OptionalTasks:1] node4 2024-07-04 05:22:26,200 ColumnFamilyStore.java:1060 - Enqueuing flush of system.local, Reason: INTERNALLY_FORCED, Usage: 566B (0%) on-heap, 0B (0%) off-heap INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:26,204 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:45740)->/127.0.0.1:7012-SMALL_MESSAGES-82ba2c66 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:26,204 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:45740)->/127.0.0.1:7012-SMALL_MESSAGES-45ee098c successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:26,209 Flushing.java:153 - Writing Memtable-local@1996137765(53B serialized bytes, 1 ops, 566B (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:26,209 InboundConnectionInitiator.java:505 - /127.0.0.1:7012(/127.0.0.1:39196)->/127.0.0.4:7012-SMALL_MESSAGES-aa7c900a messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_PerDiskMemtableFlushWriter_0:1] node4 2024-07-04 05:22:26,209 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db (18B) for commitlog position CommitLogPosition(segmentId=1720070539656, position=68458) INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:26,209 OutboundConnection.java:1161 - /127.0.0.1:7012(/127.0.0.1:39196)->/127.0.0.4:7012-SMALL_MESSAGES-1dcbf2e3 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,268 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-7-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,269 CompactionTask.java:258 - Compacted (666ec250-39c5-11ef-9de9-b702fa1dc4ae) 13 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-14-big,] to level=0. 2.345KiB to 1.788KiB (~76% of original) in 89ms. Read Throughput = 26.105KiB/s, Write Throughput = 19.908KiB/s, Row Throughput = ~26/s. 13 total partitions merged to 13. Partition merge counts were {1:13, }. Time spent writing keys = 30ms DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,270 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617893959680 bytes available, checking if we can write 326 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,270 CompactionTask.java:167 - Compacting (667ea0d0-39c5-11ef-9de9-b702fa1dc4ae) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big-Data.db:level=0, ] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,270 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-6-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,272 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-9-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,275 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-8-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,277 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-11-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,279 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-10-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,280 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-13-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,282 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-12-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,283 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-1-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,285 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,287 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,288 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-5-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,289 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local_metadata_log-e4ddd16ebea631f48361e88f07af8d4e/oa-4-big DEBUG [node4_MemtableFlushWriter:1] node4 2024-07-04 05:22:26,293 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-6-big-Data.db')] (1 sstables, 4.975KiB), biggest 4.975KiB, smallest 4.975KiB DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:26,294 Gossiper.java:2197 - Updated epstates for /127.0.0.4:7012: EndpointState: HeartBeatState = HeartBeat: generation = 1720070543, version = 40, AppStateMap = {SCHEMA=Value(00000000-0000-0000-0000-00000000000b,30), DC=Value(dc0,31), RACK=Value(rack0,32), RELEASE_VERSION=Value(5.1.0-SNAPSHOT,33), INTERNAL_IP=Value(127.0.0.4,9), RPC_ADDRESS=Value(127.0.0.4,34), NET_VERSION=Value(14,11), HOST_ID=Value(6d194555-f6eb-41d0-c000-000000000004,35), TOKENS=Value(40,36), INTERNAL_ADDRESS_AND_PORT=Value(127.0.0.4:7012,37), NATIVE_ADDRESS_AND_PORT=Value(127.0.0.4:9042,38), STATUS_WITH_PORT=Value(NORMAL,40,39), SSTABLE_VERSIONS=Value(big-oa,13)} INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,331 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,332 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,332 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,333 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,334 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,334 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,334 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,334 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,334 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,335 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,336 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,336 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,336 CompactionManager.java:441 - Starting Cleanup for system_auth.roles DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,336 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_auth/roles-5bc52802de2535edaeab188eecebb090/oa-1-big-Data.db') ([cassandra, cassandra]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,336 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,336 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,336 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,337 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(40,], (,10]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,338 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,338 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,338 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,338 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,339 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,339 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/repair_history-759fffad624b318180eefa9a52d1f627/oa-1-big-Data.db') ([trx, trx]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (,10], (20,30], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,340 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (,10], (20,30], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (,10], (20,30], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,341 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,342 CompactionManager.java:669 - Skipping BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/system_distributed/parent_repair_history-deabd734b99d3b9c92e5fd92eb5abf14/oa-1-big-Data.db') ([5b55929039c511efb651258387aac126, 5bf3804039c511efa1c94b8e7a2da833]) for cleanup; all rows should be kept. Needs cleanup full ranges: false Needs cleanup transient ranges: false Repaired: false INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,342 CompactionManager.java:681 - Skipping cleanup for 1/1 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (,10], (20,30], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,342 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,342 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,342 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,343 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,343 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,343 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,343 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,343 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,343 CompactionTask.java:258 - Compacted (667ea0d0-39c5-11ef-9de9-b702fa1dc4ae) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-7-big,] to level=0. 326B to 228B (~69% of original) in 71ms. Read Throughput = 4.429KiB/s, Write Throughput = 3.098KiB/s, Row Throughput = ~2/s. 5 total partitions merged to 1. Partition merge counts were {5:1, }. Time spent writing keys = 13ms DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,344 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,344 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,344 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,344 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (,10], (30,40]], transient ranges: []) INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,344 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,344 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,344 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,345 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,345 Directories.java:553 - FileStore /home/cassandra/cassandra (/dev/md1p1) has 617894325453 bytes available, checking if we can write 645 bytes INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,345 CompactionTask.java:167 - Compacting (668a1280-39c5-11ef-9de9-b702fa1dc4ae) [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big-Data.db:level=0, /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big-Data.db:level=0, ] INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,345 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-2-big DEBUG [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,345 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,345 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,345 CompactionManager.java:681 - Skipping cleanup for 0/2 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (,10], (30,40]], transient ranges: [(20,30]]) INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,347 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-1-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:26,348 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db') INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,349 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-4-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,351 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,353 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system/local-7ad54392bcdd35a684174e047860b377/oa-5-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:26,368 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db') INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:26,369 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-4-big INFO [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,380 CompactionTask.java:258 - Compacted (668a1280-39c5-11ef-9de9-b702fa1dc4ae) 5 sstables to [/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-6-big,] to level=0. 645B to 292B (~45% of original) in 33ms. Read Throughput = 18.610KiB/s, Write Throughput = 8.425KiB/s, Row Throughput = ~12/s. 7 total partitions merged to 6. Partition merge counts were {1:5, 2:1, }. Time spent writing keys = 13ms INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,380 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-1-big DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,380 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables DEBUG [node4_CompactionExecutor:1] node4 2024-07-04 05:22:26,381 TimeWindowCompactionStrategy.java:134 - TWCS skipping check for fully expired SSTables INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,382 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-3-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,383 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-2-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,385 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-5-big INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:26,387 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/oa-4-big INFO [node1_CompactionExecutor:1] node1 2024-07-04 05:22:26,419 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-6-big-Data.db. 282B to 282B (~100% of original) for 30 keys. Time: 51ms. INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,419 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node1_isolatedExecutor:1] node1 2024-07-04 05:22:26,419 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node1_NonPeriodicTasks:1] node1 2024-07-04 05:22:26,420 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node1/data1/tr/x-1b255f4def2540a6000000000000000a/oa-2-big INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,439 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,439 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,440 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,441 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,441 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,441 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,441 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,441 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,441 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,442 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,443 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,444 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,444 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,444 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,445 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (30,40]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,446 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: []) INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,447 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,448 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,448 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,448 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,448 CompactionManager.java:681 - Skipping cleanup for 0/2 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20]], transient ranges: [(30,40]]) INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:26,451 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db') INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:26,474 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 23ms. INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:26,474 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db') INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:26,475 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big INFO [node2_CompactionExecutor:1] node2 2024-07-04 05:22:26,541 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-6-big-Data.db. 282B to 199B (~70% of original) for 20 keys. Time: 67ms. INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,541 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node2_isolatedExecutor:1] node2 2024-07-04 05:22:26,541 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:26,542 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,566 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,567 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,567 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,569 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,569 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,569 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,569 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,569 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,569 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,570 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members INFO [node3_GossipStage:1] node3 2024-07-04 05:22:26,570 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL INFO [node1_GossipStage:1] node1 2024-07-04 05:22:26,571 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,571 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,571 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,571 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,571 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,571 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,571 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,572 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,573 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,574 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,574 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,574 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,574 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,575 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,575 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,575 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,576 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,577 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,578 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(40,], (,10], (10,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,578 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,578 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,578 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(10,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(10,20], (20,30]], transient ranges: []) INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,579 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,580 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,580 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,580 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,581 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,581 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,581 CompactionManager.java:681 - Skipping cleanup for 0/2 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(10,20], (20,30]], transient ranges: [(40,], (,10]]) INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:26,584 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db') INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:26,604 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db. 108B to 108B (~100% of original) for 10 keys. Time: 20ms. INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:26,605 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-4-big INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:26,606 CompactionManager.java:1451 - Cleaning up BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db') INFO [node3_CompactionExecutor:1] node3 2024-07-04 05:22:26,671 CompactionManager.java:1507 - Cleaned up to /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-6-big-Data.db. 109B to 109B (~100% of original) for 10 keys. Time: 66ms. INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,672 CompactionManager.java:483 - Finished Cleanup for tr.x successfully INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:26,672 BigFormat.java:324 - Deleting sstable: /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big INFO [node3_isolatedExecutor:1] node3 2024-07-04 05:22:26,672 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node2_GossipStage:1] node2 2024-07-04 05:22:26,807 StorageService.java:2121 - Node /127.0.0.4:7012 state jump to NORMAL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,824 StorageService.java:2564 - Starting Cleanup on distributed_test_keyspace.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,825 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,825 StorageService.java:2564 - Starting Cleanup on system_auth.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,827 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,829 ColumnFamilyStore.java:2899 - Resuming compactions for role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,829 CompactionManager.java:441 - Starting Cleanup for system_auth.role_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,829 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,829 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 ColumnFamilyStore.java:2899 - Resuming compactions for resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 CompactionManager.java:441 - Starting Cleanup for system_auth.resource_role_permissons_index INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.resource_role_permissons_index since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.resource_role_permissons_index DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 ColumnFamilyStore.java:2899 - Resuming compactions for identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 CompactionManager.java:441 - Starting Cleanup for system_auth.identity_to_role INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,830 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.identity_to_role since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.identity_to_role DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 ColumnFamilyStore.java:2899 - Resuming compactions for role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 CompactionManager.java:441 - Starting Cleanup for system_auth.role_members INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.role_members since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.role_members DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,831 ColumnFamilyStore.java:2899 - Resuming compactions for network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 CompactionManager.java:441 - Starting Cleanup for system_auth.network_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.network_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.network_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 ColumnFamilyStore.java:2899 - Resuming compactions for roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 CompactionManager.java:441 - Starting Cleanup for system_auth.roles INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.roles since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,832 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.roles DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_permissions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_permissions since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_permissions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for cidr_groups DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 ColumnFamilyStore.java:2899 - Resuming compactions for cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 CompactionManager.java:441 - Starting Cleanup for system_auth.cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_auth.cidr_groups since they are fully contained in owned ranges (full ranges: [(30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,833 CompactionManager.java:452 - No sstables to CLEANUP for system_auth.cidr_groups INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,834 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,834 StorageService.java:2564 - Starting Cleanup on system_cluster_metadata.[] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,835 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,835 StorageService.java:2564 - Starting Cleanup on system_distributed.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,836 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,836 ColumnFamilyStore.java:2899 - Resuming compactions for parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,836 CompactionManager.java:441 - Starting Cleanup for system_distributed.parent_repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,837 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.parent_repair_history since they are fully contained in owned ranges (full ranges: [(10,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,837 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.parent_repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,837 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,837 ColumnFamilyStore.java:2899 - Resuming compactions for view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,837 CompactionManager.java:441 - Starting Cleanup for system_distributed.view_build_status INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,837 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.view_build_status since they are fully contained in owned ranges (full ranges: [(10,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,837 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.view_build_status DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 ColumnFamilyStore.java:2899 - Resuming compactions for partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 CompactionManager.java:441 - Starting Cleanup for system_distributed.partition_denylist INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.partition_denylist since they are fully contained in owned ranges (full ranges: [(10,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.partition_denylist DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for repair_history DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 ColumnFamilyStore.java:2899 - Resuming compactions for repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 CompactionManager.java:441 - Starting Cleanup for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,838 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_distributed.repair_history since they are fully contained in owned ranges (full ranges: [(10,20], (20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,839 CompactionManager.java:452 - No sstables to CLEANUP for system_distributed.repair_history INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,839 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,839 StorageService.java:2564 - Starting Cleanup on system_traces.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,840 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,840 ColumnFamilyStore.java:2899 - Resuming compactions for sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,840 CompactionManager.java:441 - Starting Cleanup for system_traces.sessions INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,840 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.sessions since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,840 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.sessions DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,841 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for events DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,841 ColumnFamilyStore.java:2899 - Resuming compactions for events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,841 CompactionManager.java:441 - Starting Cleanup for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,841 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for system_traces.events since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: []) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,841 CompactionManager.java:452 - No sstables to CLEANUP for system_traces.events INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,841 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,841 StorageService.java:2564 - Starting Cleanup on tr.[] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,842 ColumnFamilyStore.java:2843 - Cancelling in-progress compactions for x DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,842 ColumnFamilyStore.java:2899 - Resuming compactions for x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,842 CompactionManager.java:441 - Starting Cleanup for tr.x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,842 CompactionManager.java:681 - Skipping cleanup for 0/0 sstables for tr.x since they are fully contained in owned ranges (full ranges: [(20,30], (30,40]], transient ranges: [(10,20]]) INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,843 CompactionManager.java:452 - No sstables to CLEANUP for tr.x INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,843 StorageService.java:2571 - Completed Cleanup with status SUCCESSFUL INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,868 Rebuild.java:96 - rebuild from dc: (any dc), tr, (15, 18],(20,25] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,868 StorageService.java:3291 - skipping paxos repair for rebuild. skip_paxos_repair_on_topology_change is set INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,872 Rebuild.java:188 - adding range: (15,18] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,872 Rebuild.java:188 - adding range: (20,25] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,881 Rebuild.java:103 - Rebuild movements: MovementMap{map={ReplicationParams{class=org.apache.cassandra.locator.NetworkTopologyStrategy, dc0=3/1}={Transient(/127.0.0.4:7012,(15,18])=[Full(/127.0.0.2:7012,(10,20]), Full(/127.0.0.3:7012,(10,20]), Transient(/127.0.0.4:7012,(10,20])], Full(/127.0.0.4:7012,(20,25])=[Full(/127.0.0.3:7012,(20,30]), Transient(/127.0.0.1:7012,(20,30]), Full(/127.0.0.4:7012,(20,30])]}}} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,888 RangeStreamer.java:472 - Keyspace: tr DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,889 RangeStreamer.java:473 - To fetch RN: [Transient(/127.0.0.4:7012,(15,18]), Full(/127.0.0.4:7012,(20,25])] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,889 RangeStreamer.java:487 - To fetch Transient(/127.0.0.4:7012,(15,18]) DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,890 RangeStreamer.java:536 - Endpoints to fetch for Transient(/127.0.0.4:7012,(15,18]) are [Full(/127.0.0.2:7012,(10,20])] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,890 RangeStreamer.java:487 - To fetch Full(/127.0.0.4:7012,(20,25]) DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,890 RangeStreamer.java:536 - Endpoints to fetch for Full(/127.0.0.4:7012,(20,25]) are [Full(/127.0.0.3:7012,(20,30])] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,891 RangeStreamer.java:381 - Rebuild: range Transient(/127.0.0.4:7012,(15,18]) exists on Full(/127.0.0.2:7012,(10,20]) for keyspace tr INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,891 RangeStreamer.java:381 - Rebuild: range Full(/127.0.0.4:7012,(20,25]) exists on Full(/127.0.0.3:7012,(20,30]) for keyspace tr DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,892 RangeStreamer.java:593 - Work map {/127.0.0.2:7012=[FetchReplica{local=Transient(/127.0.0.4:7012,(15,18]), remote=Full(/127.0.0.2:7012,(10,20])}], /127.0.0.3:7012=[FetchReplica{local=Full(/127.0.0.4:7012,(20,25]), remote=Full(/127.0.0.3:7012,(20,30])}]} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,892 RangeStreamer.java:679 - Keyspace tr Sources {/127.0.0.2:7012=[FetchReplica{local=Transient(/127.0.0.4:7012,(15,18]), remote=Full(/127.0.0.2:7012,(10,20])}], /127.0.0.3:7012=[FetchReplica{local=Full(/127.0.0.4:7012,(20,25]), remote=Full(/127.0.0.3:7012,(20,30])}]} DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,895 RangeStreamer.java:753 - Source and our replicas [FetchReplica{local=Transient(/127.0.0.4:7012,(15,18]), remote=Full(/127.0.0.2:7012,(10,20])}] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,896 RangeStreamer.java:754 - Source /127.0.0.2:7012 Keyspace tr streaming full [Transient(/127.0.0.4:7012,(15,18])] transient [] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,906 RangeStreamer.java:753 - Source and our replicas [FetchReplica{local=Full(/127.0.0.4:7012,(20,25]), remote=Full(/127.0.0.3:7012,(20,30])}] DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,906 RangeStreamer.java:754 - Source /127.0.0.3:7012 Keyspace tr streaming full [Full(/127.0.0.4:7012,(20,25])] transient [] INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,911 StreamResultFuture.java:98 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Executing streaming plan for Rebuild INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,912 StreamSession.java:396 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Starting streaming to 127.0.0.2:7012 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,916 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.2:7012 as initiator INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:26,922 InboundConnectionInitiator.java:450 - /127.0.0.4:7012(/127.0.0.1:45146)->/127.0.0.2:7012-STREAMING-e800c8a5 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,925 StreamingMultiplexedChannel.java:473 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 25ea38cd] Scheduling keep-alive task with 300s period. DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,926 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.2/127.0.0.2:7012 channel.local /127.0.0.1:45146 channel.id 25ea38cd DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,929 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from INITIALIZED to PREPARING INFO [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:26,929 StreamResultFuture.java:123 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Creating new streaming plan for Rebuild from /127.0.0.4:7012 channel.remote /127.0.0.1:45146 channel.local /127.0.0.2:7012 channel.id e800c8a5 INFO [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:26,929 StreamResultFuture.java:131 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae, ID#0] Received streaming plan for Rebuild from /127.0.0.4:7012 channel.remote /127.0.0.1:45146 channel.local /127.0.0.2:7012 channel.id e800c8a5 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,929 StreamCoordinator.java:268 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae, ID#0] Beginning stream session with /127.0.0.2:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:26,930 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: e800c8a5] Received StreamInitMessage: from = /127.0.0.4:7012, planId = 66dcc660-39c5-11ef-9de9-b702fa1dc4ae, session index = 0 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,930 StreamSession.java:396 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Starting streaming to 127.0.0.3:7012 DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,930 StreamingMultiplexedChannel.java:169 - Creating stream session to /127.0.0.3:7012 as initiator DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:26,930 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: e800c8a5] Received Prepare SYN (1 requests, 0 files} DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:26,930 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from INITIALIZED to PREPARING INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:26,931 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: STREAMING, Usage: 9.595KiB (0%) on-heap, 0B (0%) off-heap INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:26,936 InboundConnectionInitiator.java:450 - /127.0.0.4:7012(/127.0.0.1:41452)->/127.0.0.3:7012-STREAMING-13c4a35c streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,936 StreamingMultiplexedChannel.java:473 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 1c98b71e] Scheduling keep-alive task with 300s period. DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,937 StreamingMultiplexedChannel.java:180 - Creating control channel.remote 127.0.0.3/127.0.0.3:7012 channel.local /127.0.0.1:41452 channel.id 1c98b71e INFO [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:26,938 StreamResultFuture.java:123 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Creating new streaming plan for Rebuild from /127.0.0.4:7012 channel.remote /127.0.0.1:41452 channel.local /127.0.0.3:7012 channel.id 13c4a35c DEBUG [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,939 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from INITIALIZED to PREPARING INFO [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:26,939 StreamResultFuture.java:131 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae, ID#0] Received streaming plan for Rebuild from /127.0.0.4:7012 channel.remote /127.0.0.1:41452 channel.local /127.0.0.3:7012 channel.id 13c4a35c DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:26,939 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 13c4a35c] Received StreamInitMessage: from = /127.0.0.4:7012, planId = 66dcc660-39c5-11ef-9de9-b702fa1dc4ae, session index = 0 INFO [node4_isolatedExecutor:1] node4 2024-07-04 05:22:26,939 StreamCoordinator.java:268 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae, ID#0] Beginning stream session with /127.0.0.3:7012 DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:26,940 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 13c4a35c] Received Prepare SYN (1 requests, 0 files} DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:26,940 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from INITIALIZED to PREPARING INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:26,940 ColumnFamilyStore.java:1060 - Enqueuing flush of tr.x, Reason: STREAMING, Usage: 10.083KiB (0%) on-heap, 0B (0%) off-heap INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:26,942 Flushing.java:153 - Writing Memtable-x@2142083856(725B serialized bytes, 25 ops, 9.595KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node2_PerDiskMemtableFlushWriter_0:1] node2 2024-07-04 05:22:26,943 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db (295B) for commitlog position CommitLogPosition(segmentId=1720070517030, position=89022) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:26,946 Flushing.java:153 - Writing Memtable-x@14483204(725B serialized bytes, 25 ops, 10.083KiB (0%) on-heap, 0B (0%) off-heap), flushed range = [null, null) INFO [node3_PerDiskMemtableFlushWriter_0:1] node3 2024-07-04 05:22:26,948 Flushing.java:179 - Completed flushing /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db (295B) for commitlog position CommitLogPosition(segmentId=1720070517035, position=88705) DEBUG [node2_MemtableFlushWriter:1] node2 2024-07-04 05:22:27,006 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db')] (1 sstables, 5.366KiB), biggest 5.366KiB, smallest 5.366KiB DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:27,007 CassandraStreamManager.java:129 - ViewFilter for 3/3 sstables INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:27,013 StreamResultFuture.java:187 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Prepare completed. Receiving 0 files(0B), sending 2 files(344B) DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,014 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 25ea38cd] Received Prepare SYNACK ( 2 files} DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,017 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: e800c8a5] Received Prepare ACK INFO [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,017 StreamResultFuture.java:187 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Prepare completed. Receiving 0 files(0B), sending 2 files(344B) INFO [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,017 StreamResultFuture.java:187 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Prepare completed. Receiving 2 files(344B), sending 0 files(0B) DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,017 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from PREPARING to STREAMING DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,017 StreamingMultiplexedChannel.java:220 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #0, repairedAt: 0, pendingRepair: null, sendByFollower: true), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db}} DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,019 StreamingMultiplexedChannel.java:220 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #1, repairedAt: 1720070528229, pendingRepair: null, sendByFollower: true), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db}} DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:1] node2 2024-07-04 05:22:27,019 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.4:7012 as follower DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,020 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from PREPARING to STREAMING DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:2] node2 2024-07-04 05:22:27,020 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.4:7012 as follower DEBUG [node3_MemtableFlushWriter:1] node3 2024-07-04 05:22:27,021 ColumnFamilyStore.java:1387 - Flushed to [BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db')] (1 sstables, 5.366KiB), biggest 5.366KiB, smallest 5.366KiB DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:27,021 CassandraStreamManager.java:129 - ViewFilter for 2/3 sstables DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:1] node2 2024-07-04 05:22:27,022 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:39200 channel.id 66c58eeb INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:22:27,022 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:39200)->/127.0.0.4:7012-STREAMING-86697de6 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:27,023 InboundConnectionInitiator.java:450 - /127.0.0.2:7012(/127.0.0.1:39202)->/127.0.0.4:7012-STREAMING-6c678358 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:2] node2 2024-07-04 05:22:27,025 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:39202 channel.id 145dd9f8 DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:1] node2 2024-07-04 05:22:27,026 CassandraCompressedStreamWriter.java:62 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db to /127.0.0.4:7012, repairedAt = 0, totalSize = 236 DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:1] node2 2024-07-04 05:22:27,026 CassandraCompressedStreamWriter.java:80 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Writing section 0 with length 236 to stream. DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:1] node2 2024-07-04 05:22:27,028 CassandraCompressedStreamWriter.java:101 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db to /127.0.0.4:7012, bytesTransferred = 236B, totalSize = 236B INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:27,029 StreamResultFuture.java:187 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Prepare completed. Receiving 0 files(0B), sending 2 files(344B) DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,030 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 1c98b71e] Received Prepare SYNACK ( 2 files} DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-86697de6] node4 2024-07-04 05:22:27,030 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,030 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 13c4a35c] Received Prepare ACK INFO [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,030 StreamResultFuture.java:187 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Prepare completed. Receiving 0 files(0B), sending 2 files(344B) DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,031 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from PREPARING to STREAMING INFO [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,031 StreamResultFuture.java:187 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae ID#0] Prepare completed. Receiving 2 files(344B), sending 0 files(0B) DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,031 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from PREPARING to STREAMING DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,031 StreamingMultiplexedChannel.java:220 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #0, repairedAt: 0, pendingRepair: null, sendByFollower: true), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db}} DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-86697de6] node4 2024-07-04 05:22:27,031 CassandraCompressedStreamReader.java:68 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start receiving file #0 from /127.0.0.2:7012, repairedAt = 0, size = 236, ks = 'tr', pendingRepair = 'null', table = 'x'. DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:2] node2 2024-07-04 05:22:27,033 CassandraCompressedStreamWriter.java:62 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db to /127.0.0.4:7012, repairedAt = 1720070528229, totalSize = 108 DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,033 StreamingMultiplexedChannel.java:220 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Sending OutgoingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #1, repairedAt: 1720070528590, pendingRepair: null, sendByFollower: true), stream=CassandraOutgoingFile{/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db}} DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:2] node2 2024-07-04 05:22:27,033 CassandraCompressedStreamWriter.java:80 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Writing section 0 with length 108 to stream. DEBUG [node2_NettyStreaming-Outbound-/127.0.0.4.7012:2] node2 2024-07-04 05:22:27,033 CassandraCompressedStreamWriter.java:101 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node2/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db to /127.0.0.4:7012, bytesTransferred = 108B, totalSize = 108B DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:1] node3 2024-07-04 05:22:27,034 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.4:7012 as follower DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:2] node3 2024-07-04 05:22:27,035 StreamingMultiplexedChannel.java:186 - Creating stream session to /127.0.0.4:7012 as follower DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-6c678358] node4 2024-07-04 05:22:27,036 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-6c678358] node4 2024-07-04 05:22:27,036 CassandraCompressedStreamReader.java:68 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start receiving file #1 from /127.0.0.2:7012, repairedAt = 1720070528229, size = 108, ks = 'tr', pendingRepair = 'null', table = 'x'. INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:22:27,036 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:39206)->/127.0.0.4:7012-STREAMING-725d7300 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:1] node3 2024-07-04 05:22:27,037 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:39206 channel.id f0d1e7e6 INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:27,038 InboundConnectionInitiator.java:450 - /127.0.0.3:7012(/127.0.0.1:39216)->/127.0.0.4:7012-STREAMING-8a626a40 streaming connection established, version = 14, framing = UNPROTECTED, encryption = unencrypted DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:2] node3 2024-07-04 05:22:27,040 StreamingMultiplexedChannel.java:191 - Creating file channel.remote 127.0.0.4/127.0.0.4:7012 channel.local /127.0.0.1:39216 channel.id 406372f2 DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-725d7300] node4 2024-07-04 05:22:27,040 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-725d7300] node4 2024-07-04 05:22:27,040 CassandraCompressedStreamReader.java:68 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start receiving file #0 from /127.0.0.3:7012, repairedAt = 0, size = 236, ks = 'tr', pendingRepair = 'null', table = 'x'. DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-8a626a40] node4 2024-07-04 05:22:27,041 CassandraIncomingFile.java:71 - Incoming stream entireSSTable=false components=null DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-8a626a40] node4 2024-07-04 05:22:27,041 CassandraCompressedStreamReader.java:68 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start receiving file #1 from /127.0.0.3:7012, repairedAt = 1720070528590, size = 108, ks = 'tr', pendingRepair = 'null', table = 'x'. DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:1] node3 2024-07-04 05:22:27,041 CassandraCompressedStreamWriter.java:62 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db to /127.0.0.4:7012, repairedAt = 0, totalSize = 236 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:2] node3 2024-07-04 05:22:27,042 CassandraCompressedStreamWriter.java:62 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Start streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db to /127.0.0.4:7012, repairedAt = 1720070528590, totalSize = 108 DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:1] node3 2024-07-04 05:22:27,042 CassandraCompressedStreamWriter.java:80 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Writing section 0 with length 236 to stream. DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:2] node3 2024-07-04 05:22:27,042 CassandraCompressedStreamWriter.java:80 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Writing section 0 with length 108 to stream. DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:2] node3 2024-07-04 05:22:27,045 CassandraCompressedStreamWriter.java:101 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data2/tr/x-1b255f4def2540a6000000000000000a/oa-5-big-Data.db to /127.0.0.4:7012, bytesTransferred = 108B, totalSize = 108B DEBUG [node3_NettyStreaming-Outbound-/127.0.0.4.7012:1] node3 2024-07-04 05:22:27,045 CassandraCompressedStreamWriter.java:101 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished streaming file /home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node3/data0/tr/x-1b255f4def2540a6000000000000000a/oa-7-big-Data.db to /127.0.0.4:7012, bytesTransferred = 236B, totalSize = 236B INFO [node4_Stream-Deserializer-/127.0.0.2:7012-86697de6] node4 2024-07-04 05:22:27,056 CassandraCompressedStreamReader.java:107 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished receiving file #0 from /127.0.0.2:7012 readBytes = 236B, totalSize = 236B INFO [node4_Stream-Deserializer-/127.0.0.2:7012-6c678358] node4 2024-07-04 05:22:27,056 CassandraCompressedStreamReader.java:107 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished receiving file #1 from /127.0.0.2:7012 readBytes = 108B, totalSize = 108B DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-6c678358] node4 2024-07-04 05:22:27,056 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 6c678358] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #1, repairedAt: 1720070528229, pendingRepair: null, sendByFollower: true), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-86697de6] node4 2024-07-04 05:22:27,056 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 86697de6] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #0, repairedAt: 0, pendingRepair: null, sendByFollower: true), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-6c678358] node4 2024-07-04 05:22:27,057 StreamReceiveTask.java:87 - received 1 of 2 total files, 108 of total bytes 108 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,057 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: e800c8a5] Received Received (1b255f4d-ef25-40a6-0000-00000000000a, #1) DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,057 StreamTransferTask.java:93 - received sequenceNumber 1, remaining files [0] INFO [node4_Stream-Deserializer-/127.0.0.3:7012-725d7300] node4 2024-07-04 05:22:27,060 CassandraCompressedStreamReader.java:107 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished receiving file #0 from /127.0.0.3:7012 readBytes = 236B, totalSize = 236B DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-725d7300] node4 2024-07-04 05:22:27,060 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 725d7300] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #0, repairedAt: 0, pendingRepair: null, sendByFollower: true), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-725d7300] node4 2024-07-04 05:22:27,061 StreamReceiveTask.java:87 - received 1 of 2 total files, 236 of total bytes 236 DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,061 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 13c4a35c] Received Received (1b255f4d-ef25-40a6-0000-00000000000a, #0) DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,061 StreamTransferTask.java:93 - received sequenceNumber 0, remaining files [1] INFO [node4_Stream-Deserializer-/127.0.0.3:7012-8a626a40] node4 2024-07-04 05:22:27,068 CassandraCompressedStreamReader.java:107 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Finished receiving file #1 from /127.0.0.3:7012 readBytes = 108B, totalSize = 108B DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-86697de6] node4 2024-07-04 05:22:27,080 StreamReceiveTask.java:87 - received 2 of 2 total files, 344 of total bytes 236 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,080 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: e800c8a5] Received Received (1b255f4d-ef25-40a6-0000-00000000000a, #0) DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,080 StreamTransferTask.java:93 - received sequenceNumber 0, remaining files [] DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,081 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from STREAMING to COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-8a626a40] node4 2024-07-04 05:22:27,081 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 8a626a40] Received IncomingStreamMessage{header=Header (tableId: 1b255f4d-ef25-40a6-0000-00000000000a, #1, repairedAt: 1720070528590, pendingRepair: null, sendByFollower: true), stream=CassandraIncomingFile{sstable=tr/x}} DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,081 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 25ea38cd] Received Complete DEBUG [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:27,081 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from COMPLETE to COMPLETE INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:27,081 StreamResultFuture.java:201 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Session with /127.0.0.4:7012 is complete INFO [node2_NonPeriodicTasks:1] node2 2024-07-04 05:22:27,081 StreamResultFuture.java:260 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] All sessions completed DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-8a626a40] node4 2024-07-04 05:22:27,081 StreamReceiveTask.java:87 - received 2 of 2 total files, 344 of total bytes 108 DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,082 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 13c4a35c] Received Received (1b255f4d-ef25-40a6-0000-00000000000a, #1) DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,082 StreamTransferTask.java:93 - received sequenceNumber 1, remaining files [] DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,082 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from STREAMING to COMPLETE DEBUG [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:27,082 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from COMPLETE to COMPLETE INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:27,082 StreamResultFuture.java:201 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Session with /127.0.0.4:7012 is complete DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,083 StreamDeserializingTask.java:132 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae channel: 1c98b71e] Received Complete INFO [node3_NonPeriodicTasks:1] node3 2024-07-04 05:22:27,083 StreamResultFuture.java:260 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] All sessions completed DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,172 StreamSession.java:1128 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] handling Complete message, state = STREAMING DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,172 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,173 StreamSession.java:1128 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] handling Complete message, state = STREAMING DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,173 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from STREAMING to WAIT_COMPLETE DEBUG [node4_StreamReceiveTask:1] node4 2024-07-04 05:22:27,178 CassandraStreamReceiver.java:257 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Received 2 sstables from /127.0.0.2:7012 ([BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data2/tr/x-1b255f4def2540a6000000000000000a/oa-2-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data2/tr/x-1b255f4def2540a6000000000000000a/oa-1-big-Data.db')]) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:27,180 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:27,180 StreamResultFuture.java:201 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Session with /127.0.0.2:7012 is complete DEBUG [node4_StreamReceiveTask:2] node4 2024-07-04 05:22:27,182 CassandraStreamReceiver.java:257 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Received 2 sstables from /127.0.0.3:7012 ([BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data0/tr/x-1b255f4def2540a6000000000000000a/oa-3-big-Data.db'), BigTableReader:big(path='/home/cassandra/cassandra/build/tmp/dtests11091314702805980986/node4/data1/tr/x-1b255f4def2540a6000000000000000a/oa-4-big-Data.db')]) DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:27,189 StreamSession.java:564 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Will close attached inbound {6c678358=org.apache.cassandra.streaming.async.NettyStreamingChannel@78b24658, 25ea38cd=org.apache.cassandra.streaming.async.NettyStreamingChannel@38cddfd0, 86697de6=org.apache.cassandra.streaming.async.NettyStreamingChannel@324bbd48} and outbound {25ea38cd=org.apache.cassandra.streaming.async.NettyStreamingChannel@38cddfd0} channels DEBUG [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:27,190 StreamingMultiplexedChannel.java:514 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Closing stream connection channels on /127.0.0.2:7012 DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,190 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-6c678358] node4 2024-07-04 05:22:27,190 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-25ea38cd] node4 2024-07-04 05:22:27,190 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-6c678358] node4 2024-07-04 05:22:27,190 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE DEBUG [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:27,190 StreamingMultiplexedChannel.java:514 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,191 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_Stream-Deserializer-/127.0.0.4:7012-e800c8a5] node2 2024-07-04 05:22:27,191 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-86697de6] node4 2024-07-04 05:22:27,191 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.2:7012-86697de6] node4 2024-07-04 05:22:27,191 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:27,192 StreamSession.java:596 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Changing session state from WAIT_COMPLETE to COMPLETE INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:27,192 StreamResultFuture.java:201 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Session with /127.0.0.3:7012 is complete INFO [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:27,193 StreamResultFuture.java:260 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] All sessions completed DEBUG [node4_NonPeriodicTasks:1] node4 2024-07-04 05:22:27,194 StreamSession.java:564 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Will close attached inbound {8a626a40=org.apache.cassandra.streaming.async.NettyStreamingChannel@7c47c1c4, 1c98b71e=org.apache.cassandra.streaming.async.NettyStreamingChannel@71de9da, 725d7300=org.apache.cassandra.streaming.async.NettyStreamingChannel@7ad46086} and outbound {1c98b71e=org.apache.cassandra.streaming.async.NettyStreamingChannel@71de9da} channels DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-725d7300] node4 2024-07-04 05:22:27,195 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-8a626a40] node4 2024-07-04 05:22:27,195 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,195 HeapUtils.java:147 - Heap dump creation is already in progress. Request aborted. DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-725d7300] node4 2024-07-04 05:22:27,195 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-8a626a40] node4 2024-07-04 05:22:27,195 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE DEBUG [node4_Stream-Deserializer-/127.0.0.3:7012-1c98b71e] node4 2024-07-04 05:22:27,195 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE DEBUG [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:22:27,195 StreamingMultiplexedChannel.java:514 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Closing stream connection channels on /127.0.0.3:7012 DEBUG [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:27,195 StreamingMultiplexedChannel.java:514 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Closing stream connection channels on /127.0.0.4:7012 DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,195 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_Stream-Deserializer-/127.0.0.4:7012-13c4a35c] node3 2024-07-04 05:22:27,195 StreamSession.java:712 - [Stream #66dcc660-39c5-11ef-9de9-b702fa1dc4ae] Socket closed after session completed with state COMPLETE INFO [main] <main> 2024-07-04 05:22:27,229 AbstractCluster.java:1090 - Closing cluster d6f18461-10a8-4abd-baf2-fd0e700cce50 INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:22:27,245 Gossiper.java:1808 - Announcing shutdown INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:22:27,246 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,250 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,250 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:27,250 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,250 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:27,250 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node2_isolatedExecutor:3] node2 2024-07-04 05:22:27,250 Gossiper.java:1808 - Announcing shutdown INFO [node2_isolatedExecutor:3] node2 2024-07-04 05:22:27,251 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:22:27,251 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node2_GossipStage:1] node2 2024-07-04 05:22:27,251 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:27,251 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node2_GossipStage:1] node2 2024-07-04 05:22:27,251 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node2_GossipStage:1] node2 2024-07-04 05:22:27,251 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node4_GossipStage:1] node4 2024-07-04 05:22:27,252 Gossiper.java:1154 - InetAddress /127.0.0.1:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:22:27,252 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.1:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:27,252 FailureDetector.java:389 - Forcing conviction of /127.0.0.1:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:27,252 StorageService.java:2119 - Node /127.0.0.1:7012 state jump to shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:27,253 Gossiper.java:576 - Marked /127.0.0.1:7012 as shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,253 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,253 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:27,254 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,254 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:27,254 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node4_GossipStage:1] node4 2024-07-04 05:22:27,254 Gossiper.java:1154 - InetAddress /127.0.0.2:7012 is now DOWN INFO [node4_GossipStage:1] node4 2024-07-04 05:22:27,255 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.2:7012 DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:27,255 FailureDetector.java:389 - Forcing conviction of /127.0.0.2:7012 INFO [node4_GossipStage:1] node4 2024-07-04 05:22:27,255 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown DEBUG [node4_GossipStage:1] node4 2024-07-04 05:22:27,255 Gossiper.java:576 - Marked /127.0.0.2:7012 as shutdown INFO [node4_isolatedExecutor:3] node4 2024-07-04 05:22:27,262 Gossiper.java:1808 - Announcing shutdown INFO [node4_isolatedExecutor:3] node4 2024-07-04 05:22:27,262 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,266 Gossiper.java:1154 - InetAddress /127.0.0.4:7012 is now DOWN INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,266 MessagingService.java:596 - Interrupted outbound connections to /127.0.0.4:7012 DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:27,266 FailureDetector.java:389 - Forcing conviction of /127.0.0.4:7012 INFO [node3_GossipStage:1] node3 2024-07-04 05:22:27,266 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown DEBUG [node3_GossipStage:1] node3 2024-07-04 05:22:27,266 Gossiper.java:576 - Marked /127.0.0.4:7012 as shutdown INFO [node3_isolatedExecutor:3] node3 2024-07-04 05:22:27,289 Gossiper.java:1808 - Announcing shutdown INFO [node3_isolatedExecutor:3] node3 2024-07-04 05:22:27,289 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:27,332 InboundConnectionInitiator.java:505 - /127.0.0.2:7012(/127.0.0.1:45748)->/127.0.0.1:7012-URGENT_MESSAGES-b9902038 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:27,332 OutboundConnection.java:1161 - /127.0.0.2:7012(/127.0.0.1:45748)->/127.0.0.1:7012-URGENT_MESSAGES-ebe8513b successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:22:27,334 StorageService.java:2119 - Node /127.0.0.2:7012 state jump to shutdown INFO [node4_Messaging-EventLoop-3-2] node4 2024-07-04 05:22:27,570 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:39226)->/127.0.0.4:7012-URGENT_MESSAGES-33d3a1d4 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:27,570 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:45750)->/127.0.0.1:7012-URGENT_MESSAGES-fe6b228b successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_Messaging-EventLoop-3-2] node1 2024-07-04 05:22:27,570 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:45750)->/127.0.0.1:7012-URGENT_MESSAGES-aadc17a2 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:27,570 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:39226)->/127.0.0.4:7012-URGENT_MESSAGES-99c06f14 successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node4_GossipStage:1] node4 2024-07-04 05:22:27,571 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node1_GossipStage:1] node1 2024-07-04 05:22:27,573 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown INFO [node1_Messaging-EventLoop-3-1] node1 2024-07-04 05:22:27,805 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:45754)->/127.0.0.1:7012-URGENT_MESSAGES-0550c2d2 messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:27,805 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:45754)->/127.0.0.1:7012-URGENT_MESSAGES-5e5a25cd successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node1_GossipStage:1] node1 2024-07-04 05:22:27,807 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node2_Messaging-EventLoop-3-2] node2 2024-07-04 05:22:27,819 InboundConnectionInitiator.java:505 - /127.0.0.4:7012(/127.0.0.1:45160)->/127.0.0.2:7012-URGENT_MESSAGES-d689fa0e messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node4_Messaging-EventLoop-3-1] node4 2024-07-04 05:22:27,819 OutboundConnection.java:1161 - /127.0.0.4:7012(/127.0.0.1:45160)->/127.0.0.2:7012-URGENT_MESSAGES-1c37f09d successfully connected, version = 14, framing = CRC, encryption = unencrypted INFO [node2_GossipStage:1] node2 2024-07-04 05:22:27,820 StorageService.java:2119 - Node /127.0.0.3:7012 state jump to shutdown INFO [node2_GossipStage:1] node2 2024-07-04 05:22:27,820 StorageService.java:2119 - Node /127.0.0.4:7012 state jump to shutdown DEBUG [node3_BatchlogTasks:1] node3 2024-07-04 05:22:28,193 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint INFO [node2_Messaging-EventLoop-3-1] node2 2024-07-04 05:22:28,806 InboundConnectionInitiator.java:505 - /127.0.0.3:7012(/127.0.0.1:45174)->/127.0.0.2:7012-URGENT_MESSAGES-3157f06b messaging connection established, version = 14, framing = CRC, encryption = unencrypted INFO [node3_Messaging-EventLoop-3-1] node3 2024-07-04 05:22:28,806 OutboundConnection.java:1161 - /127.0.0.3:7012(/127.0.0.1:45174)->/127.0.0.2:7012-URGENT_MESSAGES-f981bbcc successfully connected, version = 14, framing = CRC, encryption = unencrypted DEBUG [node2_BatchlogTasks:1] node2 2024-07-04 05:22:29,140 BatchlogManager.java:246 - Updating batchlog replay throttle to 1024 KB/s, 256 KB/s per endpoint INFO [node1_isolatedExecutor:3] node1 2024-07-04 05:22:29,250 HintsService.java:234 - Paused hints dispatch INFO [node2_isolatedExecutor:3] node2 2024-07-04 05:22:29,258 HintsService.java:234 - Paused hints dispatch DEBUG [node1_isolatedExecutor:5] node1 2024-07-04 05:22:29,260 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node1_isolatedExecutor:5] node1 2024-07-04 05:22:29,261 MessagingService.java:643 - Waiting for messaging service to quiesce INFO [node4_isolatedExecutor:3] node4 2024-07-04 05:22:29,266 HintsService.java:234 - Paused hints dispatch DEBUG [node2_isolatedExecutor:10] node2 2024-07-04 05:22:29,269 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node2_isolatedExecutor:10] node2 2024-07-04 05:22:29,269 MessagingService.java:643 - Waiting for messaging service to quiesce INFO [node3_isolatedExecutor:3] node3 2024-07-04 05:22:29,294 HintsService.java:234 - Paused hints dispatch DEBUG [node3_isolatedExecutor:20] node3 2024-07-04 05:22:29,310 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node3_isolatedExecutor:20] node3 2024-07-04 05:22:29,310 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node4_isolatedExecutor:3] node4 2024-07-04 05:22:29,327 MessagingService.java:635 - Shutting down: timeout=60s, gracefully=false, shutdownExecutors=true INFO [node4_isolatedExecutor:3] node4 2024-07-04 05:22:29,328 MessagingService.java:643 - Waiting for messaging service to quiesce DEBUG [node1_COMMIT-LOG-WRITER] node1 2024-07-04 05:22:31,273 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node2_COMMIT-LOG-WRITER] node2 2024-07-04 05:22:31,300 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node3_COMMIT-LOG-WRITER] node3 2024-07-04 05:22:31,326 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled. DEBUG [node4_COMMIT-LOG-WRITER] node4 2024-07-04 05:22:31,336 HeapUtils.java:133 - Heap dump creation on uncaught exceptions is disabled.