[32m[5,337 / 8,438][0m 150 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 31s processwrapper-sandbox ... (33 actions, 31 running)
[32m[5,352 / 8,441][0m 151 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 32s processwrapper-sandbox ... (33 actions running)
[32m[5,371 / 8,444][0m 151 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 34s processwrapper-sandbox ... (33 actions running)
[32m[5,383 / 8,444][0m 151 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 35s processwrapper-sandbox ... (33 actions, 32 running)
[32m[5,405 / 8,495][0m 155 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 36s processwrapper-sandbox ... (33 actions, 31 running)
[31m[1mFAIL: [0m//br/pkg/streamhelper:streamhelper_test (shard 9 of 22) (see /root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/br/pkg/streamhelper/streamhelper_test/shard_9_of_22/test_attempts/attempt_1.log)
[32m[5,424 / 8,516][0m 155 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 37s processwrapper-sandbox ... (33 actions, 32 running)
[32m[5,428 / 8,516][0m 155 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 38s processwrapper-sandbox ... (33 actions, 32 running)
[32m[5,442 / 8,516][0m 155 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 39s processwrapper-sandbox ... (33 actions, 32 running)
[31m[1mFAIL: [0m//br/pkg/streamhelper:streamhelper_test (shard 9 of 22) (see /root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/br/pkg/streamhelper/streamhelper_test/shard_9_of_22/test_attempts/attempt_2.log)
[32m[5,454 / 8,516][0m 155 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 40s processwrapper-sandbox ... (33 actions, 32 running)
[32m[5,468 / 8,517][0m 155 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 41s processwrapper-sandbox ... (33 actions, 32 running)
[32m[5,474 / 8,517][0m 156 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 42s processwrapper-sandbox ... (33 actions running)
[32m[5,483 / 8,518][0m 156 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 43s processwrapper-sandbox ... (33 actions, 32 running)
[32mINFO: [0mFrom Testing //br/pkg/streamhelper:streamhelper_test (shard 9 of 22):
==================== Test output for //br/pkg/streamhelper:streamhelper_test (shard 9 of 22):
[2024/02/21 12:19:07.887 +00:00] [INFO] [advancer.go:336] ["meet task event"] [event=Add(whole)]
[2024/02/21 12:19:07.887 +00:00] [INFO] [db.go:208] ["inc log backup task"] [count=1]
[2024/02/21 12:19:07.887 +00:00] [INFO] [advancer.go:430] ["added event"] [task="name:\"whole\" "] [ranges="{[, inf)}"] [current-checkpoint=0]
[2024/02/21 12:19:07.888 +00:00] [INFO] [advancer.go:313] ["current last region"] [category="log backup advancer hint"] [min="([, inf), 0)"] [for-polling=1] [min-ts=1970-01-01T00:00:00Z] [region-hint="ID=5,Leader=2,ConfVer=0,Version=1,Peers=[],RealRange=[, 30303132)"]
[2024/02/21 12:19:07.888 +00:00] [INFO] [advancer.go:561] ["updated log backup GC safe point."] [checkpoint=18446744073709551615] [target=18446744073709551615]
Error Trace: br/pkg/streamhelper/advancer_test.go:291
Messages: failed to mark the cluster:
--- FAIL: TestClearCache (0.00s)
coverage: 1.4% of statements
Coverage runner: Not collecting coverage for failed test.
The following commands failed with status 1
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/sandbox/processwrapper-sandbox/4369/execroot/_main/bazel-out/k8-fastbuild/bin/br/pkg/streamhelper/streamhelper_test_/streamhelper_test.runfiles/_main/br/pkg/streamhelper/streamhelper_test_/streamhelper_test
================================================================================
==================== Test output for //br/pkg/streamhelper:streamhelper_test (shard 9 of 22):
[2024/02/21 12:19:09.755 +00:00] [INFO] [advancer.go:336] ["meet task event"] [event=Add(whole)]
[2024/02/21 12:19:09.755 +00:00] [INFO] [db.go:208] ["inc log backup task"] [count=1]
[2024/02/21 12:19:09.755 +00:00] [INFO] [advancer.go:430] ["added event"] [task="name:\"whole\" "] [ranges="{[, inf)}"] [current-checkpoint=0]
[2024/02/21 12:19:09.756 +00:00] [INFO] [advancer.go:313] ["current last region"] [category="log backup advancer hint"] [min="([, inf), 0)"] [for-polling=1] [min-ts=1970-01-01T00:00:00Z] [region-hint="ID=5,Leader=3,ConfVer=0,Version=1,Peers=[],RealRange=[, 30303132)"]
[2024/02/21 12:19:09.756 +00:00] [INFO] [advancer.go:561] ["updated log backup GC safe point."] [checkpoint=18446744073709551615] [target=18446744073709551615]
Error Trace: br/pkg/streamhelper/advancer_test.go:291
Messages: failed to mark the cluster:
--- FAIL: TestClearCache (0.00s)
coverage: 1.4% of statements
Coverage runner: Not collecting coverage for failed test.
The following commands failed with status 1
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/sandbox/processwrapper-sandbox/4398/execroot/_main/bazel-out/k8-fastbuild/bin/br/pkg/streamhelper/streamhelper_test_/streamhelper_test.runfiles/_main/br/pkg/streamhelper/streamhelper_test_/streamhelper_test
================================================================================
[32m[5,496 / 8,519][0m 156 / 393 tests;[0m GoCompilePkg pkg/expression/expression_test.internal.recompileinternal.a; 44s processwrapper-sandbox ... (33 actions running)
[35mFLAKY: [0m//br/pkg/streamhelper:streamhelper_test (Summary)
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/br/pkg/streamhelper/streamhelper_test/shard_9_of_22/test_attempts/attempt_1.log
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/br/pkg/streamhelper/streamhelper_test/shard_9_of_22/test_attempts/attempt_2.log
[32m[8,804 / 9,957][0m 223 / 393 tests;[0m GoCompilePkg pkg/privilege/privileges/executor.recompile1193.a; 13s processwrapper-sandbox ... (33 actions running)
[32m[8,806 / 9,957][0m 223 / 393 tests;[0m GoCompilePkg pkg/privilege/privileges/executor.recompile1193.a; 14s processwrapper-sandbox ... (33 actions running)
[32m[8,810 / 9,957][0m 223 / 393 tests;[0m GoCompilePkg pkg/privilege/privileges/executor.recompile1193.a; 15s processwrapper-sandbox ... (33 actions running)
[32m[8,825 / 9,959][0m 224 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 1 of 3); 11s processwrapper-sandbox ... (33 actions running)
[32m[8,832 / 9,959][0m 224 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 1 of 3); 12s processwrapper-sandbox ... (33 actions, 32 running)
[31m[1mFAIL: [0m//pkg/executor/aggregate:aggregate_test (shard 3 of 3) (see /root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/pkg/executor/aggregate/aggregate_test/shard_3_of_3/test_attempts/attempt_1.log)
[32m[8,838 / 10,038][0m 224 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 1 of 3); 13s processwrapper-sandbox ... (33 actions, 32 running)
[32m[8,857 / 10,065][0m 225 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 2 of 3); 14s processwrapper-sandbox ... (33 actions running)
[32m[8,869 / 10,065][0m 226 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 2 of 3); 15s processwrapper-sandbox ... (33 actions, 32 running)
[32m[8,879 / 10,065][0m 226 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 2 of 3); 16s processwrapper-sandbox ... (33 actions, 32 running)
[32m[8,889 / 10,065][0m 226 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 2 of 3); 17s processwrapper-sandbox ... (33 actions, 31 running)
[32m[9,023 / 10,143][0m 227 / 393 tests;[0m Testing //pkg/executor/aggregate:aggregate_test (shard 3 of 3); 27s processwrapper-sandbox ... (33 actions running)
[35mFLAKY: [0m//pkg/executor/aggregate:aggregate_test (Summary)
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/pkg/executor/aggregate/aggregate_test/shard_3_of_3/test_attempts/attempt_1.log
[32mINFO: [0mFrom Testing //pkg/executor/aggregate:aggregate_test (shard 3 of 3):
==================== Test output for //pkg/executor/aggregate:aggregate_test (shard 3 of 3):
[2024/02/21 12:25:33.331 +00:00] [ERROR] [agg_util.go:55] ["parallel hash aggregation panicked"] [error="Intest panic: final worker is panicked before start"] [errorVerbose="Intest panic: final worker is panicked before start\ngithub.com/pingcap/tidb/pkg/util.GetRecoverError\n\tpkg/util/util.go:307\ngithub.com/pingcap/tidb/pkg/executor/aggregate.recoveryHashAgg\n\tpkg/executor/aggregate/agg_util.go:53\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggFinalWorker).cleanup\n\tpkg/executor/aggregate/agg_hash_final_worker.go:250\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/tidb/pkg/executor/aggregate.intestBeforeFinalWorkerStart\n\tpkg/executor/aggregate/agg_hash_final_worker.go:261\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggFinalWorker).run\n\tpkg/executor/aggregate/agg_hash_final_worker.go:232\nruntime.goexit\n\tsrc/runtime/asm_amd64.s:1650"] [stack="github.com/pingcap/tidb/pkg/executor/aggregate.recoveryHashAgg\n\tpkg/executor/aggregate/agg_util.go:55\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggFinalWorker).cleanup\n\tpkg/executor/aggregate/agg_hash_final_worker.go:250\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/tidb/pkg/executor/aggregate.intestBeforeFinalWorkerStart\n\tpkg/executor/aggregate/agg_hash_final_worker.go:261\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggFinalWorker).run\n\tpkg/executor/aggregate/agg_hash_final_worker.go:232"] [stack="github.com/pingcap/tidb/pkg/executor/aggregate.recoveryHashAgg\n\tpkg/executor/aggregate/agg_util.go:55\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggFinalWorker).cleanup\n\tpkg/executor/aggregate/agg_hash_final_worker.go:250\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/tidb/pkg/executor/aggregate.intestBeforeFinalWorkerStart\n\tpkg/executor/aggregate/agg_hash_final_worker.go:261\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggFinalWorker).run\n\tpkg/executor/aggregate/agg_hash_final_worker.go:232"]
[2024/02/21 12:25:33.580 +00:00] [INFO] [agg_spill.go:158] ["memory exceeds quota, set aggregate mode to spill-mode"] [consumed=4036932] [quota=5000000]
[2024/02/21 12:25:34.096 +00:00] [INFO] [agg_spill.go:158] ["memory exceeds quota, set aggregate mode to spill-mode"] [consumed=4036932] [quota=5000000]
[2024/02/21 12:25:34.326 +00:00] [INFO] [agg_spill.go:158] ["memory exceeds quota, set aggregate mode to spill-mode"] [consumed=4111564] [quota=5000000]
pkg/executor/aggregate/agg_hash_executor.go:533 +0xf2
Coverage runner: Not collecting coverage for failed test.
The following commands failed with status 2
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/sandbox/processwrapper-sandbox/7646/execroot/_main/bazel-out/k8-fastbuild/bin/pkg/executor/aggregate/aggregate_test_/aggregate_test.runfiles/_main/pkg/executor/aggregate/aggregate_test_/aggregate_test
================================================================================
[32m[9,045 / 10,194][0m 228 / 393 tests;[0m GoCompilePkg pkg/plugin/executor.recompile1221.a; 6s processwrapper-sandbox ... (33 actions, 32 running)
[32m[9,068 / 10,196][0m 229 / 393 tests;[0m GoCompilePkg pkg/plugin/executor.recompile1221.a; 7s processwrapper-sandbox ... (33 actions, 31 running)
[32m[9,078 / 10,196][0m 229 / 393 tests;[0m GoCompilePkg pkg/plugin/executor.recompile1221.a; 8s processwrapper-sandbox ... (33 actions running)
[32m[9,098 / 10,197][0m 231 / 393 tests;[0m GoCompilePkg pkg/plugin/executor.recompile1221.a; 9s processwrapper-sandbox ... (33 actions, 32 running)
[32m[9,104 / 10,197][0m 231 / 393 tests;[0m GoCompilePkg pkg/plugin/executor.recompile1221.a; 10s processwrapper-sandbox ... (33 actions running)
[32m[9,424 / 10,246][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 25s processwrapper-sandbox ... (33 actions running)
[32m[9,430 / 10,246][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 27s processwrapper-sandbox ... (33 actions, 31 running)
[32m[9,432 / 10,246][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 28s processwrapper-sandbox ... (33 actions, 32 running)
[32m[9,436 / 10,246][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 29s processwrapper-sandbox ... (33 actions running)
[32m[9,440 / 10,246][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 30s processwrapper-sandbox ... (33 actions running)
[31m[1mFAIL: [0m//pkg/planner/core:core_test (shard 15 of 50) (see /root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/pkg/planner/core/core_test/shard_15_of_50/test_attempts/attempt_1.log)
[32m[9,448 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 31s processwrapper-sandbox ... (33 actions, 32 running)
[32m[9,452 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 32s processwrapper-sandbox ... (33 actions, 31 running)
[32m[9,455 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 34s processwrapper-sandbox ... (33 actions, 32 running)
[32m[9,455 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 35s processwrapper-sandbox ... (33 actions running)
[32m[9,460 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 36s processwrapper-sandbox ... (33 actions running)
[32m[9,473 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/planner/core:core_test (shard 2 of 50); 41s processwrapper-sandbox ... (32 actions running)
[32m[9,481 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 37s processwrapper-sandbox ... (33 actions running)
[32m[9,490 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 38s processwrapper-sandbox ... (33 actions, 31 running)
[32m[9,495 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 39s processwrapper-sandbox ... (33 actions, 32 running)
[32mINFO: [0mFrom Testing //pkg/planner/core:core_test (shard 15 of 50):
==================== Test output for //pkg/planner/core:core_test (shard 15 of 50):
--- PASS: TestCast (0.00s)
=== RUN TestBinPushDownToTiFlash
[2024/02/21 12:26:39.937 +00:00] [INFO] [region_cache.go:2711] ["change store resolve state"] [store=1] [addr=store1] [from=unresolved] [to=resolved] [liveness-state=reachable]
[2024/02/21 12:26:39.938 +00:00] [INFO] [ddl_api.go:1125] ["Automatically convert BLOB(65535) to MEDIUMBLOB"]
[2024/02/21 12:26:48.382 +00:00] [INFO] [ddl_worker.go:734] ["finish DDL job"] [worker="worker 15, tp general"] [category=ddl] [jobID=109] [conn=2] [job="ID:109, Type:create table, State:synced, SchemaState:public, SchemaID:2, TableID:108, RowCount:0, ArgLen:0, start time: 2024-02-21 12:26:48.34 +0000 UTC, Err:<nil>, ErrCount:0, SnapshotVersion:0, LocalMode: false"]
[2024/02/21 12:26:48.384 +00:00] [INFO] [ddl.go:1290] ["DDL job is finished"] [category=ddl] [jobID=109]
[2024/02/21 12:26:48.384 +00:00] [INFO] [callback.go:139] ["performing DDL change, must reload"]
[2024/02/21 12:26:48.386 +00:00] [WARN] [2pc.go:1803] ["schemaLeaseChecker is not set for this transaction"] [sessionID=2] [startTS=447877849647939584] [checkTS=447877849647939585]
[2024/02/21 12:26:48.387 +00:00] [WARN] [2pc.go:1803] ["schemaLeaseChecker is not set for this transaction"] [sessionID=2] [startTS=447877849647939588] [checkTS=447877849648201728]
[2024/02/21 12:26:48.389 +00:00] [INFO] [region_request.go:1556] ["send request failed, err: context canceled"] [req-ts=447877849648463873] [req-type=Cop] [region="{ region id: 2, ver: 1, confVer: 3 }"] [replica-read-type=leader] [stale-read=false] [request-sender="{rpcError:context canceled,replicaSelector: replicaSelector{selectorStateStr: accessKnownLeader, cacheRegionIsValid: true, replicaStatus: [peer: 3, store: 1, isEpochStale: false, attempts: 1, replica-epoch: 0, store-epoch: 0, store-state: resolved, store-liveness-state: reachable]}}"] [retry-times=0] [total-backoff-ms=0] [total-backoff-times=0] [max-exec-timeout-ms=60000] [total-region-errors=]
physical_plan_test.go:495:
Error Trace: pkg/planner/core/physical_plan_test.go:495
Test: TestPhysicalTableScanExtractCorrelatedCols
[2024/02/21 12:26:48.392 +00:00] [INFO] [mock.go:106] ["owner manager is canceled"] [category=ddl] [ID=a4af21bd-6f7c-49b0-ad14-289aa291b34f] [ownerKey=/tidb/ddl/fg/owner]
[2024/02/21 12:26:48.392 +00:00] [INFO] [ddl_workerpool.go:83] ["closing workerPool"] [category=ddl]
[2024/02/21 12:26:50.870 +00:00] [INFO] [db.go:596] ["Compaction finished"]
[2024/02/21 12:26:50.870 +00:00] [INFO] [db.go:615] ["BlobManager finished"]
[2024/02/21 12:26:50.870 +00:00] [INFO] [db.go:619] ["ResourceManager finished"]
[2024/02/21 12:26:50.870 +00:00] [INFO] [db.go:625] ["Waiting for closer"]
--- PASS: TestTrueCardCost (2.46s)
coverage: 10.5% of statements
Coverage runner: Not collecting coverage for failed test.
The following commands failed with status 1
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/sandbox/processwrapper-sandbox/8288/execroot/_main/bazel-out/k8-fastbuild/bin/pkg/planner/core/core_test_/core_test.runfiles/_main/pkg/planner/core/core_test_/core_test
================================================================================
[32m[9,498 / 10,247][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 40s processwrapper-sandbox ... (33 actions, 32 running)
[32m[9,504 / 10,248][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 41s processwrapper-sandbox ... (33 actions running)
[32m[9,507 / 10,248][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 43s processwrapper-sandbox ... (33 actions running)
[32m[9,510 / 10,248][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 44s processwrapper-sandbox ... (33 actions, 31 running)
[32m[9,514 / 10,248][0m 245 / 393 tests;[0m Testing //pkg/ddl:ddl_test (shard 2 of 50); 45s processwrapper-sandbox ... (33 actions running)
[32m[11,079 / 11,726][0m 321 / 393 tests;[0m Testing //pkg/session/nontransactionaltest:nontransactionaltest_test (shard 1 of 3); 34s processwrapper-sandbox ... (33 actions running)
[32m[11,090 / 11,732][0m 322 / 393 tests;[0m Testing //pkg/session/nontransactionaltest:nontransactionaltest_test (shard 1 of 3); 35s processwrapper-sandbox ... (33 actions running)
[32m[11,093 / 11,732][0m 323 / 393 tests;[0m Testing //pkg/session/nontransactionaltest:nontransactionaltest_test (shard 1 of 3); 36s processwrapper-sandbox ... (33 actions, 32 running)
[32m[11,100 / 11,732][0m 325 / 393 tests;[0m Testing //pkg/table/tables/test/partition:partition_test (shard 17 of 18); 20s processwrapper-sandbox ... (33 actions running)
[32m[11,102 / 11,743][0m 325 / 393 tests;[0m Testing //pkg/table/tables/test/partition:partition_test (shard 17 of 18); 21s processwrapper-sandbox ... (33 actions running)
[31m[1mFAIL: [0m//pkg/executor/test/jointest/hashjoin:hashjoin_test (shard 10 of 10) (see /root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/pkg/executor/test/jointest/hashjoin/hashjoin_test/shard_10_of_10/test_attempts/attempt_1.log)
[32m[11,107 / 11,744][0m 325 / 393 tests;[0m Testing //pkg/table/tables/test/partition:partition_test (shard 17 of 18); 22s processwrapper-sandbox ... (33 actions, 32 running)
[32m[11,109 / 11,744][0m 325 / 393 tests;[0m Testing //pkg/table/tables/test/partition:partition_test (shard 17 of 18); 23s processwrapper-sandbox ... (33 actions, 32 running)
[32m[11,118 / 11,745][0m 326 / 393 tests;[0m Testing //pkg/ddl/tests/partition:partition_test (shard 35 of 44); 14s processwrapper-sandbox ... (33 actions, 32 running)
[32m[11,123 / 11,745][0m 327 / 393 tests;[0m Testing //pkg/ddl/tests/partition:partition_test (shard 35 of 44); 15s processwrapper-sandbox ... (33 actions, 32 running)
[32m[11,128 / 11,777][0m 327 / 393 tests;[0m Testing //pkg/ddl/tests/partition:partition_test (shard 35 of 44); 16s processwrapper-sandbox ... (33 actions, 32 running)
[35mFLAKY: [0m//pkg/executor/test/jointest/hashjoin:hashjoin_test (Summary)
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/execroot/_main/bazel-out/k8-fastbuild/testlogs/pkg/executor/test/jointest/hashjoin/hashjoin_test/shard_10_of_10/test_attempts/attempt_1.log
[32mINFO: [0mFrom Testing //pkg/executor/test/jointest/hashjoin:hashjoin_test (shard 10 of 10):
==================== Test output for //pkg/executor/test/jointest/hashjoin:hashjoin_test (shard 10 of 10):
[2024/02/21 12:32:55.199 +00:00] [INFO] [region_cache.go:2711] ["change store resolve state"] [store=1] [addr=store1] [from=unresolved] [to=resolved] [liveness-state=reachable]
[2024/02/21 12:32:55.199 +00:00] [INFO] [ddl_api.go:1125] ["Automatically convert BLOB(65535) to MEDIUMBLOB"]
[2024/02/21 12:32:55.200 +00:00] [INFO] [ddl_api.go:1125] ["Automatically convert BLOB(65535) to MEDIUMBLOB"]
[2024/02/21 12:32:55.201 +00:00] [INFO] [ddl_api.go:1125] ["Automatically convert BLOB(65535) to MEDIUMBLOB"]
[2024/02/21 12:32:57.704 +00:00] [ERROR] [misc.go:91] ["panic in the recoverable goroutine"] [r="failpoint panic: IndexHashJoinBuildHashTablePanic"] ["stack trace"="github.com/pingcap/tidb/pkg/util.WithRecovery.func1\n\tpkg/util/misc.go:93\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/failpoint.actPanic\n\texternal/com_github_pingcap_failpoint/terms.go:344\ngithub.com/pingcap/failpoint.(*term).do\n\texternal/com_github_pingcap_failpoint/terms.go:311\ngithub.com/pingcap/failpoint.(*terms).eval\n\texternal/com_github_pingcap_failpoint/terms.go:116\ngithub.com/pingcap/failpoint.(*Failpoint).Eval\n\texternal/com_github_pingcap_failpoint/failpoint.go:107\ngithub.com/pingcap/failpoint.(*Failpoints).Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:210\ngithub.com/pingcap/failpoint.Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:271\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).buildHashTableForOuterResult\n\tpkg/executor/index_lookup_hash_join.go:573\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).handleTask.func3\n\tpkg/executor/index_lookup_hash_join.go:667\ngithub.com/pingcap/tidb/pkg/util.WithRecovery\n\tpkg/util/misc.go:96"] [stack="github.com/pingcap/tidb/pkg/util.WithRecovery.func1\n\tpkg/util/misc.go:91\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/failpoint.actPanic\n\texternal/com_github_pingcap_failpoint/terms.go:344\ngithub.com/pingcap/failpoint.(*term).do\n\texternal/com_github_pingcap_failpoint/terms.go:311\ngithub.com/pingcap/failpoint.(*terms).eval\n\texternal/com_github_pingcap_failpoint/terms.go:116\ngithub.com/pingcap/failpoint.(*Failpoint).Eval\n\texternal/com_github_pingcap_failpoint/failpoint.go:107\ngithub.com/pingcap/failpoint.(*Failpoints).Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:210\ngithub.com/pingcap/failpoint.Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:271\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).buildHashTableForOuterResult\n\tpkg/executor/index_lookup_hash_join.go:573\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).handleTask.func3\n\tpkg/executor/index_lookup_hash_join.go:667\ngithub.com/pingcap/tidb/pkg/util.WithRecovery\n\tpkg/util/misc.go:96"]
[2024/02/21 12:32:57.704 +00:00] [ERROR] [misc.go:91] ["panic in the recoverable goroutine"] [r="failpoint panic: IndexHashJoinBuildHashTablePanic"] ["stack trace"="github.com/pingcap/tidb/pkg/util.WithRecovery.func1\n\tpkg/util/misc.go:93\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/failpoint.actPanic\n\texternal/com_github_pingcap_failpoint/terms.go:344\ngithub.com/pingcap/failpoint.(*term).do\n\texternal/com_github_pingcap_failpoint/terms.go:311\ngithub.com/pingcap/failpoint.(*terms).eval\n\texternal/com_github_pingcap_failpoint/terms.go:116\ngithub.com/pingcap/failpoint.(*Failpoint).Eval\n\texternal/com_github_pingcap_failpoint/failpoint.go:107\ngithub.com/pingcap/failpoint.(*Failpoints).Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:210\ngithub.com/pingcap/failpoint.Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:271\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).buildHashTableForOuterResult\n\tpkg/executor/index_lookup_hash_join.go:573\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).handleTask.func3\n\tpkg/executor/index_lookup_hash_join.go:667\ngithub.com/pingcap/tidb/pkg/util.WithRecovery\n\tpkg/util/misc.go:96"] [stack="github.com/pingcap/tidb/pkg/util.WithRecovery.func1\n\tpkg/util/misc.go:91\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/failpoint.actPanic\n\texternal/com_github_pingcap_failpoint/terms.go:344\ngithub.com/pingcap/failpoint.(*term).do\n\texternal/com_github_pingcap_failpoint/terms.go:311\ngithub.com/pingcap/failpoint.(*terms).eval\n\texternal/com_github_pingcap_failpoint/terms.go:116\ngithub.com/pingcap/failpoint.(*Failpoint).Eval\n\texternal/com_github_pingcap_failpoint/failpoint.go:107\ngithub.com/pingcap/failpoint.(*Failpoints).Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:210\ngithub.com/pingcap/failpoint.Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:271\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).buildHashTableForOuterResult\n\tpkg/executor/index_lookup_hash_join.go:573\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).handleTask.func3\n\tpkg/executor/index_lookup_hash_join.go:667\ngithub.com/pingcap/tidb/pkg/util.WithRecovery\n\tpkg/util/misc.go:96"]
[2024/02/21 12:32:57.704 +00:00] [ERROR] [misc.go:91] ["panic in the recoverable goroutine"] [r="failpoint panic: IndexHashJoinBuildHashTablePanic"] ["stack trace"="github.com/pingcap/tidb/pkg/util.WithRecovery.func1\n\tpkg/util/misc.go:93\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/failpoint.actPanic\n\texternal/com_github_pingcap_failpoint/terms.go:344\ngithub.com/pingcap/failpoint.(*term).do\n\texternal/com_github_pingcap_failpoint/terms.go:311\ngithub.com/pingcap/failpoint.(*terms).eval\n\texternal/com_github_pingcap_failpoint/terms.go:116\ngithub.com/pingcap/failpoint.(*Failpoint).Eval\n\texternal/com_github_pingcap_failpoint/failpoint.go:107\ngithub.com/pingcap/failpoint.(*Failpoints).Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:210\ngithub.com/pingcap/failpoint.Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:271\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).buildHashTableForOuterResult\n\tpkg/executor/index_lookup_hash_join.go:573\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).handleTask.func3\n\tpkg/executor/index_lookup_hash_join.go:667\ngithub.com/pingcap/tidb/pkg/util.WithRecovery\n\tpkg/util/misc.go:96"] [stack="github.com/pingcap/tidb/pkg/util.WithRecovery.func1\n\tpkg/util/misc.go:91\nruntime.gopanic\n\tGOROOT/src/runtime/panic.go:914\ngithub.com/pingcap/failpoint.actPanic\n\texternal/com_github_pingcap_failpoint/terms.go:344\ngithub.com/pingcap/failpoint.(*term).do\n\texternal/com_github_pingcap_failpoint/terms.go:311\ngithub.com/pingcap/failpoint.(*terms).eval\n\texternal/com_github_pingcap_failpoint/terms.go:116\ngithub.com/pingcap/failpoint.(*Failpoint).Eval\n\texternal/com_github_pingcap_failpoint/failpoint.go:107\ngithub.com/pingcap/failpoint.(*Failpoints).Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:210\ngithub.com/pingcap/failpoint.Eval\n\texternal/com_github_pingcap_failpoint/failpoints.go:271\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).buildHashTableForOuterResult\n\tpkg/executor/index_lookup_hash_join.go:573\ngithub.com/pingcap/tidb/pkg/executor.(*indexHashJoinInnerWorker).handleTask.func3\n\tpkg/executor/index_lookup_hash_join.go:667\ngithub.com/pingcap/tidb/pkg/util.WithRecovery\n\tpkg/util/misc.go:96"]
Error Trace: pkg/executor/test/jointest/hashjoin/hash_join_test.go:445
[2024/02/21 12:32:57.705 +00:00] [INFO] [mock.go:106] ["owner manager is canceled"] [category=ddl] [ID=e8eac7a1-e048-4025-bda4-bb70a9f7acdf] [ownerKey=/tidb/ddl/fg/owner]
[2024/02/21 12:32:57.705 +00:00] [INFO] [ddl_workerpool.go:83] ["closing workerPool"] [category=ddl]
[2024/02/21 12:32:57.705 +00:00] [INFO] [ddl_worker.go:186] ["DDL worker closed"] [worker="worker 10, tp add index"] [category=ddl] ["take time"=3.75µs]
[2024/02/21 12:32:57.705 +00:00] [INFO] [ddl_worker.go:186] ["DDL worker closed"] [worker="worker 7, tp add index"] [category=ddl] ["take time"=2.75µs]
[2024/02/21 12:32:57.713 +00:00] [INFO] [db.go:592] ["Memtable flushed"]
[2024/02/21 12:32:57.713 +00:00] [INFO] [db.go:596] ["Compaction finished"]
[2024/02/21 12:32:57.713 +00:00] [INFO] [db.go:615] ["BlobManager finished"]
[2024/02/21 12:32:57.713 +00:00] [INFO] [db.go:619] ["ResourceManager finished"]
[2024/02/21 12:32:57.713 +00:00] [INFO] [db.go:625] ["Waiting for closer"]
--- FAIL: TestIssue31129 (2.55s)
coverage: 10.4% of statements
Coverage runner: Not collecting coverage for failed test.
The following commands failed with status 1
/root/.cache/bazel/_bazel_root/87ed6087912c296e834108bb969b41ce/sandbox/processwrapper-sandbox/9881/execroot/_main/bazel-out/k8-fastbuild/bin/pkg/executor/test/jointest/hashjoin/hashjoin_test_/hashjoin_test.runfiles/_main/pkg/executor/test/jointest/hashjoin/hashjoin_test_/hashjoin_test
================================================================================
[32m[11,136 / 11,777][0m 329 / 393 tests;[0m Testing //pkg/executor/test/analyzetest/memorycontrol:memorycontrol_test (shard 2 of 5); 12s processwrapper-sandbox ... (33 actions, 32 running)
[32m[11,138 / 11,777][0m 329 / 393 tests;[0m Testing //pkg/executor/test/analyzetest/memorycontrol:memorycontrol_test (shard 2 of 5); 13s processwrapper-sandbox ... (33 actions running)
[32m[11,147 / 11,778][0m 329 / 393 tests;[0m Testing //pkg/executor/test/analyzetest/memorycontrol:memorycontrol_test (shard 2 of 5); 14s processwrapper-sandbox ... (33 actions running)
[32m[11,155 / 11,778][0m 331 / 393 tests;[0m Testing //pkg/executor/test/analyzetest/memorycontrol:memorycontrol_test (shard 2 of 5); 15s processwrapper-sandbox ... (33 actions, 32 running)
[32m[11,156 / 11,778][0m 331 / 393 tests;[0m Testing //pkg/executor/test/seqtest:seqtest_test (shard 9 of 28); 6s processwrapper-sandbox ... (33 actions running)