Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

*: a bunch of failures #110498

Closed
cockroach-teamcity opened this issue Sep 12, 2023 · 55 comments
Closed

*: a bunch of failures #110498

cockroach-teamcity opened this issue Sep 12, 2023 · 55 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-testeng TestEng Team
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Sep 12, 2023

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/pretty:pretty_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/pretty:pretty_test (3 packages loaded, 12227 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[9 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[10 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[11 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[12 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[16 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[17 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[19 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[29 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[34 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[35 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[37 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[38 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[39 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[40 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[43 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[44 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (4 actions running)
[48 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[55 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions, 3 running)
[65 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[79 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
[96 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-31577

@cockroach-teamcity cockroach-teamcity added C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-testeng TestEng Team branch-release-23.1.10-rc labels Sep 12, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.2 milestone Sep 12, 2023
@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/quotapool:quotapool_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/quotapool:quotapool_test (48 packages loaded, 11182 targets configured)
Analyzing: target //pkg/util/quotapool:quotapool_test (147 packages loaded, 15354 targets configured)
Analyzing: target //pkg/util/quotapool:quotapool_test (199 packages loaded, 18333 targets configured)
INFO: Analyzed target //pkg/util/quotapool:quotapool_test (208 packages loaded, 20295 targets configured).
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[348 / 1,218] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[348 / 1,218] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[349 / 1,218] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[355 / 1,218] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 20s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
[361 / 1,218] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 21s processwrapper-sandbox
Target //pkg/util/quotapool:quotapool_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/randident:randident_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/randident:randident_test (12 packages loaded, 14039 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[268 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions running)
[268 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[269 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 27s processwrapper-sandbox ... (4 actions, 3 running)
[272 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions running)
[275 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions running)
[279 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions running)
[283 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[290 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[296 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[302 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions, 3 running)
[306 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions, 3 running)
[310 / 733] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions running)
[318 / 733] GoCompilePkg external/com_github_gogo_protobuf/plugin/gostring/gostring.a [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[337 / 733] GoCompilePkg external/com_github_gogo_protobuf/types/types.a [for tool]; 0s processwrapper-sandbox ... (3 actions running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/util/randutil:randutil_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
INFO: Elapsed time: 57.435s, Critical Path: 53.45s
INFO: 77 processes: 15 internal, 62 processwrapper-sandbox.

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/rangedesc:rangedesc_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (190 packages loaded, 4811 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (347 packages loaded, 11046 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (404 packages loaded, 12070 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (522 packages loaded, 13742 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (605 packages loaded, 15701 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (717 packages loaded, 19154 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (870 packages loaded, 20952 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (936 packages loaded, 24286 targets configured)
Analyzing: target //pkg/util/rangedesc:rangedesc_test (1003 packages loaded, 26846 targets configured)
INFO: Analyzed target //pkg/util/rangedesc:rangedesc_test (1047 packages loaded, 27659 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[139 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[139 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[140 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (4 actions, 3 running)
[143 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[146 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[150 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions, 3 running)
[153 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 31s processwrapper-sandbox ... (4 actions running)
[159 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 32s processwrapper-sandbox ... (4 actions, 3 running)
[164 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[168 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[171 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions running)
[177 / 514] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runti

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/quantile:quantile_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/quantile:quantile_test (3 packages loaded, 12225 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[9 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[12 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[12 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[13 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[15 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[16 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[17 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[21 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[22 / 224] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[30 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[33 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[33 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[35 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[36 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[38 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[40 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[43 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[45 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[47 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[47 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (4 actions running)
[51 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions running)
[63 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 224] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/protoutil:protoutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/protoutil:protoutil_test (116 packages loaded, 10777 targets configured)
Analyzing: target //pkg/util/protoutil:protoutil_test (209 packages loaded, 13430 targets configured)
Analyzing: target //pkg/util/protoutil:protoutil_test (347 packages loaded, 16417 targets configured)
Analyzing: target //pkg/util/protoutil:protoutil_test (373 packages loaded, 18492 targets configured)
INFO: Analyzed target //pkg/util/protoutil:protoutil_test (396 packages loaded, 22493 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[129 / 549] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[129 / 549] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[130 / 549] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[352 / 1,258] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[352 / 1,258] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[353 / 1,258] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[367 / 1,258] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[370 / 1,258] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[381 / 1,258] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[396 / 1,258] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[398 / 1,258] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 20s processwrapper-sandbox ... (4 actions, 3 running)
[413 / 1,258] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: reloca

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/retry:retry_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/retry:retry_test (32 packages loaded, 12559 targets configured)
INFO: Analyzed target //pkg/util/retry:retry_test (97 packages loaded, 15400 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[10 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[11 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[12 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[14 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[18 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[21 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[24 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[27 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[30 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[38 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[40 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[46 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[53 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[54 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[56 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[64 / 314] Compiling src/google/protobuf/generated_message_table_driven_lite.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[93 / 314] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[136 / 314] GoCompilePkg external/co_honnef_go_tools/staticcheck/fakexml/fakexml.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90e

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/ring:ring_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/ring:ring_test (12 packages loaded, 13175 targets configured)
INFO: Analyzed target //pkg/util/ring:ring_test (26 packages loaded, 14196 targets configured).
INFO: Found 1 test target...
[0 / 7] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[5 / 63] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[5 / 63] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[6 / 63] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[17 / 173] Compiling src/google/protobuf/struct.pb.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[18 / 173] Compiling src/google/protobuf/struct.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[19 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[19 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[20 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[22 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[23 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[25 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[29 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[31 / 173] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not define

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/shuffle:shuffle_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/shuffle:shuffle_test (9 packages loaded, 12786 targets configured)
INFO: Analyzed target //pkg/util/shuffle:shuffle_test (25 packages loaded, 14095 targets configured).
INFO: Found 1 test target...
[0 / 1] checking cached actions
[9 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[10 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[15 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[20 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[20 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[23 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[24 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[25 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[27 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[29 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[30 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[32 / 208] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions running)
[43 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions running)
[44 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions running)
[47 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions, 3 running)
[47 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (4 actions running)
[48 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions running)
[55 / 208] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messa

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/search:search_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/search:search_test (10 packages loaded, 13090 targets configured)
INFO: Analyzed target //pkg/util/search:search_test (23 packages loaded, 14134 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[11 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[12 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[12 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[13 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[16 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[22 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[24 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[26 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[27 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[31 / 314] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[38 / 314] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[39 / 314] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions running)
[43 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 7s processwrapper-sandbox ... (4 actions, 3 running)
[44 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions running)
[45 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 9s processwrapper-sandbox ... (4 actions running)
[46 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[47 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions running)
[52 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions, 3 running)
[54 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions, 3 running)
[55 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions running)
[63 / 314] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder lin

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[56 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[59 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[61 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[63 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[64 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[66 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[70 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[73 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[76 / 219] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[78 / 219] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[82 / 219] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 219] Compiling src/google/protobuf/compiler/importer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[86 / 219] Compiling src/google/protobuf/compiler/parser.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[90 / 219] Compiling src/google/protobuf/extension_set_heavy.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[93 / 219] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[96 / 219] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[101 / 219] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[103 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[106 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[108 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[112 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[133 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[146 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[157 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[174 / 493] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[199 / 493] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[210 / 493] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[235 / 493] GoCompilePkg external/org_golang_x_tools/go/internal/cgo/cgo.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire n

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[41 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions running)
[42 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions running)
[43 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[46 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions running)
[51 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions, 3 running)
[52 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[54 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
[59 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions running)
[62 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (4 actions, 3 running)
[68 / 215] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[73 / 215] Compiling src/google/protobuf/util/internal/protostream_objectsource.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[78 / 215] Compiling src/google/protobuf/generated_message_util.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 215] Compiling src/google/protobuf/util/field_mask_util.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[89 / 215] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[92 / 215] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[94 / 215] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[99 / 215] Compiling src/google/protobuf/extension_set_heavy.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[102 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[104 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[107 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[107 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[111 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[128 / 504] Compiling src/google/protobuf/struct.pb.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[149 / 504] Compiling src/google/protobuf/struct.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[175 / 504] Compiling src/google/protobuf/struct.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[183 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[213 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[242 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[261 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __t

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/stringarena:stringarena_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/stringarena:stringarena_test (80 packages loaded, 11838 targets configured)
INFO: Analyzed target //pkg/util/stringarena:stringarena_test (173 packages loaded, 15937 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 541] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[131 / 541] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[132 / 541] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[269 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[269 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[270 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 27s processwrapper-sandbox ... (4 actions, 3 running)
[273 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 28s processwrapper-sandbox ... (4 actions, 3 running)
[276 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 29s processwrapper-sandbox ... (4 actions, 3 running)
[279 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 30s processwrapper-sandbox ... (4 actions running)
[280 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 33s processwrapper-sandbox ... (4 actions, 3 running)
[286 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 34s processwrapper-sandbox ... (4 actions, 3 running)
[290 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 35s processwrapper-sandbox ... (4 actions running)
[294 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 36s processwrapper-sandbox ... (4 actions running)
[298 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 37s processwrapper-sandbox ... (4 actions, 3 running)
[306 / 805] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 38s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-529502155522/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runti

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/stop:stop_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/stop:stop_test (75 packages loaded, 10935 targets configured)
Analyzing: target //pkg/util/stop:stop_test (179 packages loaded, 15073 targets configured)
Analyzing: target //pkg/util/stop:stop_test (204 packages loaded, 18818 targets configured)
INFO: Analyzed target //pkg/util/stop:stop_test (208 packages loaded, 20289 targets configured).
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[11 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[13 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[14 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[16 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[17 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[19 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[22 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[25 / 418] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[34 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[35 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[37 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[38 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[40 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[45 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[45 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[46 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[50 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions running)
[51 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[52 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[58 / 418] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/strutil:strutil_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/strutil:strutil_test (3 packages loaded, 12268 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[8 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[10 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[13 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[19 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[20 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[23 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[24 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[26 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[27 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[29 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[30 / 209] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions running)
[39 / 209] Compiling src/google/protobuf/util/time_util.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[43 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[45 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[46 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[48 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[53 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[55 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[56 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[59 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[61 / 209] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox buil

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[49 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[53 / 215] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[59 / 215] Compiling src/google/protobuf/wire_format.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[62 / 215] Compiling src/google/protobuf/wire_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[70 / 215] Compiling src/google/protobuf/util/internal/protostream_objectsource.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[76 / 215] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[78 / 215] Compiling src/google/protobuf/util/internal/datapiece.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 215] Compiling src/google/protobuf/empty.pb.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 215] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[90 / 215] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[92 / 215] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[97 / 215] Compiling src/google/protobuf/extension_set_heavy.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[100 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[102 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[103 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[105 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[107 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[111 / 215] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[142 / 504] Compiling src/google/protobuf/struct.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[152 / 504] Compiling src/google/protobuf/struct.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[170 / 504] Compiling src/google/protobuf/struct.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[205 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[219 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[248 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[270 / 504] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[301 / 504] GoCompilePkg external/com_github_gogo_protobuf/plugin/description/description.a [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.ra

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/startup:startup_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/startup:startup_test (230 packages loaded, 9678 targets configured)
Analyzing: target //pkg/util/startup:startup_test (342 packages loaded, 10134 targets configured)
Analyzing: target //pkg/util/startup:startup_test (401 packages loaded, 10758 targets configured)
Analyzing: target //pkg/util/startup:startup_test (512 packages loaded, 12853 targets configured)
Analyzing: target //pkg/util/startup:startup_test (583 packages loaded, 15618 targets configured)
Analyzing: target //pkg/util/startup:startup_test (658 packages loaded, 18046 targets configured)
Analyzing: target //pkg/util/startup:startup_test (711 packages loaded, 20599 targets configured)
Analyzing: target //pkg/util/startup:startup_test (800 packages loaded, 23497 targets configured)
Analyzing: target //pkg/util/startup:startup_test (960 packages loaded, 26289 targets configured)
Analyzing: target //pkg/util/startup:startup_test (1001 packages loaded, 27014 targets configured)
INFO: Analyzed target //pkg/util/startup:startup_test (1045 packages loaded, 27648 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 10] [Prepa] BazelWorkspaceStatusAction stable-status.txt ... (2 actions, 0 running)
[10 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[18 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[25 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[26 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[27 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[28 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[30 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[32 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[33 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[34 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[35 / 396] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 396] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[45 / 396] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 396] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[48 / 396] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[50 / 396] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[52 / 396] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[53 / 396] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[54 / 396] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[55 / 396] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[55 / 3

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/span:span_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/span:span_test (51 packages loaded, 11460 targets configured)
Analyzing: target //pkg/util/span:span_test (127 packages loaded, 13855 targets configured)
Analyzing: target //pkg/util/span:span_test (191 packages loaded, 17270 targets configured)
INFO: Analyzed target //pkg/util/span:span_test (204 packages loaded, 20269 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[9 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[10 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[11 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[15 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[16 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[17 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[18 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[19 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[25 / 409] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions running)
[34 / 409] Compiling src/google/protobuf/descriptor_database.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[35 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[37 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[39 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[41 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[42 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[43 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[45 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions running)
[47 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 20s processwrapper-sandbox ... (4 actions running)
[55 / 409] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[39 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions, 3 running)
[40 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions running)
[43 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 9s processwrapper-sandbox ... (4 actions running)
[45 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions running)
[46 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions running)
[47 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions running)
[50 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions running)
[51 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions running)
[52 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions running)
[56 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
[59 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions running)
[61 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (4 actions running)
[64 / 211] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (3 actions running)
[70 / 211] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[75 / 211] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[78 / 211] Compiling src/google/protobuf/generated_message_util.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 211] Compiling src/google/protobuf/util/field_mask_util.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 211] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[91 / 211] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[93 / 211] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[96 / 211] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[99 / 211] Compiling src/google/protobuf/extension_set_heavy.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[102 / 211] Compiling src/google/protobuf/descriptor.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[104 / 211] Compiling src/google/protobuf/descriptor.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[106 / 211] Compiling src/google/protobuf/descriptor.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[107 / 211] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[110 / 211] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[120 / 240] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[149 / 500] Compiling src/google/protobuf/struct.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[155 / 500] Compiling src/google/protobuf/struct.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[179 / 500] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[217 / 500] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defin

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[66 / 400] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[71 / 400] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[73 / 400] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[76 / 400] Compiling src/google/protobuf/util/internal/datapiece.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[83 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[89 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[94 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[97 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[101 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[107 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[110 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[111 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[123 / 488] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[127 / 496] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[129 / 525] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[129 / 525] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[130 / 525] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[141 / 638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[142 / 638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[142 / 638] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[143 / 638] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[156 / 638] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[178 / 638] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[194 / 638] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/sysutil:sysutil_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/sysutil:sysutil_test (3 packages loaded, 13294 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[8 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[10 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[13 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[18 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[19 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[21 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[23 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[25 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[26 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[27 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[28 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[30 / 205] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions running)
[38 / 205] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[41 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[45 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[46 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[47 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[49 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[53 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[60 / 205] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[65 / 205] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 205] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: erro

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/timeutil:timeutil_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/timeutil:timeutil_test (30 packages loaded, 12549 targets configured)
Analyzing: target //pkg/util/timeutil:timeutil_test (95 packages loaded, 15376 targets configured)
INFO: Analyzed target //pkg/util/timeutil:timeutil_test (97 packages loaded, 15406 targets configured).
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[10 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[11 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[15 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[16 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[18 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[18 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[19 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[29 / 408] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions running)
[34 / 408] Compiling src/google/protobuf/descriptor_database.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[35 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions, 3 running)
[37 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions running)
[40 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions, 3 running)
[40 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 7s processwrapper-sandbox ... (4 actions running)
[41 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions running)
[42 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions running)
[43 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (4 actions running)
[44 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions running)
[48 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[61 / 408] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see ver

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/timeofday:timeofday_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/timeofday:timeofday_test (21 packages loaded, 12396 targets configured)
INFO: Analyzed target //pkg/util/timeofday:timeofday_test (52 packages loaded, 14553 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[9 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[10 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[11 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[13 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[16 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[18 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[20 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 210] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[31 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[34 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[36 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[38 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[39 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[39 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[40 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[41 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[44 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[45 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[47 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[47 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (4 actions running)
[50 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[54 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[60 / 210] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/trigram:trigram_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/trigram:trigram_test (3 packages loaded, 12262 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 3] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[131 / 507] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[131 / 507] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (3 actions running)
[132 / 507] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (3 actions, 2 running)
[140 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (3 actions running)
[140 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 11s processwrapper-sandbox ... (3 actions running)
[141 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (3 actions, 2 running)
[149 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
[156 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions, 3 running)
[165 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (4 actions running)
[177 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 25s processwrapper-sandbox ... (4 actions, 3 running)
[194 / 507] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 26s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: 

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/treeprinter:treeprinter_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/treeprinter:treeprinter_test (3 packages loaded, 12225 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 5] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[9 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[11 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[12 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[13 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[15 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[16 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[18 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[22 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[34 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions, 3 running)
[36 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[37 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions running)
[40 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions running)
[43 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions, 3 running)
[44 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 7s processwrapper-sandbox ... (4 actions running)
[45 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions running)
[46 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions, 3 running)
[46 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (4 actions running)
[48 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions running)
[52 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions running)
[59 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/tsearch:tsearch_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/util/tsearch:tsearch_test (40 packages loaded, 11916 targets configured)
INFO: Analyzed target //pkg/util/tsearch:tsearch_test (98 packages loaded, 14971 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[8 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[11 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[14 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[26 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[27 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[28 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[30 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[32 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[33 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[35 / 294] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[46 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[52 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[53 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[55 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[56 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[59 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[59 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[62 / 294] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[68 / 294] Compiling src/google/protobuf/map_field.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for deb

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/unique:unique_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/unique:unique_test (3 packages loaded, 12225 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 6] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[9 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[11 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[12 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[13 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[14 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[16 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[16 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[17 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[20 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[21 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[22 / 225] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[30 / 225] Compiling src/google/protobuf/wire_format_lite.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[32 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[33 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[35 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions running)
[36 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions, 3 running)
[38 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 7s processwrapper-sandbox ... (4 actions, 3 running)
[40 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 9s processwrapper-sandbox ... (4 actions running)
[43 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions, 3 running)
[43 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions running)
[44 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (4 actions, 3 running)
[45 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions, 3 running)
[47 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions running)
[48 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions running)
[51 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[53 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
[70 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (4 actions, 3 running)
[93 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 225] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions, 3 running

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[63 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[64 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[67 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[69 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[74 / 219] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[76 / 219] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[78 / 219] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[83 / 219] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 219] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[86 / 219] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[91 / 219] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[94 / 219] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[95 / 219] Compiling src/google/protobuf/type.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[100 / 219] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[103 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[107 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[110 / 219] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[133 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[163 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[183 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[197 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[234 / 493] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[246 / 493] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit st

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[54 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[59 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[63 / 256] Compiling src/google/protobuf/util/internal/protostream_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[67 / 256] Compiling src/google/protobuf/util/internal/type_info_test_helper.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[71 / 256] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[73 / 256] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[76 / 256] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[80 / 256] Compiling src/google/protobuf/compiler/parser.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[86 / 256] Compiling src/google/protobuf/extension_set_heavy.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[89 / 256] Compiling src/google/protobuf/message.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[91 / 256] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[93 / 256] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[94 / 256] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[98 / 256] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[101 / 256] Compiling src/google/protobuf/type.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[103 / 256] Compiling src/google/protobuf/descriptor_database.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[105 / 256] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[109 / 256] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[110 / 256] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[114 / 256] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[142 / 501] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[157 / 501] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[183 / 501] Compiling src/google/protobuf/descriptor.cc [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[208 / 501] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[55 / 400] Compiling src/google/protobuf/wire_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[58 / 400] Compiling src/google/protobuf/wire_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[61 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[65 / 400] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[68 / 400] Compiling src/google/protobuf/util/internal/protostream_objectsource.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[73 / 400] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[75 / 400] Compiling src/google/protobuf/util/internal/datapiece.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[81 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[86 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[92 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[95 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[98 / 400] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[101 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[111 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[123 / 488] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[124 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[127 / 496] Compiling src/google/protobuf/descriptor.cc [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[129 / 500] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[130 / 500] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[137 / 537] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[138 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[145 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[150 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[155 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions running)
[160 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions running)
[162 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions running)
[165 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions running)
[170 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (4 actions, 3 running)
[182 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 22s processwrapper-sandbox ... (4 actions, 3 running)
[186 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (4 actions running)
[193 / 537] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (4 actions, 3 running)
[200 / 537] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation tar

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/workload/cli:cli_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/workload/cli:cli_test (44 packages loaded, 12286 targets configured)
Analyzing: target //pkg/workload/cli:cli_test (172 packages loaded, 15017 targets configured)
Analyzing: target //pkg/workload/cli:cli_test (249 packages loaded, 18252 targets configured)
INFO: Analyzed target //pkg/workload/cli:cli_test (268 packages loaded, 20865 targets configured).
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[11 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (3 actions running)
[12 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[17 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[19 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[20 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[24 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[28 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[29 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[32 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[35 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[38 / 270] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[52 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[55 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[56 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[58 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[59 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (4 actions running)
[62 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions, 3 running)
[72 / 270] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build ro

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/util/version:version_test (0 packages loaded, 0 targets configured)
INFO: Analyzed target //pkg/util/version:version_test (3 packages loaded, 12971 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[12 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[13 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[14 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[17 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[26 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[29 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[31 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[31 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[32 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[34 / 315] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[44 / 315] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[45 / 315] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[46 / 315] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions, 3 running)
[52 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions running)
[53 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 6s processwrapper-sandbox ... (4 actions running)
[54 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 9s processwrapper-sandbox ... (4 actions, 3 running)
[54 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions running)
[55 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 15s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions running)
[59 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions, 3 running)
[60 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions, 3 running)
[69 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions, 3 running)
[86 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (4 actions, 3 running)
[100 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions, 3 running)
[130 / 315] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 24s processwrapper-sandbox ... (4 actions, 3 running)
[162 / 315] GoCompile

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/workload/bank:bank_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (249 packages loaded, 9960 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (353 packages loaded, 11470 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (530 packages loaded, 14056 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (552 packages loaded, 15344 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (594 packages loaded, 15684 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (690 packages loaded, 17337 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (755 packages loaded, 20563 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (764 packages loaded, 24178 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (981 packages loaded, 26601 targets configured)
Analyzing: target //pkg/workload/bank:bank_test (1006 packages loaded, 27059 targets configured)
INFO: Analyzed target //pkg/workload/bank:bank_test (1047 packages loaded, 27653 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[11 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[12 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[13 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[14 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[15 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[16 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[18 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[19 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[22 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[30 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[34 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[36 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[37 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[40 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[43 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[44 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[47 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox .

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/workload/histogram:histogram_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/workload/histogram:histogram_test (18 packages loaded, 12166 targets configured)
INFO: Analyzed target //pkg/workload/histogram:histogram_test (39 packages loaded, 14716 targets configured).
INFO: Found 1 test target...
[0 / 2] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[13 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[14 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[15 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[19 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[23 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[24 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[24 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[25 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[27 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[29 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[30 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[32 / 410] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[42 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[45 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[47 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[48 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[50 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[52 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[54 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[55 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[56 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 16s processwrapper-sandbox ... (4 actions running)
[58 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (4 actions running)
[60 / 410] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/workload/insights:insights_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (275 packages loaded, 10380 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (350 packages loaded, 11650 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (415 packages loaded, 12420 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (457 packages loaded, 12451 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (576 packages loaded, 15198 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (722 packages loaded, 18127 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (751 packages loaded, 21330 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (947 packages loaded, 24889 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (988 packages loaded, 26779 targets configured)
Analyzing: target //pkg/workload/insights:insights_test (1036 packages loaded, 27500 targets configured)
INFO: Analyzed target //pkg/workload/insights:insights_test (1047 packages loaded, 27653 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt ... (2 actions, 0 running)
[12 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[13 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[14 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[15 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[16 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[17 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[19 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[20 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[23 / 256] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions running)
[31 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[32 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[35 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[37 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[37 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[39 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[41 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[43 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[44 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[46 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 256] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 14s processwrapper-sandbox ... (4

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[72 / 422] Compiling src/google/protobuf/wire_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[77 / 422] Compiling src/google/protobuf/implicit_weak_message.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[82 / 422] Compiling src/google/protobuf/type.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[83 / 422] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[84 / 422] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[88 / 422] Compiling src/google/protobuf/message.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[94 / 422] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[97 / 422] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[102 / 422] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[104 / 422] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[111 / 422] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[129 / 507] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[138 / 508] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (3 actions running)
[138 / 508] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (3 actions running)
[139 / 508] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (3 actions, 2 running)
[147 / 508] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
[158 / 508] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions, 3 running)
[177 / 508] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 20s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/workload/faker:faker_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
INFO: Elap

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ bd61e36a4eddea38a9b0c55d19bc260840e30a3a:

[25 / 292] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[31 / 292] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[33 / 292] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[35 / 292] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[36 / 292] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[37 / 292] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[44 / 292] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[45 / 292] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[47 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions running)
[49 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 8s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 10s processwrapper-sandbox ... (4 actions running)
[50 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 13s processwrapper-sandbox ... (4 actions, 3 running)
[51 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 14s processwrapper-sandbox ... (4 actions, 3 running)
[51 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 16s processwrapper-sandbox ... (4 actions running)
[53 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 17s processwrapper-sandbox ... (4 actions running)
[57 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 18s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 20s processwrapper-sandbox ... (4 actions running)
[59 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 21s processwrapper-sandbox ... (4 actions running)
[60 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
[62 / 292] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 23s processwrapper-sandbox ... (4 actions, 3 running)
[65 / 292] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[67 / 292] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[70 / 292] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[73 / 292] Compiling src/google/protobuf/descriptor.cc [for tool]; 10s processwrapper-sandbox ... (4 actions, 3 running)
[78 / 292] Compiling src/google/protobuf/text_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[82 / 292] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[86 / 292] Compiling src/google/protobuf/message.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[90 / 292] Compiling src/google/protobuf/type.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[93 / 292] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[98 / 292] Compiling src/google/protobuf/util/internal/protostream_objectsource.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[100 / 292] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[102 / 292] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 292] Compiling src/google/protobuf/api.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[109 / 292] Compiling src/google/protobuf/descriptor_database.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[116 / 292] Compiling src/google/protobuf/extension_set.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[137 / 501] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[152 / 501] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[183 / 501] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[198 / 501] GoCompilePkg external/co_honnef_go_tools/go/ir/ir.a [for tool]; 0s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p)

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/workload/movr:movr_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/workload/movr:movr_test (19 packages loaded, 12557 targets configured)
Analyzing: target //pkg/workload/movr:movr_test (121 packages loaded, 15163 targets configured)
Analyzing: target //pkg/workload/movr:movr_test (192 packages loaded, 18471 targets configured)
INFO: Analyzed target //pkg/workload/movr:movr_test (204 packages loaded, 20374 targets configured).
INFO: Found 1 test target...
[0 / 8] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[13 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[14 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[15 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[19 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[22 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[24 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[24 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[25 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[28 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[29 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[32 / 411] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[41 / 411] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[43 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[46 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[48 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[52 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[53 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[54 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[55 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[57 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[58 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 18s processwrapper-sandbox ... (4 actions running)
[64 / 411] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 19s processwrapper-sandbox ... (4 actions running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed:

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

[54 / 400] Compiling src/google/protobuf/wire_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[58 / 400] Compiling src/google/protobuf/any_lite.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[61 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[64 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[68 / 400] Compiling src/google/protobuf/util/internal/proto_writer.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[72 / 400] Compiling src/google/protobuf/util/internal/protostream_objectwriter.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[74 / 400] Compiling src/google/protobuf/generated_message_table_driven_lite.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[77 / 400] Compiling src/google/protobuf/generated_message_table_driven_lite.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[83 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[94 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[96 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[100 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[104 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[108 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[111 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[123 / 488] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[124 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[127 / 496] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[129 / 506] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[130 / 521] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[131 / 521] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[142 / 634] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[144 / 634] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[145 / 634] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[149 / 634] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[161 / 634] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[183 / 634] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[198 / 634] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.rac

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

[65 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[70 / 400] Compiling src/google/protobuf/util/internal/proto_writer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[73 / 400] Compiling src/google/protobuf/util/internal/protostream_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[76 / 400] Compiling src/google/protobuf/generated_message_table_driven_lite.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[81 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[94 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[96 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[99 / 400] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[103 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[107 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[111 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[124 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[125 / 493] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[127 / 496] Compiling src/google/protobuf/descriptor.cc [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[129 / 596] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[130 / 596] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[141 / 709] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[141 / 709] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[142 / 709] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[143 / 709] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[151 / 709] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[172 / 709] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[195 / 709] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (3 actions, 2 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/p

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

[56 / 400] Compiling src/google/protobuf/wire_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[59 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[62 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[66 / 400] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[70 / 400] Compiling src/google/protobuf/util/internal/proto_writer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[73 / 400] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[76 / 400] Compiling src/google/protobuf/util/internal/datapiece.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[83 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[94 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[97 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[101 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[111 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[123 / 488] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (4 actions running)
[124 / 491] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[127 / 496] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[129 / 524] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[129 / 524] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[130 / 524] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[139 / 635] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[140 / 635] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[141 / 635] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[142 / 635] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[154 / 635] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[159 / 635] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[176 / 635] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[189 / 635] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[215 / 635] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 17s processwrapper-sandbox ... (4 actions, 3 running)
[240 / 635] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

[32 / 400] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[35 / 400] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[42 / 400] Compiling src/google/protobuf/struct.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[46 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[50 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[52 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[54 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[55 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 7s processwrapper-sandbox ... (4 actions, 3 running)
[55 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[56 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions, 3 running)
[58 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[61 / 400] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[64 / 400] Compiling src/google/protobuf/wire_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[67 / 400] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[69 / 400] Compiling src/google/protobuf/util/internal/protostream_objectsource.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[74 / 400] Compiling src/google/protobuf/util/internal/field_mask_utility.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[76 / 400] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[81 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[93 / 400] Compiling src/google/protobuf/map_field.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[97 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[102 / 400] Compiling src/google/protobuf/descriptor_database.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[106 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[111 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[135 / 493] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[138 / 493] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[156 / 493] Compiling src/google/protobuf/compiler/command_line_interface.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[186 / 493] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
ru

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

[36 / 400] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[37 / 400] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[41 / 400] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[49 / 400] Compiling src/google/protobuf/type.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[52 / 400] Compiling src/google/protobuf/generated_message_table_driven_lite.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[53 / 400] Compiling src/google/protobuf/generated_message_table_driven_lite.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[59 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[62 / 400] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[65 / 400] Compiling src/google/protobuf/util/internal/utility.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[70 / 400] Compiling src/google/protobuf/util/internal/proto_writer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[73 / 400] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[76 / 400] Compiling src/google/protobuf/util/internal/datapiece.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[83 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[88 / 400] Compiling src/google/protobuf/text_format.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[94 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 0s processwrapper-sandbox ... (4 actions running)
[96 / 400] Compiling src/google/protobuf/generated_message_table_driven.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[99 / 400] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[103 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[108 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[110 / 400] Compiling src/google/protobuf/descriptor.pb.cc [for tool]; 4s processwrapper-sandbox ... (4 actions running)
[112 / 427] Compiling src/google/protobuf/descriptor.cc [for tool]; 5s processwrapper-sandbox ... (4 actions, 3 running)
[123 / 488] Compiling src/google/protobuf/descriptor.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[127 / 496] Compiling src/google/protobuf/descriptor.cc [for tool]; 8s processwrapper-sandbox ... (4 actions running)
[129 / 505] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 6s processwrapper-sandbox ... (4 actions, 3 running)
[129 / 505] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[130 / 505] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[137 / 627] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions running)
[138 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions, 3 running)
[149 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[154 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[164 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
[171 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 16s processwrapper-sandbox ... (4 actions, 3 running)
[172 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 18s processwrapper-sandbox ... (4 actions running)
[174 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 19s processwrapper-sandbox ... (4 actions running)
[177 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 20s processwrapper-sandbox ... (4 actions running)
[180 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 21s processwrapper-sandbox ... (4 actions, 3 running)
[185 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 23s processwrapper-sandbox ... (4 actions, 3 running)
[190 / 627] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 24s processwrapper-sandbox ... (4 actions, 3 running)
[196 / 627] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 22s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/cmd/protoc-gen-gogoroach/BUILD.bazel:16:10: GoLink pkg/cmd/protoc-gen-gogoroach/protoc-gen-gogoroach_/protoc-gen-gogoroach [for tool] failed: (Exit 1): builder failed: error executing command (from target //pkg/cmd/protoc-gen-gogoroach:protoc-gen-gogoroach) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -arc ... (remaining 65 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not define

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

stdout: 
, stderr: Loading: 
WARNING: Streamed test output requested. All tests will be run locally, without sharding, one at a time
Loading: 
Loading: 0 packages loaded
INFO: Build options --//build/toolchains:crdb_test_flag, --@io_bazel_rules_go//go/config:race, --define, and 2 more have changed, discarding analysis cache.
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (0 packages loaded, 0 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (157 packages loaded, 9611 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (331 packages loaded, 9889 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (416 packages loaded, 11848 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (544 packages loaded, 13130 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (624 packages loaded, 15406 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (644 packages loaded, 16122 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (685 packages loaded, 17138 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (747 packages loaded, 19904 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (762 packages loaded, 23768 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (925 packages loaded, 25374 targets configured)
Analyzing: target //pkg/workload/workloadsql:workloadsql_test (994 packages loaded, 26859 targets configured)
INFO: Analyzed target //pkg/workload/workloadsql:workloadsql_test (1047 packages loaded, 27654 targets configured).
 checking cached actions
INFO: Found 1 test target...
[0 / 11] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[11 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[13 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[14 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 3s processwrapper-sandbox ... (4 actions, 3 running)
[18 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 4s processwrapper-sandbox ... (4 actions, 3 running)
[20 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 6s processwrapper-sandbox ... (4 actions running)
[21 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 7s processwrapper-sandbox ... (4 actions running)
[22 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 8s processwrapper-sandbox ... (4 actions, 3 running)
[28 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[29 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[31 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 12s processwrapper-sandbox ... (4 actions running)
[34 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions running)
[37 / 267] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions running)
[48 / 267] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 0s processwrapper-sandbox ... (4 actions running)
[49 / 267] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 1s processwrapper-sandbox ... (4 actions running)
[52 / 267] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 2s processwrapper-sandbox ... (4 actions running)
[53 / 267] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 3s processwrapper-sandbox ... (4 actions running)
[54 / 267] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 4s processwrapper-sandbox ... (4 actions running)
[56 / 267] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 5s processwrapper-sandbox ... (4 actions running)
[57 / 267] GoStdlib external/io_bazel_rules_go/stdlib_/pkg; 12s processwrapper-sandbox ... (4 actions, 3 running)
[58 / 267] GoS

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

. failed with artifacts on release-23.1.10-rc @ 61c49dd4ad5a88742b377a5e4060af4d2c93aa7d:

[61 / 427] Compiling src/google/protobuf/util/internal/protostream_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[64 / 427] Compiling src/google/protobuf/wire_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[66 / 427] Compiling src/google/protobuf/util/message_differencer.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[70 / 427] Compiling src/google/protobuf/util/internal/proto_writer.cc [for tool]; 1s processwrapper-sandbox ... (4 actions running)
[75 / 427] Compiling src/google/protobuf/util/internal/default_value_objectwriter.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[80 / 427] Compiling src/google/protobuf/type.pb.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[84 / 427] Compiling src/google/protobuf/text_format.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[85 / 427] Compiling src/google/protobuf/text_format.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[92 / 427] Compiling src/google/protobuf/io/gzip_stream.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[96 / 427] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 1s processwrapper-sandbox ... (4 actions, 3 running)
[97 / 427] Compiling src/google/protobuf/generated_message_reflection.cc [for tool]; 3s processwrapper-sandbox ... (4 actions running)
[102 / 427] Compiling src/google/protobuf/compiler/parser.cc [for tool]; 2s processwrapper-sandbox ... (4 actions, 3 running)
[108 / 427] Compiling src/google/protobuf/compiler/plugin.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[129 / 553] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 0s processwrapper-sandbox ... (4 actions, 3 running)
[129 / 553] Compiling src/google/protobuf/compiler/js/js_generator.cc [for tool]; 2s processwrapper-sandbox ... (4 actions running)
[130 / 553] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 9s processwrapper-sandbox ... (4 actions, 3 running)
[140 / 664] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 10s processwrapper-sandbox ... (4 actions running)
[141 / 664] GoStdlib external/io_bazel_rules_go/stdlib_/pkg [for tool]; 11s processwrapper-sandbox ... (4 actions running)
[142 / 664] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 13s processwrapper-sandbox ... (4 actions, 3 running)
[157 / 664] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 14s processwrapper-sandbox ... (4 actions, 3 running)
[174 / 664] GoToolchainBinaryBuild external/go_sdk/builder [for tool]; 15s processwrapper-sandbox ... (4 actions, 3 running)
ERROR: /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/external/io_bazel_rules_go/go/tools/builders/BUILD.bazel:145:10: GoLink external/io_bazel_rules_go/go/tools/builders/go-protoc-bin_/go-protoc-bin [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external/go_sdk/builder_reset/builder link -sdk external/go_sdk -installsuffix linux_amd64 -tags bazel,gss,race,bazel,gss,race -package_list ... (remaining 15 arguments skipped)

Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
runtime.(*mspan).setUserArenaChunkToFault: relocation target __tsan_free not defined
runtime.mallocgc: relocation target __tsan_malloc not defined
runtime.runfinq: relocation target __tsan_finalizer_goroutine not defined
runtime.(*sweepLocked).sweep: relocation target __tsan_free not defined
runtime.goexit1: relocation target __tsan_go_end not defined
runtime.gfget: relocation target __tsan_malloc not defined
runtime.(*p).init: relocation target __tsan_proc_create not defined
runtime.(*p).destroy: relocation target __tsan_go_end not defined
runtime.(*p).destroy: relocation target __tsan_proc_destroy not defined
runtime.RaceDisable: relocation target __tsan_go_ignore_sync_begin not defined
runtime.RaceEnable: relocation target __tsan_go_ignore_sync_end not defined
runtime.raceinit: relocation target __tsan_init not defined
runtime.raceinit: relocation target __tsan_map_shadow not defined
runtime.racefini: relocation target __tsan_fini not defined
runtime.racemapshadow: relocation target __tsan_map_shadow not defined
runtime.racegostart: relocation target __tsan_go_start not defined
runtime.raceacquireg: relocation target __tsan_acquire not defined
runtime.raceacquirectx: relocation target __tsan_acquire not defined
runtime.racereleaseg: relocation target __tsan_release not defined
runtime.racereleaseacquireg: relocation target __tsan_release_acquire not defined
runtime.racereleasemergeg: relocation target __tsan_release_merge not defined
external/go_sdk/pkg/tool/linux_amd64/link: too many errors
link: error running subcommand external/go_sdk/pkg/tool/linux_amd64/link: exit status 2
Target //pkg/workload/ycsb:ycsb_test failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /go/src/github.com/cockroachdb/cockroach/pkg/util/log/logpb/BUILD.bazel:5:11 GoCompilePkg pkg/util/log/logpb/logpb.a [for tool] failed: (Exit 1): builder failed: error executing command (from target @io_bazel_rules_go//go/tools/builders:go-protoc-bin) bazel-out/k8-opt-exec-2B5CBBC6-ST-9e4de9a90ea1/bin/external

Parameters: TAGS=bazel,gss,race , stress=true

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@yuzefovich yuzefovich changed the title : failed *: a bunch of failures Sep 15, 2023
@rickystewart
Copy link
Collaborator

race issue from the Go 1.20 upgraded, @healthy-pod fixed in #110309.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-testeng TestEng Team
Projects
No open projects
Status: Done
Development

No branches or pull requests

2 participants