Provide an error message if LD_PRELOAD is set during a Julia build or startup

[wsmoses]

This was a build of release-1.10.

[119298] signal (6.-6): Aborted
in expression starting at /home/wmoses/julia/usr/share/julia/stdlib/v1.10/Downloads/src/Downloads.jl:469
gsignal at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
abort at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
unknown function (ip: 0x7fed8bd1b26d)
unknown function (ip: 0x7fed8bd232fb)
unknown function (ip: 0x7fed8bd24f9f)
Curl_parsenetrc at /home/wmoses/julia/usr/bin/../lib/libcurl.so.4 (unknown line)
Curl_connect at /home/wmoses/julia/usr/bin/../lib/libcurl.so.4 (unknown line)
multi_runsingle at /home/wmoses/julia/usr/bin/../lib/libcurl.so.4 (unknown line)
multi_socket at /home/wmoses/julia/usr/bin/../lib/libcurl.so.4 (unknown line)
curl_multi_socket_action at /home/wmoses/julia/usr/bin/../lib/libcurl.so.4 (unknown line)
curl_multi_socket_action at /home/wmoses/julia/usr/share/julia/stdlib/v1.10/Downloads/src/Curl/Curl.jl:51 [inlined]
curl_multi_socket_action at /home/wmoses/julia/usr/share/julia/stdlib/v1.10/Downloads/src/Curl/Curl.jl:59 [inlined]
macro expansion at /home/wmoses/julia/usr/share/julia/stdlib/v1.10/Downloads/src/Curl/utils.jl:56 [inlined]
do_multi at /home/wmoses/julia/usr/share/julia/stdlib/v1.10/Downloads/src/Curl/Multi.jl:129
#48 at /home/wmoses/julia/usr/share/julia/stdlib/v1.10/Downloads/src/Curl/Multi.jl:147 [inlined]
lock at ./lock.jl:229
#47 at /home/wmoses/julia/usr/share/julia/stdlib/v1.10/Downloads/src/Curl/Multi.jl:144 [inlined]
#726 at ./asyncevent.jl:306
unknown function (ip: 0x7fed7181c392)
_jl_invoke at /home/wmoses/julia/src/gf.c:2895 [inlined]
ijl_apply_generic at /home/wmoses/julia/src/gf.c:3077
jl_apply at /home/wmoses/julia/src/julia.h:1982 [inlined]
start_task at /home/wmoses/julia/src/task.c:1238
Allocations: 77961049 (Pool: 77879838; Big: 81211); GC: 96
Aborted (core dumped)
*** This error might be fixed by running `make clean`. If the error persists, try `make cleanall`. ***
make[1]: *** [sysimage.mk:67: /home/wmoses/julia/usr/lib/julia/sys.ji] Error 1
make: *** [Makefile:101: julia-sysimg-ji] Error 2

The same error occurs on my system using juliaup binaries for 1.10, 1.9, and 1.11-rc2

[giordano]

Can you please provide more information about the system? CPU, operating system, etc... What are make options? Just default configuration?

The same error occurs on my system using juliaup binaries for 1.10, 1.9, and 1.11-rc2

Just to understand, how do you reproduce the same error when you're using prebuilt binaries?

[ViralBShah]

Is there an LD_LIBRARY_PATH or LD_PRELOAD by any chance that is loading something else?

[wsmoses]

yeah I think its an ld_preload setting the allocator to libtcmalloc

[giordano]

For future reference, this is probably related to #44242 and #48461 (which was also worked around by unsetting LD_PRELOAD)

[ViralBShah]

Please reopen if still an issue. We may want to check the existence of LD_PRELOAD and LD_LIBRARY_PATH in our build to warn users.

[moble]

@ViralBShah I think this is very much still an issue. One of my users ran into this problem (with jemalloc, on a cluster I couldn't access), and it took us forever to diagnose. Some sort of warning would have saved us a lot of time.

Unfortunately for this user, just unsetting LD_PRELOAD isn't an option, because he needs to call Julia from another program that does actually need jemalloc. But knowing that earlier would have been very helpful. I'm hoping that building Julia from scratch lets him avoid the problem. 🤞

[ViralBShah]

I am not sure how far you'll get with jemalloc even with a source build: #46298

But reopening this issue to have a warning if LD_PRELOAD is set at build or run time.

[giordano]

Note that LD_PRELOAD can also be used "safely", for example for profiling, and MPI.jl explicitly supports that: JuliaParallel/MPI.jl#451. So I'm a bit wary of adding a warning.

[ViralBShah]

I was thinking that the message would say something along the lines of: "LD_PRELOAD has been set to $val. If you experience problems with your build or at runtime, please review".

[maleadt]

Also note that LD_PRELOAD is already shown by the Environment: section in versioninfo(), so there's some visibility already:

julia/stdlib/InteractiveUtils/src/InteractiveUtils.jl

Lines 171 to 173 in c6c449c

	function is_nonverbose_env(k::String)
	return occursin(r"^JULIA_|^DYLD_|^LD_", k)
	end

[ufechner7]

But that does not help if Julia doesn't start at all.

[giordano]

If Julia doesn't start at all it probably doesn't have any chance to print anything because it dies too early.

[oscardssmith]

Can we not intercept the signal handler to print a brief something on the C level?

[IanButterworth]

If there isn't a good option in julia perhaps juliaup could warn?

[moble]

But that does not help if Julia doesn't start at all.

Fair enough, but evidently for several cases, Julia does start just fine. In the example I ran into, the error only occurred after Pkg had been loaded and started trying to curl something.