Fix traversal of dirs containing troublesome softlinks #1561

Job	Run time
CI on centos-stream-fsf-latest	9m 19s
CI on debian-stable	5m 37s
CI on fedora-latest	5m 49s
CI on ubuntu-lts	6m 21s
CI on arch-rolling	5m 31s
	32m 37s

Provide feedback