Remove some `as` casts #2174

Job	Run time
Build and Test (ubuntu-latest, 1.70)	2m 19s
Rustfmt (stable)	10s
Build and Test (ubuntu-latest, 1.75)	2m 5s
clippy_check (ubuntu-latest, stable)	44s
clippy_check (ubuntu-latest, nightly)	38s
Build and Test (ubuntu-latest, 1.80)	1m 58s
clippy_check (windows-latest, stable)	2m 9s
Build and Test (ubuntu-latest, stable)	4m 26s
clippy_check (windows-latest, nightly)	1m 5s
Build and Test (ubuntu-latest, beta)	1m 50s
Build and Test (ubuntu-latest, nightly)	53s
Build and Test (windows-latest, 1.70)	3m 9s
Build and Test (windows-latest, 1.75)	3m 10s
Build and Test (windows-latest, 1.80)	3m 6s
Build and Test (windows-latest, stable)	3m 27s
Build and Test (windows-latest, beta)	2m 58s
Build and Test (windows-latest, nightly)	1m 43s
Tests result	1s
	35m 51s

Provide feedback