Rust optimizer improvements #4285

Job	Run time
Check for upstream trigger phrase	4s
Test importing with bare requirements	12m 20s
Build & Test (ubuntu-latest, python: 3.9, distributed: false)	8m 25s
Build & Test (ubuntu-latest, python: 3.10, distributed: false)	8m 54s
Build & Test (ubuntu-latest, python: 3.11, distributed: false)	8m 52s
Build & Test (ubuntu-latest, python: 3.12, distributed: false)	9m 9s
Build & Test (windows-latest, python: 3.9, distributed: false)	18m 25s
Build & Test (windows-latest, python: 3.10, distributed: false)	19m 58s
Build & Test (windows-latest, python: 3.11, distributed: false)	25m 18s
Build & Test (windows-latest, python: 3.12, distributed: false)	15m 35s
Build & Test (macos-latest, python: 3.9, distributed: false)	24m 33s
Build & Test (macos-latest, python: 3.10, distributed: false)	16m 26s
Build & Test (macos-latest, python: 3.11, distributed: false)	13m 0s
Build & Test (macos-latest, python: 3.12, distributed: false)	19m 8s
Build & Test (ubuntu-latest, python: 3.9, distributed: true)	8m 32s
Build & Test (ubuntu-latest, python: 3.11, distributed: true)	9m 32s
	3h 38m 11s

Provide feedback