gh-141510: Update specializer to support frozendict #2235

Job	Run time
aarch64-unknown-linux-gnu/gcc	7m 15s
x86_64-apple-darwin/clang	23m 53s
x86_64-unknown-linux-gnu/gcc-free-threading	8m 55s
aarch64-apple-darwin/clang	9m 50s
x86_64-pc-windows-msvc/msvc	10m 0s
x86_64-pc-windows-msvc/msvc-free-threading	5m 15s
x86_64-unknown-linux-gnu/gcc	10m 1s
	1h 15m 9s

Provide feedback