Problem solved. The new installation needed another component to be installed using the command line.
C:\Users\rimme\AppData\Local\Programs\Python\Python314\python.exe -m pip install pyzmq
After that RegisterExternalEvaluator[] worked.
