Yes, it is possible. Indeed there has to be something very unusual about what I am doing.
The only software I can think of common to all 4 PCs were MS Office, Visual Studio and Eclipse, Chrome and Acrobat Reader all of which I would expect many Mathematica users to also use. Also Norton Internet Security would be on all of them.
One of the 4 PCs is only accessible through a remote desktop and has no graphics card, so I can cross off a wide range of video and graphics-intensive programmes or games that would never have been installed there.
In the past, I thought it could be a MariaDB JDBC driver as the vast majority of my notebooks read from a centralised database and this driver would be on all PCs, but later I have had examples fail that didn't use the database at all and the failures were certainly not commonly happening during database functions or commands in Mathematica.
I also wondered about network devices, especially printers and have tried removing these from the PC I am currently using, but haven't found a culprit yet.
However, I think your direction is a good one to reflect on.