The metal pipe is bolted to the back of the engine, if you can get the bolt near the thermostat out you should be able to do it without removing the thermostat.
I find removing the pump/thermostat assembly together easier than just the thermostat. It's not a hard job to do, just takes a bit of...