How to clear rdp connection history?

You could set up the Workstation to your liking (install rdp-client and any other tools you need) which you will use as a template, and just copy it for temporary use.