This is due to the application already being open but not visible.
1. Open task manager (Right click task bar > Task Manager)
2. Go to the Detail Tab
3. Find offending application in list (i.e. Outlook.exe or Excel.exe)
4. Right click offending application and End task
1. Reboot PC / Workstation
1. Sign out of VDI and back in