This is an XFCE thing.
- Open the XFCE Settings App and choose “Session and Startup”
- Under “General” make sure “Automatically save session on logout” is unchecked
- Under “Saved Sessions” push the “Clear saved sessions” button
- Shutdown and reboot your computer. You should no longer see what you have reported.