As Administrator, find the shortcut the installer created in "C:\Users\Public\Public Desktop", right-click and select Properties, Security, Interactive -- check any unchecked boxes, Apply. You should now be able to delete the shortcut from "C:\Users\Public\Public Desktop" and make it disappear from your desktop.
