On further investigation, it seems that this problem occurs only if there are multiple versions of the same product installed. If there is only 1 version of the product installed, the shortcut gets deleted no problem. Here is the scenario:
1) I install MyProduct v15, with shortcut labeled ...
FOLLOW US
Get the latest news in Application Packaging