I'll take a stab at this.
I just played around with my wardrobe a bit since I didn't know that "feature" existed.
I assume by "get rid of" you mean get out of your My Collection and into another category.
Looks like the wardrobe will allow you to designate the frags in your My Collection as also swapable (Swap List). This would stand to reason since in order for it to be swapable, you must own it.
I remember seeing a complaint at one point that a member wanted to be able to show her frags under the My Collection category but also show them under her Swap List and/or as Decantable. It doesn't look like you can put it into the Swap List without it also showing under My Collection. Makes sense to me.