Possession character unblocked - where does it go?

If a Possession character is not blocked where does the die go? Normally unblocked characters go to the used pile. Would this mean the possessed character die would return to my opponent's used pile at the end of my turn?