Unfortunately, you would lose that argument. The controller of the trigger is the controller of the permanent right before it died. Since they controlled it, they also control the trigger. It doesn't matter that you own it, or that it goes to your yard. What matters is who controlled it at the moment it died and that was them.
Please help:
In a situation where an opponent takes control of my modular creature, and sacrifices it. Would he get the +1/+1 counters on it?
I am arguing no.