Want to control your right to marry who you want
This is like saying that abolitionists "wanted to control your right to hold slaves" by abolishing slavery. And yes, this was actually an argument used by democrat opponents of abolition.
US law is rife not only with examples of things you have the right to do, but also moral evils you have the right to be free from ever having to experience. Viewing "Freedom" as only applying to the former is narrow-minded, and frankly doesn't make much sense.
Edited 2/11/2016 14:00:02