I was listening to a talk by the British Historian David Starkey, who actually scoffed at the idea of "rights" at all. It gave me quite a jolt, actually, and I've been thinking about it for a few days now.
It seems to me that whatever "rights" we might have are those that we collectively grant to ourselves, through things like Charters of Rights by governments and other such bodies. And I think we tend to do that (when we have sufficient freedom to choose and control) when we decide what rights we would like for ourselves, and would grant to everyone else at the same time.
But if that is the case, these will change as our societies change. Things that we push under the table will not be on our "Charter of Rights," so of course, matters of non-heterosexual, non-one-man-one-woman, unmarried couldn't make the list in the 18th century, but in light of new knowledge of human nature, can eventually make the grade, as it were.
In fact, Human Rights have really only been "a thing" for about 200 years. The very idea that every human being should have equal legal protection of their basic needs is built on humanist ideas from 18th-century Europe.
But in the end, as I said, our rights are those that we collectively give to ourselves.