Friday, September 22, 2017

Postal vote

Nathan and I both filled out our same-sex marriage surveys and have posted them back to the Australian Bureau of Statistics (ABS).

As a scientist, I see so many design flaws with the process that, whichever way the decision goes, it's legitimacy is vulnerable to being questioned.

We all know that the compulsory plebiscite was blocked by the Senate and the Government has decided to go for a non compulsory postal survey instead.

Naturally, this means that only the views of a portion of the population will be sampled because not everyone is going to return their postal survey. Gathering data on only a 'subsample' of the population is widely and legitimately used in science – provided that the design of the subsampling is scientifically sound. Herein lies my biggest issue. Those who choose to participate and return their surveys will not necessarily be representative of the population as a whole because they will be a self-selecting bunch of individuals, i.e., those who feel strongly enough about the issue to vote. If one is going to subsample a population, then one needs to randomise the sampling process. The ABS should know this. It's one of the basics of good scientific design.

The question being asked is also being confused. The 'no' campaign has been raising a bunch of questions that have very little to do with the specific question at hand, which is about whether the law should be changed to allow same sex couples to marry. Thus, if some people are answering 'no' because they don't agree with some of the other issues being raised (boys wearing dresses; safe schools program), then this potentially also calls into question the validity of some of the returned surveys.

I've only raised some of the scientific issues. There are, in fact, many problems that could affect the credibility of the postal survey, from undelivered survey forms to people filling out multiple surveys.

And that's the worry!


3 comments:

Anonymous said...

Any sort of scientific or medical trial based on anything like this survey would laughed at. Opinion polls mostly get it vaguely right, but this is a far less reliable survey. Just curious, if positive equality of marriage laws were passed, would you walk down the metaphorical aisle with N? We might have to velcro your bridal veil to your head.

Victor said...

I haven't attended a wedding in years. I'm not sure whether I can manage a deluge of wedding invitations. And then there is the question of what gifts to give. I went through a long stage of giving the same wedding present to all my straight friends; a set of Splaydes. It was my signature gift, so to speak. I'm not sure this gift will do in the gay universe.

Adaptive Radiation said...

Andrew: To be honest, I haven't allowed myself to consider the possibility of marriage and we have not had a serious discussion about it. It's difficult to do so when it's not currently a reality.
Victor: I'm sure the gifts at a gay wedding will be fabulous.