Nathan and I went to a wedding in Port Fairy a few weeks ago.
Port Fairy is a nice town but their tap water tastes strange.
I did some research when I got back. Apparently the quality of the drinking water there is a long standing issue. The bad taste and funny smell is because it is bore water.
I've had bore water elsewhere (e.g. in Central Australia) but I don't recall the weird smell and taste.