No it's not a fair point at all! People residing in Australia are required to prove that they can communicate at a certain level in English. All people applying for visas whose first language is not English, must prove that they are proficient in the language.
Your comment is irrelevent, as we are not talking about me, or my arabic skills, as living and working in the UAE people are not required to speak Arabic or prove that they can speak Arabic. But in Australia you 'must' be able to speak and write English to Governmentally accepted level and prove it.
Plus reading the comments he was quoted as saying, his English appears to be very good, which makes what he said even worse, as he knew exactly what he was saying and the meaning of it. Also who's to say that he didn't give the surmon in Arabic and what he said has been translated into English?
I'm appalled that you would try and defend someone who would see women abused and them blame the women for the actions of men, because of the way they're dressed. And I'm especially appalled seeing as you are a woman yourself!