Obviously, the fact that Muslims really do have this belief does not bode well for those who wish to have us believe that Robert Spencer is factually incorrect in the other thread.
So, I googled 'non-Muslims are guilty' into google and it turns out that more prominent Muslims besides Choudary hold this particular belief:
A report posted on Islam Watch, a site run by Muslims who oppose intolerant teachings and hatred for unbelievers, exposes a prominent Islamic cleric and lawyer who support extreme punishment for non-Muslims — including killing and rape.
A question-and-answer session with Imam Abdul Makin in an East London mosque asks why Allah would tell Muslims to kill and rape innocent non-Muslims, including their wives and daughters, according to Islam Watch.
"Because non-Muslims are never innocent, they are guilty of denying Allah and his prophet," the Imam says, according to the report. "If you don't believe me, here is the legal authority, the top Muslim lawyer of Britain."
http://www.foxnews.com/story/0,2933,344409,00.html
And for the video from Anjem Choudary, watch around the 30 second mark where he says that non-Muslims are guilty for not believing in Allah.