If you think that anything not denied is automatically the truth, the libel and slander laws need a serious rewrite.
Anyways, if they spent all their time having to confirm or deny every little thing said about them, they wouldn't have the time to spend maintaining their secret mountain lair...