I think it's just a matter of perception.
When the football side is doing well, fans are happy and optimistic, so the SISU issues fade into the background a little..
When the football side is not doing well, fans are not happy and SISU is the easiest target.