I had exactly the same issue, but started taking my gym stuff to work with me, so I go directly from work and I found that easier. Last couple of weeks, I've done some mornings before work, which I prefer to be honest, it's just getting up that's the issue!
It was frustrating though at times...