I have a close affinity with the Speedway team and over the decades have not ever thought of them as being other than a 'Coventry' based team.
If a new stadium was built on the edge of Coventry, Ryton, Brandon, Exhall and the like then that to me is good enough. Heck some folks come a long way...