I just don't answer anything if its not a number I know.
I ended up closing my Lloyds account as everytime they phoned up, usually to try and sell me something, they would insist on me giving them security information. They couldn't grasp that I wasn't going to give security information to...