Thinking it back, I am sure it is a scam.
I did not give any details over the phone. I am sure of that. No date of birth, address, password, secure information. I also don't think he knew my name, although I answer my phone with my name anyway so that means nothing.
But I did ask "How did you...