Can someone acces your bank account through your phone number?

I don't think so. Not with my internet banking for sure. I think someone is giving you a bunch of crap.