If you ask me a question and follow it with "if you don't mind me asking" then,
1. More than likely, I do mind you asking.
2. It's none of your business.
3. We aren't that close.
So don't ask or,
1. Don't get offended when you get ignored.
Thanks. Have a nice day.