True Caller — they are showing my name to other unknown people, when they receive my phone.

Well i never used or downloaded truecaller, but today when i called a milkman who had true caller on his phone, he could tell me what my name was. I think it is an intrusion to my personal info.
Who gave them the permission to display my name on other's phone.
Truecaller is a fraudulent company, we all know that, a type of solution for me would be to block truecaller for accessing my info, and them to delete all my information they have of mine.