Why my app has access to location permission.?

Will google remove my app because of no asking for this permission from users.

no it does not

If you are using amazon ad, this problem is quite common

Or sometime web component too ask for location