– To disturb the peace of mind of (someone) especially by repeated disagreeable acts.
Usage example: continuously clearing your throat like that is starting to get to me
are semantically related in feelings
topic. Sometimes you can use "Chafe" instead a verb
Nearby Word: getting