Avoid grabbing comments by mistake while panning

every time I zoom out and pan I grab a comment moving it from its original position. It would be nice to add CTRL+Z when you move a comment. or maybe delay the opening animation to make it harder to grab them.