Removing interactions issue

Sometimes I select the whole frame to remove interactions and start from a blank experience but even hovering interactions are lost and that’s quite frustrating. Imagine we can remove interactions per type… say “Remove all click interactions”.