Is it possible to ignore messages and forward them to Figma?

I would like to cooperate with Figma in the following situation:


So, basically, if the pointer comes in dragging, ignore it and keep Figma doing its thing, in this case panning the canvas.

I’m getting a dragging state by checking event.buttons in pointerenter, but then nothing that I do in pointermove will prevent my plugin from reacting to the pointer.

Is this even possible? It’s a real issue for this plugin as it turns out, as it’s resizable, tends to take up lots of room, and users need to be able to pan their page content around, which is hard currently if the plugin iframe take up lots of space, then panning has to be done in small steps and it’s annoying.