Pinch-to-zoom unreliable

Both my work and personal MacBook (intel, Monterrey and Ventura) experience this problem for months now.

It happens multiple times a day. Starts and resolves itself randomly.
Disrupts the flow and is very frustrating.

I’m using macOS Accessibility screen zoom feature (Control key + swipe up/down). Few attempts with this gesture unblocks Figma’s pinch-to-zoom. Usually.