After the most recent Figma update, it seems that pinch to zoom is inconsistent or rather, almost never works on the first attempt but then works on the second attempt. This is true if the window is focused or in the background.
Have an M1 mac if that helps
Any support from the community or from Figma to fix this would be much appreciated!