Swipe-Left is not consistent on iPhone

How can we make Swipe-Left of a card in Figma prototype work consistently on iPhone?

The first in five cards swipes left properly. But trying to swipe-left the second card onward does not.

Most of the time, the swipe left causes the content below the card to jump a few pixels upwards. Then, sometimes, the card would swipe. Random.

Did anyone run into this problem?