This is probably a design problem.
I found a few related topics that you can vote on for the Figma team to take notice: