Solved
Collapsing all layers makes the file really slow
While working on a file, when I collapse all layers (OPT+L), it seems like Figma starts syncing the file, which makes it extremely slow for a few moments. I didn’t have this problem in the past.
