Show overlay once with conditional logic

I have an overlay that is manually positioned inside a frame and opens with a delay.

I’m curious if there’s a way to prevent the overlay from reappearing once I’ve closed it. Maybe with using conditional logic?

I tried to do a similar thing a while ago, but there is some sort of bug which disallows using “Change to” component functionality with conditional logic. To the best of my knowledge, this bug has not been fixed yet.