Thumbnails will not be updated (or not predictably anyway) in the project gallery unless you perform Restore default thumbnail + Set as thumbnail sequence on the wanted frame. This problem has been around forever, would be great to finally fix it as it is pretty annoying.
Found this ticket describing it, which was closed sadly: My new thumbnail didn't refresh even after waiting 8h how to force refresh?