It’s currently only possible to use HEX value colours in the Overlay background dialog (open overlay).

It would be easier to have a theme named colour instead, then you can change the named colour and all the overlay background colours would also change. Now it’s a tedious process to change them manually and there is no easy way to locate them all.