If you want the overrides to be preserved, you need to add an extra layer to each component variant where Figma can write the override data. Please take a look at the answers in this thread: Color override goes crazy when I place my graphic element in a component.