Delete variable color: I deleted them but it still appears in the color list

After I updated Figma, it was really hard to use. I deleted all variants but when I select an object and change color, it shows all the variants I deleted even though I filtered by local variant. Would love for Figma to improve the ux better. Terrible experience