I found a solution to this problem, but it is not the desired way of working. It feels like font variables are not real variables at this moment.
You can use the command “Recompute text layout in selection” to update the text boxes. However, this requires manually running the command on every single page in your document after changing the font family variable.
For more details, refer to the discussion here: Update all text boxes with new version of font.