Unfortunately, it is not possible to update multiple widgets at once. As you described, you need to select each widget and update manually via the context menu.
You can change the topic category from “Questions” to “Feedback” so that the Figma team will consider this as a feature request.