The case could happen where, because of CSS styles, two widgets (e.g. a text widget) are exactly overlayed in the visual editor. Since the only way to select a text widget is through the visual editor, the bottom widget is unreachable.
If the user could right click or double click on the bottom widget in the widget tree to put cursor focus on it in the visual editor, then it would be accessible.