I saw several sugegstions about deleting and moving the assignments.
I think the main problem is that that widget doesn't have a top level handle.
I suggest to change the widget slightly as shown in the image to add that top level control.
Now the (=)
icon has a top level handle to assign widget. Hence tiy can build controls on the icon to move it another assignment, change order and delete..
What do you think?