Thank you, J.
Deleting this, because it turns out that you can actually do this.
As long as you're not editing the comment, you can hover over the edges of a comment and drag a line out to any element. If the element gets bumped by insertion of another element, the comment does indeed come along for the ride.
Wish I had known this a long time ago :)