Reproduced and fixed. Your own, your pet's and other players' balloons were already cleared on a map change; the one that followed you was a townsperson's idle line. It now goes when you leave the map. To re-test: stand beside a chatty NPC, wait for a line to pop up, and step through a portal while it is showing.