While holding left mouse to move, mousing over any NPC, waypoint, zone exit, etc will auto interact with it even if you did not mean to click on these elements. The distance you interact with them is also quite far, causing you to talk or change areas when not meaning to.
You should have to initiate the “mouse down” action ON the object you want to interact with so that simply having the mouse button already held wont do this.