Bound LMB to skill. It casts every time I advance dialogue. Workaround?

Hello,

I am new to the game, but I ran into a rather inconvenient quirk of the keybindings that I find very frustrating. Please let me know if there is a workaround for this.

The situation:
I prefer to have “move” bound to the right mouse button, so I did just that in the keybindings. Additionally, I bound a skill to the left mouse button. My problem now, however, is that it seems like the only way to advance dialogue is to press LMB, which also casts the bound skill each time. I do not want to cast a skill every time I want to advance dialogue. Is there a fix or workaround for this I do not know about?