Ah I just found a thread about this “problem” from before and it seems intended.
Channeling flurry also gives Perfection stacks with every tap (every use of the skill)
I hope there will be a (greatly reduced) way of gaining multiple stacks of things with one long channel.