Rune of Removal & Rune of Shattering - My friend is using my runes

Whenever I’m in a party with my friend and I have any amount of rune of removal or rune of shattering and he uses his runes, he will instead use the ones i have, leaving me with 0 of both of them while he still has 60+. We tried swapping party leader as well but nothing changed.

Example: I have 5 rune of removal, he uses 3 rune of removal, I can then still see that I have 5 rune of removal but when i go and use them, the first 3 will just disappear without removing anything and then the last 2 works fine.