Using items like Thorn Slinger (+1 to physical skills) correctly adds additional points to spend of skills but the displayed level stays at 20 and when going into the skill tree it says “0 unspent points”, even though there is a point available.
Edit: unequipping the item doesn’t remove the latest point spent but a different one. For Shurikens it removes one point from Ethereal Blades.