I don’t know exactly how it happened, but I leveled Swaddling of the Erased (Gloves) and they gave me attunement.
When the item was finished I unequipped them and put them into my inventory.
At first I didn’t notice anything but later when I opened my stat sheet I saw I had negative 14 attunement (exactly how much those Gloves were giving me before)
When relogging the stat return to normal.