The idols do seem to give you increased poison damage. Easy way to test it is by opening your character stats to see your increased poison damage go up by xx%
You are right it does increased damage even if converted.
I was wronged by the fact that the damage doesnt change if you swap your idol during the activation of the aura of decay.
You have to first equip your idols, and then activate the aura.