Party members lag out during dungeons

Looking for some ideas. when a friend and I have a party one of us always lags out during dungeons. Lightless arbor , those kinda of dungeons . We both have around 47 ms playing. Is anyone else having this problem ? Or is there a solution , I am not aware of. Thank you in advance.