Please delete the post, I fixed it on my own.
Im having the same problem, how did you fix it?
Mind sharing how you fixed it? 
Big performance issues after about 70 minutes in game - Technical Support - Last Epoch Forums
In this post we talk but with the game stuttering, i think i find a solution, with the shader cache size.