Who's responsible for the lagging?

It depends, If you are already getting a pretty good FPS at high/ultra settings then it is your GPU, if you have a good GPU and you are still getting low FPS then it is your CPU.