Unfortunately I think cdpr has a history of poor optimization. I remember having witcher 3 with graphics patches and maxed out and it ran like no problem. This was with mods. Then they released the next gen update, which imo looked about the exact same compared to my modded version, and it ran at 1/8th the FPS. Shortly thereafter they released a performance patch and it was better but still never the same.