You can’t prove that material existence exists, but you experience your thoughts, so I think “I think” here more refers to experience/qualia/consciousness more so than anything else. You can’t really prove that anything at all exists, but you do experience something, so you know at the very least that your experience exists.