I just got a Llama 2 70B LLM (offline chat AI) working on my laptop. That is a much larger (smarter) system than I thought was possible on a laptop. It takes every bit of 64GB of RAM, and it is about as fast as AOL instant messanger on bad 56k dialup, but it works.
I think I also fixed my problem that stopped me from using text to speech AI. Now I just need to figure out speech to text, get a few billion dollars, and make an iron man suit.
I just got a Llama 2 70B LLM (offline chat AI) working on my laptop. That is a much larger (smarter) system than I thought was possible on a laptop. It takes every bit of 64GB of RAM, and it is about as fast as AOL instant messanger on bad 56k dialup, but it works.
I think I also fixed my problem that stopped me from using text to speech AI. Now I just need to figure out speech to text, get a few billion dollars, and make an iron man suit.
Is that for training the LLM or just simply running it?
Just running