Folks, I'm the head of product at ThirdAI and we are excited to get this PocketLLM tool out here for you all to try. The main aim is to showcase that we can build LLMs on laptops or any commodity CPUs.
With the exponential growth of digital documents in recent years, finding the right document has become a hassle for many of us. Existing document search solutions rely heavily on server-side processing, raising concerns about data privacy and security.
Enter ThirdAI PocketLLM, a new application from ThirdAI that allows you to train a neural network model locally on your laptop or air-gapped device to memorize an entire PDF or a folder full of PDFs, offering personalized and secure neural search.
ThirdAI PocketLLM's innovative technology allows you to bypass the cloud and ensure your sensitive information stays private. Our model is trained on CPUs, making it affordable and accessible to everyone. You can train a 50M to 1B parameter model in minutes, without any specialized hardware.
We understand the importance of privacy, which is why the entire ThirdAI PocketLLM can be trained locally. Your data is kept on your device, and no one, not even ThirdAI, can access it. Our solution is designed to offer personalized search that is specific to your needs, without ever compromising your privacy.
ThirdAI PocketLLM's search is incredibly fast, thanks to the power of neural networks. Our solution uses embeddings, allowing for similarity search and natural language queries.
We can't wait for you to try out ThirdAI PocketLLM!
Vinod Iyengar