An off-grid LLM platform deployed and accessible through 868Mhz LoRa mesh network. Requires no internet or whatever. Super long range. Useful in disaster/emergency situations. Supports user sessions, chat contextand even tools i.e calling emergency service.
I deployed a local LLM platform on Meshtastic. It is completely offline, requires no-internet, on both client and server side. So essentially disaster-proof apocalypse-grade ChatGPT.
Users can connect to it with a LoRa module from 1km away (tested in Budapest suburban area) or 8-15km with line of sight. Theoretically, this can reach even more than 1000km, the record is 1336km on LoRa Wan.
It can prove useful in disaster area, where mobile network and internet is not available. In addition to being a robust comm network, government can utilize the radio mesh to distribute helpful AI agents to people in need, get them updated on key info and survival guide.
Github: https://github.com/pham-tuan-bin...
Distance Testing Demo: https://youtu.be/Snfn_bGH_KE?si=...
Emergency Service Demo: https://youtu.be/KbpxYTYvm5o?si=...
would be nice to have it available in Turkey, where is prone to natural disasters.
Sorry to tell you, but the problem is not the distance, not the 200 symbols per message, not even Meshtastic. The problem is LoRa routing architecture. You simply can't guarantee the recipient will get the answer from your laptop, not saying make a significant throughput via LoRa. Many users or messages will lay the network down, causing a DoS attack.
This is such a cool and useful product. Great work—wishing you all the best with the launch.
Pham Binh