Layla

Private AI that runs completely offline on your device

Android

Artificial Intelligence

Virtual Assistants

Bots

I’m an independent developer who’s used to work in server-side/backend stuff. I love AI and am very passionate about the new innovations and technologies that are popping up every day. Recently, I’ve decided to go my own and dive head-first into this field! With the recent advances in both algorithms and hardware, I see potential for a truly democratised AI landscape, where everyone holds a personal AI assistant/friend in their hands. I’ve created “Layla”, a personal assistant that runs completely offline in your phone. Because it doesn’t send your data or conversation anywhere, feel free to chat with it about intimate topics, making it truly personal! Layla is also able to mimic a variety of different personalities, and you can create ones for her on the fly! My vision is everyone should have their pocket AI in the future, just like their smartphone today, and it will evolve and learn with you, becoming a true companion. One that can’t be taken away from you. A bit about the technologies used for those interested. The app downloads a 2-4GB model when the first time it starts. This is the only time it requires internet, once the model is downloaded, it runs completely locally in your phone. There are two versions of Layla, "full" and "lite": Full version uses the Llama2 7B model and is available for anyone who have phones with more than 8GB of RAM. Lite version uses the Open Llama 3B model, for older devices. I finetuned the model on conversational datasets I gathered from many sources; I finetuned them myself using 8xA100 GPUs for over a week. The Layla Full version (7B model) performs exceedingly well for my tests; Layla Lite unfortunately does trail a bit behind in terms of intelligence due to the small number of parameters. All the calculations are done completely on your phone CPU. Due to this, it's best not to compare it's reasoning capabilities with ChatGPT 😅. Layla is more your everyday friend rather than a super AI trying to take over the world. Roadmap The app is still under heavy development. I plan to release updates every 1-2 weeks with a lot more features. Additionally, I am looking at prioritising doing another round of training on the Lite version to improve its overall capabilities. Some things I have planned for in the next few weeks/months: Integrate it with your phone features, such as adding alarms, reminders, calendar events. Adding more “assistant” features Adding more characters and personalities. All characters have their own finetune for their personality. Augment Layla’s capabilities with server-side AI. Privacy is always going to be my focus. However, server-side AI can help your local Layla for things like summarising already publicly available content such as news and giving that information to your local AI. It doesn’t mean your local AI will give up any information up to the server. The app is a one-time payment for download at $14.99 USD. Future local features added of course are included as free updates! I’m really excited to share this project with you guys! Feel free to ask me anything in the comments!