Product Thumbnail

NotHotDog (Alpha)

Test your LLM powered APIs & AI agents

API
Developer Tools
Artificial Intelligence
GitHub

NotHotDog is a testing tool for LLM Powered APIs - suitable both for voice and text apis.Test latency, record, store voice/string test cases and simplify API testing with NotHotDog - the Postman for LLM powered APIs.

Top comment

NotHotDog: Supercharge Your AI Agent Testing 🚀 What is NotHotDog? NotHotDog is a powerful, user-friendly platform designed to revolutionize how developers and QA teams test AI agents and chatbots. Whether you're working with voice or text-based interactions, NotHotDog provides a comprehensive suite of tools to create, manage, and analyze your tests with ease. Key Features: 🎙️ Voice & Text Testing Test both voice and text interactions in one place. Record audio, upload files, or type out your test cases. 🧠 Smart Evaluation Leverage AI-powered context matching and customizable evaluation criteria to ensure your agents are performing as expected. 📊 Real-time Analytics Get instant pass/fail results and latency measurements to optimize your AI's performance. 👥 Team Collaboration Organize tests into projects and groups, perfect for team collaboration and large-scale testing efforts. 🔗 API Flexibility Easily connect to your own endpoints or third-party APIs for comprehensive integration testing. 🔒 Secure & User-friendly Google Sign-In integration and an intuitive UI make it easy to get started and keep your tests secure. Why NotHotDog? Save Time: Automate your testing process and run multiple tests with a single click. Improve Quality: Catch issues early with detailed analytics and customizable test criteria. Scale Easily: From individual developers to large QA teams, NotHotDog grows with your needs. Stay Flexible: Support for both voice and text means you can test any type of AI agent or chatbot. How It Works: Sign in and create a project Add test cases (voice recordings, text inputs, or API calls) Set your evaluation criteria Run tests individually or in groups Analyze results and optimize your AI Who Is It For? AI Developers QA Teams Chatbot Creators Voice Assistant Developers Product Managers overseeing AI projects Get Started: Visit NotHotDog.com to sign up for beta launch or Send an email to [email protected] for alpha access

Comment highlights

LLMs require significant testing for reliability and guardrails due to their unpredictable nature; as engineers and product folks, we have had to do multiple iterations of testing and engineering to ensure the system functions as required, but it's difficult to test some edge cases. I think this will help increase the coverage and reduce the time and effort/stress to test. We also need this extended to help PREVENT not CURE.

Congratulations Team!! @nehasuresh how does this tool help out companies who are building voice ai bots . Do you have a free tier ?

Loving the creativity behind NotHotDog, @vedhsaka! It's great to see such an innovative tool for LLM powered APIs. The emphasis on user-friendly interfaces and detailed reporting is crucial for developers looking to streamline their testing processes. The multi-format support for both text and voice outputs opens up a lot of possibilities too. Can't wait to test it out myself. Here’s to better API testing and fewer accidental octopus snacks! Upvoted! 🌭

This is a fascinating tool! It really seems like it could streamline the testing process. What inspired the unique name "NotHotDog" :D

Impressive name! I’ll definitely be recommending it to my team! Congrats on the launch @vedhsaka and team!

Congrats @vedhsaka on launching NotHotDog! This is a game changer for API testing, especially for LLMs. Love the blend of humor and functionality you’ve created—definitely brings a fresh perspective to the QA space. The multi-format support and customizable scenarios will truly streamline the process. Excited to see how it evolves and can't wait to try it out! Keep up the great work! 🚀

OK, so we're going back to the "Not Hotdog" joke, huh, look doesn't everybody just use Postman already for this kinda stuff, seems a bit redundant, unless you're really into novelty apps, maybe focus a bit more on what sets it apart from other tools like Swagger?

This is Interesting. Congratulations to your launch, Akash! just gave it a good upvote

Sounds like another attempt to ride the AI wave, isn't there already a ton of tools like Postman and others that do this, what's really new here 🧐

Interesting concept but I’m not sure how many people will need a tool just for API testing like this, isn't Postman enough, it might be good if it had more unique features or integrations with other dev tools, what are you planning next for this?

wow this is some forward thinking testing software! A common struggle has been how do we make sure the AI has the right output? This really answers that question! Do we need to use the waitlist or is there a way to directly signup to try it out?

Hi @vedhsaka Congrats on the launch! Seems like NotHotDog is a really useful tool :) I created this shortlink for you that will send users directly to this PH page, in case you feel like the PH link is too long :) Here is the link: https://shor.tf/nhd-ph

Nice throwback to Not Hotdog.

Congratulation on the launch, very cool product, good job by you and your team. cool name too :D does your tool support team collaboration too? and where can I find your pricing details?