Web Application, AI/ML

Snipiddy: AI-Powered Dietary Assistant

Snipiddy is an AI-powered web application that revolutionizes dietary decision-making by extracting and analyzing menu data to provide personalized, insightful information on ingredients, allergens, and dietary recommendations.

Project Overview

Snipiddy is a cutting-edge web application designed to empower users to make informed and safe dietary choices, especially when dining out. By leveraging advanced Artificial Intelligence, Snipiddy goes beyond basic allergy warnings, offering comprehensive insights into menu items tailored to individual needs.

Users simply input their dietary restrictions—such as specific food allergies or irritating ingredients—along with dietary preferences, specific diets (e.g., vegan, keto), or caloric goals. They then capture a photo of a menu, and Snipiddy's AI-powered scanner takes over. Within seconds, the application identifies potential allergens, analyzes nutritional content, and provides personalized dietary recommendations, ensuring users can confidently select their meals.

The core functionality involves Optical Character Recognition (OCR) to extract text from menu images, followed by an Augmented Retrieval Generation (RAG) search utilizing both a local comprehensive allergen database and a Large Language Model (LLM). This dual approach ensures highly accurate and contextually rich information regarding ingredients, potential allergens, and macronutrient content.

Key Features

Users can define specific food allergies, intolerances, dietary preferences (e.g., vegetarian, gluten-free), and macronutrient goals through personalized dietary profiles
Advanced OCR (OpenAI-Vision) to accurately extract text and relevant data from menu images powers menu scanning
Supabase authentication with Google OAuth, allowing users to quickly and securely sign in with their Google accounts

Technologies Used

Next.js (Frontend)FastAPI (Backend)TypescriptSupabase with raw SQL (Database)OpenAI-Vision (OCR)Large Language Models (LLM) for RAG

View Source Code

How It Works

Welcome

Welcome to Snipiddy! Let's help you make safer dining choices

1. Sign Up with Email

Enter your email address and we'll send you a verification code to complete your registration

2. Set Up Your Profile

Customize your dietary profile by selecting allergens, dietary preferences (like vegan or keto), and set your macro nutrient goals for personalized recommendations

3. Just Scan

Simply point your camera at any restaurant menu and wait a few seconds while our AI analyzes the items and provides personalized recommendations based on your dietary profile

That's it!

Search through the menu, apply filters, and instantly see which items match your dietary restrictions. That simple!

Important Health Disclaimer

Snipiddy is not FDA approved and should not replace professional medical advice. Always consult a healthcare professional or allergist and verify information directly with restaurants for your safety.

1 of 6