Welcome to the AI Engineer Toolkit!
Designed to help software engineers and non-engineers build production-grade AI applications from scratch.
You will find every popular framework, tool, and resource to ship one AI project at a time!
-
If you are new to software engineering check out the fundamentals folder.
-
If you need inspiration, check out example projects inside the sandbox.
-
If you are ready to build, check out the table below.
-
If you want more guidance, check out the upcoming AI Engineering Bootcamp that starts on March 10th, 2025.
Explore the table below to find the right tools for your AI projects.
Each category includes cost details, use cases, and links to official documentation.
| Category | Tool Name | Cost Model | Use Case | Link |
|---|---|---|---|---|
| 😎 Model Providers | ||||
| OpenAI API | Paid API | GPT models | OpenAI | |
| Grok (xAI) | Paid API | Human-like reasoning for complex queries | Grok | |
| Google Gemini | Paid API | Multimodal AI for text and images | Gemini | |
| Hugging Face | Freemium | Open-source models and hosted inference | Hugging Face | |
| Anthropic Claude | Paid API | Safe, interpretable language models | Claude | |
| 📝 Prompt Engineering | ||||
| DSPy | Open-Source | Automate prompt optimization with code | DSPy | |
| LangChain | Open-Source | Build prompt-driven AI workflows | LangChain | |
| Haystack | Open-Source | Optimize prompts for RAG pipelines | Haystack | |
| Agenta | Open-Source | Experiment and deploy prompt variants | Agenta | |
| ⚙️ Backend | ||||
| FastAPI | Open-Source | Fast, modern Python APIs | FastAPI | |
| Flask | Open-Source | Lightweight web apps and APIs | Flask | |
| Django | Open-Source | Robust web framework with ORM | Django | |
| Node.js (Express) | Open-Source | Scalable backend with JavaScript | Express | |
| 💻 Frontend | ||||
| AI SDK (Vercel) | Open-Source | AI-ready UI components for React | AI SDK | |
| Streamlit | Open-Source | Rapid prototyping for data apps | Streamlit | |
| Gradio | Open-Source | Interactive ML model interfaces | Gradio | |
| Dash | Open-Source | Data-driven dashboards with Python | Dash | |
| 🎈 Fullstack | ||||
| Next.js | Open-Source | React with SSR and built-in API routes | Next.js | |
| SvelteKit | Open-Source | Lightweight full-stack with Svelte | SvelteKit | |
| Nuxt.js | Open-Source | Vue.js with server-side rendering | Nuxt.js | |
| Meteor | Open-Source | Full-stack JavaScript framework | Meteor | |
| 📀 Databases | ||||
| Supabase | Freemium | Open-source Firebase alternative | Supabase | |
| PostgreSQL | Open-Source | Reliable relational database | PostgreSQL | |
| MongoDB | Open-Source | Flexible NoSQL for unstructured data | MongoDB | |
| SQLite | Open-Source | Lightweight, serverless database | SQLite | |
| 🔢 Vector Databases | ||||
| ChromaDB | Open-Source | Simple vector store for embeddings | ChromaDB | |
| Pinecone | Paid API | Scalable, hosted vector search | Pinecone | |
| Weaviate | Open-Source | GraphQL-based vector database | Weaviate | |
| Qdrant | Open-Source | High-performance vector search | Qdrant | |
| 📻 Fine-tuning | ||||
| OpenAI Fine-Tuning | Paid API | Customize GPT models for your needs | OpenAI Fine-Tuning | |
| Hugging Face Trainer | Open-Source | Fine-tune transformers easily | Hugging Face Trainer | |
| Ludwig | Open-Source | Declarative fine-tuning for ML models | Ludwig | |
| PyTorch Lightning | Open-Source | Structured fine-tuning with PyTorch | PyTorch Lightning | |
| 🤖 Agent Development | ||||
| LangGraph | Open-Source | Stateful agents with LangChain | LangGraph | |
| AG2 (AgentGraph) | Open-Source | Multi-agent orchestrators | AG2 | |
| CrewAI | Open-Source | Multi-agent workflows for automation | CrewAI | |
| AutoGen | Open-Source | Conversational agents with flexibility | AutoGen | |
| 🕸️ Web Data Access | ||||
| Firecrawl | Freemium | Web scraping with caching | Firecrawl | |
| Jina AI Reader API | Freemium | Extract structured data from web pages | Jina AI | |
| Puppeteer | Open-Source | Dynamic content scraping via browser | Puppeteer | |
| Scrapy | Open-Source | Powerful web crawling framework | Scrapy | |
| 🤔 Evaluation Frameworks | ||||
| RAGAS | Open-Source | Evaluate RAG pipelines | RAGAS | |
| DeepEval | Open-Source | Custom metrics for LLM evaluation | DeepEval | |
| LangSmith | Freemium | Debug and evaluate LLM apps | LangSmith | |
| TruLens | Open-Source | Ground truth evaluation for LLMs | TruLens | |
| 📊 Monitoring & Logging | ||||
| LangSmith | Freemium | Monitor and trace LLM applications | LangSmith | |
| Sentry | Freemium | Real-time error tracking | Sentry | |
| Prometheus | Open-Source | Metrics and alerting for systems | Prometheus | |
| Grafana | Open-Source | Visualize logs and metrics | Grafana | |
| 🔊 Audio | ||||
| Whisper (OpenAI) | Open-Source | High-accuracy speech-to-text | Whisper | |
| DeepSpeech | Open-Source | End-to-end speech recognition | DeepSpeech | |
| Coqui TTS | Open-Source | Text-to-speech with diverse voices | Coqui TTS | |
| SpeechBrain | Open-Source | All-in-one audio processing toolkit | SpeechBrain | |
| 👀 Vision | ||||
| YOLO | Open-Source | Real-time object detection | YOLO | |
| OpenCV | Open-Source | Versatile computer vision library | OpenCV | |
| Detectron2 | Open-Source | Advanced detection and segmentation | Detectron2 | |
| CLIP (OpenAI) | Open-Source | Image-text understanding and search | CLIP | |
| 🚀 Deployment Tools | ||||
| Vercel | Freemium | Deploy full-stack apps with ease | Vercel | |
| Docker | Open-Source | Containerize apps for consistent deployment | Docker | |
| Kubernetes | Open-Source | Orchestrate and scale containerized apps | Kubernetes | |
| Heroku | Freemium | Quick deployment for prototypes and MVPs | Heroku |