The AI core
The engine room. Nothing here faces a customer — it is what lets every other layer think, remember and act instead of just storing rows.
Inference servers
The thing that actually runs a model's weights and answers requests. Pick by where it runs: GPU server, laptop CPU, or a phone.
Model gateways & routers
One endpoint in front of every model you use. Handles keys, failover, cost tracking and per-request routing so your apps never hardcode a provider.
Agent frameworks
Libraries that let a model plan, call tools and loop until a job is done. Code-first ones give control; visual ones give speed.
Coding agents
Agents pointed at a repo instead of a chat box. This is the layer that actually replaces contract dev hours.
Vector databases
Where embeddings live so a model can find the right 20 paragraphs out of a million. If you already run Postgres, start with pgvector and stop there.
RAG frameworks
Retrieval-augmented generation: answer from your documents, with citations, instead of from the model's memory. This is 80% of real business AI.
Agent memory
The difference between a chatbot and an assistant. Persists facts, preferences and history across sessions instead of starting cold.
Fine-tuning
Teaching a base model your domain, your tone or your format. LoRA on a single GPU is enough for almost every business case.
Evals & observability
Proof that a change made things better, and a trace when a customer says it got something wrong. Skipping this is why AI features quietly rot.
Guardrails & AI security
Stops prompt injection, PII leaks and jailbreaks before they reach a customer or a payer. Non-negotiable once real data flows.
Chat interfaces
The window people actually type into. Put one in front of your gateway and the whole company gets ChatGPT without the per-seat bill.
MCP & tool plumbing
The standard that lets one agent reach your email, DB, CRM and browser without a bespoke integration each time.
Voice, vision & media
Everything that turns text into something a human hears or sees, and back again. This is the layer that lets an agent answer a phone or cut an ad.
Text to speech
Turns text into a voice. The split that matters: CPU-only models are free and instant; GPU models sound better and can clone a voice.
Speech to text
Turns audio into text. Whisper is the family; the forks differ on speed, word timestamps and knowing who was speaking.
Realtime voice agents
The full loop — listen, think, speak, handle interruption — under 800ms. What a sales or support call agent actually needs.
Diarisation & VAD
Who spoke, and when. Without this a meeting transcript is one wall of text with no names on it.
Image generation
Marketing graphics, product shots, thumbnails, logos. ComfyUI is GPL — fine to run, do not bundle it inside something you sell closed.
Video generation & editing
Ads, product motion, subtitled clips. Generation needs a GPU; the editing and clipping tools are CPU and free.
Avatars & talking heads
A face that speaks your script. The weakest part of open source — usable for internal video, not for a client's brand film.
Document AI & OCR
Turning PDFs, scans and faxes into structured data. For RCM this is the front door — EOBs, remits, payer manuals, contracts.
Vision & detection
Counting, reading and spotting things in images or video. Ultralytics YOLO is AGPL and enforced — in a product you sell it means publishing your source.
Go to market
Finding people, reaching them, and closing them. Every row here has a SaaS bill attached to it in most companies — this is where self-hosting pays back fastest.
CRM & system of record
The one place a customer's history lives. Getting this wrong means every other tool argues about who the customer is.
Lead generation & enrichment
Filling the top of the funnel legally. Scraping LinkedIn is fragile and bannable — local business data and public registries are not.
Marketing automation & email campaigns
Sequences, newsletters, drip campaigns. Host the engine, but always send through a real provider — port 25 from your own box will not deliver.
Social publishing
Scheduling and posting across platforms. The tool is never the blocker — getting each platform's API app approved is the real work.
SEO & content intelligence
Keywords, rankings, crawl health, trends. This whole layer is CPU-only and free — there is no reason to be paying Semrush.
Web analytics & product analytics
Who came, what they did, where they dropped. Self-hosting also solves the consent problem — the data never leaves your box.
Experiments & feature flags
Ship a change to 5% of users, measure, then roll out. Also the safest way to launch AI features you are not sure about.
Website, CMS & landing pages
Where the content and the sign-up form live. Headless CMS keeps the front-end yours and the editing simple for non-developers.
Ecommerce & storefronts
Selling product online. Medusa is the developer pick; Bagisto and WooCommerce win when a non-developer has to run the shop.
Booking & scheduling
Letting someone pick a time without an email thread. One of the highest value-per-hour things to self-host.
Forms & surveys
Intake, qualification, feedback. Formbricks is the one that also does the in-app survey side.
Run the work
Communication, projects, documents, meetings, people. The unglamorous layer where a 20-person company quietly spends $3-5k a month on seats.
Messaging & customer conversations
Reaching a person on the channel they actually read. In India that is WhatsApp, and self-hosting it is the single biggest unlock here.
Helpdesk & support
Tickets, SLAs and a knowledge base. Only worth standing up once more than one person answers customers.
Team chat
Internal conversation. Matrix is the one that federates; Mattermost is the one enterprises approve.
Meetings & video
Calls, webinars and the transcript afterwards. LiveKit is the building block; Jitsi is the finished product.
Project management & tickets
Where work is tracked. Plane is the closest open Linear; Huly is the everything-app bet.
Docs, wiki & knowledge base
Where decisions and process live so they survive people leaving. This is also the corpus your RAG layer should read.
Files, storage & sync
The company drive. Nextcloud is the full office suite; MinIO is the S3 your applications talk to.
E-signature & documents
Contracts signed without DocuSign. Both good options are copyleft — fine for your own contracts, careful if you rebrand and resell.
Whiteboard & design
Diagrams, wireframes, architecture. Excalidraw is the one everyone actually uses; Penpot is the real Figma replacement.
People, HR & time
Onboarding, leave, attendance, appraisals. Frappe HR is the only open option that covers Indian payroll properly.
Learning & enablement
Training staff or selling a cohort. Moodle is the institution standard; Frappe LMS is the light one.
Money & back office
Invoices, books, payroll, compliance. The layer founders postpone until an auditor asks — and the one where copyleft licences matter most, because you run these for yourself rather than resell them.
ERP — the whole back office in one
If you would otherwise stitch six tools together, an ERP is usually the cheaper answer. ERPNext is the strongest open option for an Indian company.
Accounting & bookkeeping
The books themselves. Plain-text accounting is the developer's answer; Akaunting and ERPNext are what an accountant will accept.
Invoicing & billing
Getting paid. Invoice Ninja covers one-off invoices; Lago and Kill Bill handle recurring and usage-based billing.
Payments
Taking money. The gateways themselves are not open source — what is open is the layer that orchestrates them and keeps you portable.
Compliance & tax
The India-specific gap. GST filing, TDS and e-invoicing have no strong open tool — ERPNext plus custom scripts is the honest answer.
Data
Storage, movement, and the dashboards leadership actually looks at. An AI company that cannot answer 'what happened last month' from its own data is running on vibes.
Databases
Postgres unless you have a specific reason. Watch the licence shifts — Redis and MongoDB both moved away from open licences.
Data movement & transformation
Getting data out of SaaS tools and into one place, then shaping it. Airbyte plus dbt is the standard pair.
Orchestration & scheduling
Running jobs on time, in order, with retries and visibility. This is what replaces a folder of cron scripts nobody trusts.
BI & dashboards
The numbers on a screen. Metabase for business users, Evidence for engineers who want dashboards in git.
Talk to your data
Natural-language questions over a database. Genuinely useful now, but always keep it read-only and scoped by tenant.
Search
Finding a record fast. Meilisearch for product search, OpenSearch when you need log-scale and aggregations.
Streaming & queues
Moving events between services without them calling each other directly. NATS if you want simple; Kafka if you need the ecosystem.
Build, ship & run
The platform underneath everything else. Get this layer right once and every product you build after ships in an afternoon instead of a week.
Self-hosted PaaS
The 'push and it deploys' experience on a box you own. Coolify is the one to start with — it turns a $6 VPS into your own Vercel and Heroku.
Containers & orchestration
Where things actually run. k3s is the sane Kubernetes for a small team; Proxmox is the sane hypervisor.
Proxy, ingress & tunnels
Getting traffic to the right container with HTTPS, and reaching a machine that has no public IP.
Git hosting & CI/CD
Your own GitHub when you need it, and the pipeline that ships code. Gitea Actions runs GitHub-syntax workflows on your own runner.
Identity & access
One login across every internal tool, with roles. Do this before you have fifteen tools each with their own password list.
Secrets management
Stop keeping keys in a flat file. This is the single highest-value security upgrade available here today.
Monitoring & uptime
Knowing something broke before a client tells you. Uptime Kuma takes ten minutes and covers most of the value.
Logs, traces & errors
What actually happened, in order, when something failed. SigNoz is the one-box replacement for a Datadog bill.
Backup & disaster recovery
The thing you only value once. restic plus a cron is enough for almost every small company.
Security & hardening
Intrusion detection, vulnerability scanning and CI checks. Wazuh and CrowdSec are the two that matter for an internet-facing box.
Browser automation & QA
Testing that a site works, and driving sites that have no API. This is also how agents click things.
API layer & gateways
How services talk. Hoppscotch and Bruno replace Postman without the account and the cloud sync you did not ask for.
Frontend & apps
What the customer sees. This is already the GetMax standard — Next.js, Tailwind and shadcn on every product.