Skip to content
View irfanalidv's full-sized avatar

Organizations

@brainsfeed @re-sources-io

Block or report irfanalidv

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
irfanalidv/README.md
Irfan Ali — Senior AI Engineer. I make LLM systems reliable in production.

Website LinkedIn PyPI ORCID Email


Senior AI engineer, seven-plus years. I work on the part that's hard after the demo works: retrieval that returns the right answer, agents that degrade loudly instead of silently, evaluation harnesses that catch regressions, and cost you can actually account for.

Founding AI engineer at Kuration AI. First AI hire at Schneider Electric's Luminous R&D, reporting to the CTO. First data hire at brainsfeed, where I led a distributed team of ten.

Open to senior AI IC roles — Bengaluru or remote. irfan.ali@datacortex.in

Experience

Role Org When
Independent AI Engineer (self-employed) DataCortex IQ · India Dec 2025 – present
Founding AI Engineer Kuration AI · Hong Kong 2024–2025
Senior Manager – Data & AI, R&D · first AI hire, reported to CTO Luminous Power Technologies (Schneider Electric) · India 2023–2024
Data Analytics & Automation Associate Lynk · India 2022–2023
Head of Data & Analytics · first data hire, led team of 10+ brainsfeed · Hong Kong 2018–2022

Since December 2025 I've worked independently, self-funding a focused build phase on production LLM infrastructure — evaluation, reliability, retrieval, and multi-provider routing — and open-sourcing most of it. Pre-revenue by design and by outcome. The systems below came out of it.

Selected engineering work

Full writeups at datacortex.in. Every number below has a public reproduce path.

Company-intelligence extraction pipeline — Five stages: search → crawl → extract → deduplicate → verdict. FastAPI, DSPy, Pydantic strict JSON Schema, confidence-scored verdicts with human-review flagging, per-call cost metering. Pass 3 runs sequentially so each verdict sees already-confirmed products.

Frozen eval, 2026-09-01, 20/20 domains scored: macro P / R / F1 = 0.771 / 0.869 / 0.795. The writeup is mostly about the misses — including an optimizer run that made the metric worse and got reverted, and a search provider that returned HTTP 400 on empty credits so the pipeline scored zeros instead of failing loudly.

Case study · Eval writeup · Labels + rescore script

FastAPI DSPy Pydantic LangSmith

Voice check-in system — Idempotent webhook ingest, deterministic safety detection on the raw transcript before any LLM call, then a Groq → Hugging Face → heuristic fallback chain. Cross-session context comes from pgvector retrieval over prior calls, not a longer prompt.

Case study

Next.js Bolna Groq pgvector

FMCG trade-operations app — Party ledgers with VAT/PAN, billing, collections, credit limits, godown stock, field-visit logging, phone-width UI. Built for distributors in Nepal. No LLM in the critical path — correctness here is referential integrity and role checks, and the writeup is honest about where app-level roles should have been database policies.

Case study

Next.js 15 TypeScript Supabase

Open source

Twelve published Python libraries. The only numbered result is linked to its benchmark file.

Library What it does
RAGNav · src Hybrid BM25 + dense retrieval with RRF fusion. Navigation-first RAG for long documents. R@3 0.956 over 500 SQuAD questions — script and results in-repo
ragfallback · src Stop RAG from failing silently. Query rewriting, retrieval confidence scoring, fallback strategies, retry logic
AgentEnsemble · src Multi-agent orchestration. ReAct, Swarm, Pipeline, Debate, WorkflowGraph. Routing, planning, RAG, cost tracking
nepal-gov-agent · src Agentic RAG on Nepal government policy and legal documents. Hybrid retrieval with citations. Nepali + English
AgentCare · src Voice AI for healthcare. Call intake, structured extraction, missing-data recovery, appointment orchestration
scrapeflow-py · src Playwright scraping. LLM extraction, hybrid selectors, session persistence, rate limiting, anti-detection
AskPandas · src Natural-language queries on CSV via local LLMs. No API keys, no cloud
lingo-nlp-toolkit · src Lightweight NLP utilities bridging classic pipelines and transformer-ready workflows
PyroChain · src Agentic feature engineering. PyTorch + LangChain agents for multimodal extraction
toxic-comment-classifier · src Deep-learning toxicity detection with per-category scores
socialmediaextractor · src Extract social media profile links from websites
trustpilot-scraper · src Scrape Trustpilot reviews into structured output

All packages: pypi.org/user/irfanalidv

Applied research

  • Cross-validation framework for mental-health AI on MentalChat16K — BERT and neural networks · IJAINN, Dec 2025 · DOI
  • Neural-symbolic topic evolution on Yelp reviews — multi-aspect temporal topic modelling · IJAINN, Oct 2025 · DOI

ORCID: 0000-0003-0022-3047

Contact

irfan.ali@datacortex.in · LinkedIn · datacortex.in

Pinned Loading

  1. ragfallback ragfallback Public

    ragfallback is a Python library that prevents silent RAG failures — chunk quality, retrieval fallback, adaptive querying, and answer evaluation in one package.

    Python 2

  2. AgentEnsemble AgentEnsemble Public

    AgentEnsemble is a Production-ready multi-agent orchestration for Python. ReAct, Swarm, Pipeline, Debate, Router, Planner, WorkflowGraph. Observability, cost tracking, human-in-loop. Structured out…

    Python 1

  3. AskPandas AskPandas Public

    AI-powered data engineering and analytics assistant for querying CSV data using natural language—locally and intelligently

    Python 1

  4. scrapeflow-py scrapeflow-py Public

    Production-ready web scraping engine on Playwright. LLM extraction, hybrid selectors, session persistence, rate limiting, anti-detection.

    Python 1

  5. AgentCare AgentCare Public

    Python framework for voice-AI workflows: healthcare front-desk booking, care coordination, follow-up, and workplace burnout check-ins.

    Python 1

  6. RAGNav RAGNav Public

    RAGNav is a Hybrid RAG retrieval — BM25 + embeddings + document graph. Runs fully offline. SQuAD R@3: 0.956, zero API calls.

    Python 1