ALL PROJECTS ARCHIVE
Production Live
AI Agents & RAG2026

PaperLens AI

Autonomous AI Research Co-Pilot & Literature Engine

PaperLens AI is an autonomous, full-stack AI research orchestrator designed to transform unstructured academic literature into structured, actionable research outputs. Features a dual-pipeline RAG architecture (in-memory BM25 + FAISS hybrid search for instant single-session analysis, paired with remote Supabase pgvector persistence for cross-session synthesis), a multi-provider fallback engine, real-time Server-Sent Events (SSE) citation tracking, and an autonomous ReAct agent loop with Model Context Protocol (MCP) server support. Engineered specifically for production memory constraints (500MB cap compliant) through generator-based stream parsing, lazy-loaded vector models, and turn-compressed prompt optimization.

$git clone https://github.com/arpanpramanik2003/PaperLens-AI.git
PaperLens AI
DEPLOYMENT CATEGORYAI Agents & RAG
RELEASE CYCLE2026
SYSTEM HEALTHProduction Live
Architecture Overview

Dual-Pipeline RAG & ReAct Agent Loop with Deterministic Fast-Path Routing

Deterministic Fast-Path Router
1.5s Saved (~600 tokens/query)

Direct keyword pattern matcher skips the LLM router call for single-intent queries (e.g. dataset lookup, literature search).

LLM Call Consolidation
54.5% API Call Reduction

Consolidated dual-pass synthesis & critique into single LLM passes; batched multi-chunk summarization.

Prompt Compression
~40% Context Token Reduction

Turn 1 sends full tool JSON schemas; Turns 2–6 automatically compress tools into signature representations.

Memory-Safe Extraction
0MB Heap Bloat (<500MB Cap)

Generator-based PyMuPDF stream parsing combined with lazy-loaded SentenceTransformer vector models.

Structured Outputs
0 Retries / 0 Regex Hacks

Strict Pydantic v2 schemas (ReActDecision, SynthesisResult) with structured XML tag enforcement.

Citation Resilience
<1% Missing Citation Rate

Automatic 4-stage search fallback (DOI → Exact Match → Title → Loose Keyword) with rate-limit recovery.

Engineering Highlights

  • Dual-Pipeline RAG (In-memory BM25 + FAISS hybrid search + Supabase pgvector)
  • 54.5% API call reduction via batched single-pass synthesis & critique
  • Deterministic Fast-Path Router saving ~1.5s latency per query
  • 500MB free-tier heap memory cap compliance using generator stream parsing
  • Autonomous ReAct Agent Loop with native Model Context Protocol (MCP) support

TECHNOLOGY STACK ECOSYSTEM (14)

ZERO RUNTIME BLOAT
React 18TypeScriptFastAPIPython 3.10+Supabase (pgvector)FAISSrank_bm25PyMuPDFGroq Cloud APIReAct AgentMCP ServerClerk JWTPydantic v2Tailwind CSS