SecondActSociety RAG Pipeline V2

Decision Progress

Latency: Connection Pool Warming
Observability: LangSmith Only
Enhancement: Conversation Memory (LIVE)
Graph Depth: 3 Chunks
Fallback: Broad Match

2 decisions remaining to begin implementation sprint

Decision 1 of 2

Next Enhancement Priority

A) Intent Classification Refinement Recommended

Improve 7-intent accuracy. The Feb 28 clarification routing bug revealed over-triggering on vague/personal queries from known users. Better intent classification has the highest immediate UX impact.

B) A/B Testing Framework

Experiment with RRF weights, phase ratios, fallback thresholds. Requires sufficient query volume for statistical significance.

C) Authority Taxonomy Evolution

Add new authority levels or reclassify sources as content library grows. Currently: primary, supplementary, illustrative, supporting.

D) Multi-Modal Content Ingestion

Add video/image content paths to RAG pipeline. Activates when Jay produces visual content materials.

Decision 2 of 2

Connection Pool Warming Scope

A) Service Startup Only

Pre-warm all connections (PostgreSQL/pgvector, Neo4j, Redis) on FastAPI startup event. Simple, reliable.

B) Startup + Periodic Keepalive Recommended

Pre-warm on startup PLUS background task to maintain warm connections. Prevents Railway idle timeout from causing cold-start penalty.

C) Lazy + Circuit Breaker

No pre-warming. Instead, add circuit breaker pattern for graceful degradation when connections are cold.