Model Online / On-Site
Duration
Modules 6 modules

Course Objective & Scope

A RAG script that works on a hundred static files breaks down in production when faced with tens of thousands of mutating documents, deletions, embedding model upgrades, concurrent user traffic and security audits. This course addresses both planes of a production-grade RAG system: the asynchronous ingestion/indexing data plane and the low-latency online query/serving plane.

Participants design a production architecture incorporating event-driven (webhook/CDC) document sync, zero-downtime blue-green index migrations, multi-layer caching, indirect prompt injection defences and OpenTelemetry tracing.

Who Should Attend?

  • AI, data and backend engineers taking RAG systems into enterprise-scale production
  • Solution and platform architects responsible for search, data pipelines and AI infrastructure
  • MLOps and SRE teams managing SLAs, unit cost and operational reliability for AI services
  • Prerequisite: solid grasp of RAG fundamentals, vector databases and distributed backend systems

Key Takeaways

  • Design queue-backed, idempotent and incremental document ingestion pipelines
  • Execute zero-downtime index migrations via blue-green aliasing when changing embeddings or chunking
  • Optimise the end-to-end query latency budget across embedding, ANN search, reranking and LLM TTFT
  • Defend against permission leaks, PII exposure and indirect prompt injection hidden in documents
  • Build operational dashboards tracking index freshness lag, zero-hit rates, cost and quality drift

Curriculum

Production RAG Reference Architecture: Decoupling Ingestion and Serving
  • Isolating heavy asynchronous document ingestion from the low-latency query serving path
  • Message queues (Kafka/RabbitMQ/SQS), dead-letter queues (DLQs), backpressure and retries
Document Lifecycle, Index Freshness and Zero-Downtime Re-Indexing
  • Handling updates, soft/hard deletes and orphan chunk cleanup via webhooks and CDC
  • Versioned indexes and blue-green alias swaps when upgrading embedding models or chunking logic
Query Performance, Latency Budgets and Multi-Tier Caching
  • Optimising the latency breakdown across query embedding, filtered ANN, reranking and LLM TTFT
  • Embedding caches, retrieval caches and permission-scoped response caches
RAG Security: Indirect Prompt Injection, PII and Data Governance
  • Defending against indirect prompt injection payloads embedded inside retrieved documents
  • Pre-ingestion PII scanning, right-to-erasure propagation (KVKK/GDPR) and audit trails
Observability, Knowledge Drift Detection and Operational Resilience
  • Tracing retrieved chunk IDs, similarity scores, reranker shifts and token spend per request
  • Detecting emerging knowledge gaps (unanswered query clusters) and degraded-mode fallbacks
Architecture Workshop: Production RAG Blueprint and Readiness Review
  • Designing a production RAG architecture sized for the organisation's corpus and SLAs
  • Completing a comprehensive Production Readiness Checklist

Other Courses in This Category

  • Building an Enterprise Knowledge Assistant: Architecture and Implementation

    End-to-end engineering programme for building an enterprise knowledge assistant across SharePoint, Confluence, Jira and internal docs with multi-turn memory, citations, permissions and feedback loops.

    RAG & Enterprise Knowledge Systems Corporate
    Live Course
    6 modules
    View
  • Text-to-SQL and Conversational Analytics over Enterprise Databases

    Engineering Text-to-SQL and conversational analytics systems that translate natural-language business questions into accurate SQL queries, tables and charts over PostgreSQL, BigQuery, Snowflake and SQL Server.

    RAG & Enterprise Knowledge Systems Corporate
    Live Course
    6 modules
    View
  • Semantic Layers and Governed Metric Definitions for Text-to-SQL and AI Analytics

    Preventing inconsistent numbers in AI analytics by grounding LLMs in a governed semantic layer (Cube, dbt Semantic Layer, YAML metric definitions, canonical joins and business glossaries).

    RAG & Enterprise Knowledge Systems Corporate
    Live Course
    6 modules
    View
  • SQL Query Validation, Guardrails and Access Control for Text-to-SQL

    Securing production Text-to-SQL systems with AST validation (SQLGlot), read-only execution sandboxes, Row-Level Security (RLS), column masking, query cost guards and semantic verification.

    RAG & Enterprise Knowledge Systems Corporate
    Live Course
    6 modules
    View
  • Text-to-SQL Accuracy Evaluation and Enterprise Benchmarking

    Evaluating Text-to-SQL systems rigorously using Execution Accuracy, result-set matching, AST structural comparison, query efficiency scoring and enterprise benchmark construction.

    RAG & Enterprise Knowledge Systems Corporate
    Live Course
    6 modules
    View
  • RAG with LangChain RAG with LangChain

    Hands-on workshop on building an end-to-end Retrieval-Augmented Generation (RAG) chatbot using LangChain, covering document chunking, embeddings, vector databases, and a Gradio interface.

    RAG & Enterprise Knowledge Systems Corporate, Individual Workshop
    Live Course
    6 modules
    View

Get in touch