RAG & Agentic AI Systems
Signature Course No. 203 — A Signature AI Socratic Coaching Course.
A New Kind of Learning
Socratic coaching, delivered by an agentic AI coach.
Not a course you watch. An AI coach you work with.
The Lighthouse Coach begins by discovering how you think about the subject, teaches what is missing, and gives you realistic practice before asking you to prove that you can use it. You may test out of concepts you already understand, while capstones turn the learning into a practical plan, decision, conversation, or other real-world result.
The curriculum is deliberately authored; the AI delivers it through coaching. It is not an AI randomly generating lessons.
A coach that teaches by asking — not by lecturing
The Lighthouse Coach is an AI Socratic coach built on Cognosco Learning's RAG & Agentic AI Systems course, in the AI at Work category. It does not play videos at you. It holds a conversation: it asks you a question, listens to your answer, names the misconception it hears, affirms what you got right, and asks the next question — the way a great coach works in the room.
A retrieval system makes a checkable promise. An ordinary chatbot answers from what it absorbed when it was built. A retrieval-augmented system answers from these documents, the ones you chose, and shows where each answer came from — and every stage of its pipeline can fail in a way that looks like the same confident wrong answer: the corpus lacked the document, the chunk cut the answer in half, the search ranked a look-alike first, or the model blended the passages it was handed.
Module 1 builds retrieval that finds the answer. State the contract first — documents, scope, refusal, stakes, and the judgment clause; audit the corpus on authority, coverage, duplication and contradiction, and provenance; cut documents to fit their content; understand embeddings and the index as mechanism; measure recall and precision; rerank the shortlist; run exact words and meaning together; and transform the question toward the documents' vocabulary.
Module 2 makes answers verifiable and systems runnable. Ground every claim inside the evidence and cite it at claim level; evaluate retrieval and answers as separate grades that are never merged; put the agent on retrieval duty only, routing and iterating under bounds; keep the corpus fresh and permissioned; and run the whole system inside a token and latency budget computed from its own parts.
It works in two movements. First, Module 1 — Building Retrieval That Finds the Answer — work through Concepts 1–9, finishing with The Retrieval Foundation; then, Module 2 — Answers You Can Verify, Systems You Can Run — work through Concepts 10–18, finishing with The System in Production.
Both capstones produce real artifacts — The Retrieval Foundation, a foundation design for Fennick Parts Co.'s retrieval system that a build team could work from; and The System in Production, an operating plan for running that system responsibly — each built on the running case and again on your own live retrieval project.
One workplace, worked honestly, the whole way through. Fennick Parts Co., a fictional distributor of industrial components, is building a retrieval system over its own documentation — product manuals, warranty terms, and safety bulletins — and makes, in these pages, most of the mistakes real teams make, in an order that lets you learn from each one cheaply. Every worked number recomputes exactly from the figures given on its own page.
Scope and honesty are stated up front. This book owns retrieval systems: general agent construction belongs to a companion course, and agents appear here only as controllers of retrieval. Product facts are labeled as product facts — wherever the course touches one, it says so in place: as of this writing, check the current documentation.
The course is self-paced and always on — roughly 30 minutes per concept, about 9 hours in full, taken in as many sittings as you like. You can type your answers, or talk out loud: the Voice Coach speaks its questions and listens to your spoken replies. Learners who already know the material can test out concept by concept.
This is the two hundred and third course in The Lighthouse Signature Series — the online counterpart to the one-day, in-person learning Cognosco Learning has delivered since 2002.
Course Facts
One full concept, coached end to end — free: verify your email and we’ll send you a link to start.
Already enrolled? Enter the course →
Diagnose → Learn & Practice → Prove → Capstone
Every learner moves through the same discipline a Cognosco instructor would insist on in the room.
Diagnose
The Coach starts where the course starts: with what you actually bring. Every concept opens with three questions. They are not a quiz; they locate where you actually stand — what you already handle well in a retrieval pipeline, and where the common trap is waiting for you. Your answers shape how deeply the Coach works the concept with you. Everyone begins with Module 1 — no skipping the foundations you only think you have.
Learn & Practice
Work each concept in conversation with the Coach — spoken or written — then practice it against realistic situations until it holds up.
Prove
Every concept ends in proof: answer the check cold and demonstrate the skill. Know it already? Test out and take credit immediately.
Capstone
Finish with two capstones — The Retrieval Foundation for Module 1 and The System in Production for Module 2 — that pull the whole course together, and earn the certificate.
What You'll Learn
One pipeline is the unit of diagnosis. Every failure belongs to a stage — corpus, preparation, index, retrieval, generation, presentation — and each stage has its own test; this course never lets you say the system is inaccurate without naming the stage and the evidence.
Module 1 finds the answer. The contract and the audit before anything is indexed, chunking fitted to the documents, embeddings and the index understood as mechanism, retrieval quality in computed figures, and the three improvements — reranking, hybrid search, and query transformation — specified as deliberate settings, not inherited defaults.
Module 2 earns belief. Grounding and claim-level citation that make answers checkable, two evaluations kept separate forever, the agent bounded to retrieval control, and the operating disciplines — freshness, access control, and budget — that keep a pilot believable in production.
And every claim stays checkable. A retrieved passage is evidence; a citation is the pointer to that evidence; an evaluation is the habit of checking pointers at scale. The course treats an uncheckable answer as an unfinished answer, however fluent it sounds.
What you will learn
- Explain the retrieval pipeline end to end and locate a failure in the stage that produced it
- Audit a corpus for authority, coverage, duplication, and provenance before indexing it
- Design a chunking scheme — size, overlap, structure — fitted to the documents and the questions
- Explain embeddings and vector indexes, and choose retrieval settings deliberately
- Measure retrieval quality with recall and precision, and improve it with reranking and hybrid search
- Transform questions — rewriting, expanding, and decomposing them — so retrieval has a fair chance
- Ground answers in retrieved evidence and cite claims so a reader can verify each one
- Evaluate retrieval and answer quality separately, with test sets and graded numbers
- Use an agent as a retrieval controller: routing, iterating, and stopping on evidence
- Operate the system over time — freshness, access control, security, cost, and latency
Everything in the course
- All 18 concepts of RAG & Agentic AI Systems, in 2 modules
- A starting-point check first — the Coach finds where you actually stand before teaching
- Learn, Practice, Prove for every concept — no passive video watching
- A test-out on every concept: prove you know it and move on
- The Voice Coach: talk with the Coach out loud — it speaks, listens, and replies
- A personal Learner Record of your work across the course
- Two capstone exercises: The Retrieval Foundation and The System in Production
- A printable session summary whenever you pause
- The Lighthouse Coach completion certificate (Signature Series)
- Your progress is saved as you go — stop anytime, resume where you left off
Built for the people who own the answers
Builders of internal knowledge tools — engineers and technical leads putting a question-answering system over company documentation, who need the retrieval half to be as engineered as the model half.
Product and platform owners — who must decide what a RAG system may answer, what it must refuse, and how its quality will be proven before it faces users.
Support, documentation, and knowledge managers — whose manuals and policies become the corpus, and who need to know how document quality becomes answer quality.
Evaluators and reviewers — anyone asked to sign off on a retrieval system, who needs numbers that separate a search problem from a writing problem. The course assumes you can read a technical document and follow a worked calculation; it assumes no prior machine-learning background.
Prefer to learn live and in person? The same material anchors Cognosco's one-day programs — browse the in-person catalog.
Start with The Retrieval Foundation
$195 — introductory price. One payment. No subscription, no password to manage.
Here is exactly what happens when you enroll:
- Pay securely with Stripe — you are taken straight into the course
- Create your learner profile and begin the Module 1 starting-point check
- Save the access key you are given — it restores your enrollment on any device
- Learn at your pace; your progress is stored in your browser on your device
For the full voice experience, use Chrome and allow the microphone when asked. Typing your answers works everywhere, all the time. Questions before you enroll? Email hello@cognoscolearning.com.
More Signature Courses are coming
RAG & Agentic AI Systems is Signature Course No. 203. Leave your email and we'll send you news of future Signature Courses and Lighthouse updates as they are announced — nothing else.