Databricks and the Lakehouse in Practice: One Platform for Data and AI Work
Signature Course No. 432 — A Signature AI Socratic Coaching Course.
No experience needed — your coach starts where you are.
A New Kind of Learning
Socratic coaching, delivered by an agentic AI coach.
Not a course you watch. An AI coach you work with.
The Lighthouse Coach begins by discovering how you think about the subject, teaches what is missing, and gives you realistic practice before asking you to prove that you can use it. You may test out of concepts you already understand, while capstones turn the learning into a practical plan, decision, conversation, or other real-world result.
The curriculum is deliberately authored; the AI delivers it through coaching. It is not an AI randomly generating lessons.
A coach that teaches by asking — not by lecturing
The Lighthouse Coach is an AI Socratic coach built on Cognosco Learning's Databricks and the Lakehouse in Practice: One Platform for Data and AI Work course, in the Personal Effectiveness & Well-Being category. It does not play videos at you. It holds a conversation: it asks you a question, listens to your answer, names the misconception it hears, affirms what you got right, and asks the next question — the way a great coach works in the room.
One estate can serve engineering, analytics, and machine learning — but only if it is built as one estate from the first table. That is this course's premise. Most companies do not have a data problem — they have a copies problem: the same facts living in a warehouse for reporting, in a lake for the data scientists, in extracts on laptops, and in a feature store for the models, disagreeing quietly, with no single place where a question about a table has one answer. The lakehouse answers that sprawl with architecture — data held once, in open formats on object storage, under one governance layer — and this course teaches that idea on Databricks, not as a tour of features, but as an operating craft.
It starts with the seat. You will take the platform seat and learn exactly what it owns — placement, promotion, governance, and cost on the one estate: how the lakehouse is laid out, how data lands and is promoted, which compute runs which job, how access and lineage are governed, and what the bill is telling you — and what it refuses, because the refusals are half the definition: never the copy a team asks for under deadline; always the need, granted on the estate. The craft is taught at workflow and architecture level, on one running estate — Brenwick Home Goods, a fictional home-goods retailer — so every concept works on the same orders, inventory, and loyalty tables.
It works in two movements. First, Module 1 — Build the Lakehouse: Architecture, Ingestion, and the Work Surface — work through Concepts 1–9, finishing with The Estate Build; then, Module 2 — Govern It and Run It: Access, Quality, Cost, and Models — work through Concepts 10–18, finishing with The Governed Release.
Both capstones produce real artifacts — an Estate Build Plan for Brenwick Home Goods, a fictional home-goods retailer selling online and through forty stores, whose estate begins as finance's spreadsheet extract, the loyalty team's marketing export, and a contractor's unreproducible model snapshot: every workload placed on the estate map with an owner, every source landed by its temper, orders, inventory, and returns promoted through bronze, silver, and gold as promises, the load-bearing notebooks graduated into shippable work, compute chosen by workload shape, and analysts served from the same governed tables; and a Governed Production Release Plan that takes the same estate into governed production — grants reviewed and lineage verified, quality gated at both promotion borders, the bill read by owner, data shared without copies, the demand forecaster built on governed features, and the release walked through its promotion path with rollbacks stated in advance.
The honesty standard is part of the course. Platforms change faster than books do — features are renamed, consoles are rearranged, services appear and are retired — so the course teaches the durable operating model: storage held apart from compute, open table formats with transactional behavior, the medallion discipline, compute matched to workload shape, one catalog governing access and lineage, and cost read as a signal, flagging every current product specific to verify against the documentation before you rely on it. Nothing in the course is endorsed by, or written on behalf of, Databricks, Inc.; the platform is named because the craft is platform-specific, and naming it is description, not endorsement.
The course is self-paced and always on — roughly 30 minutes per concept, about 9 hours in full, taken in as many sittings as you like. You can type your answers, or talk out loud: the Voice Coach speaks its questions and listens to your spoken replies. Learners who already know the material can test out concept by concept.
Databricks and the Lakehouse in Practice: One Platform for Data and AI Work is part of The Lighthouse Signature Series — the online counterpart to the one-day, in-person learning Cognosco Learning delivers.
Course Facts
One full concept, coached end to end — free: verify your email and we’ll send you a link to start.
Already enrolled? Enter the course →
Diagnose → Learn & Practice → Prove → Capstone
Every learner moves through the same discipline a Cognosco instructor would insist on in the room.
Diagnose
The Coach starts where the course starts: with the seat. List every place in your organization where the same core facts — orders, customers, inventory — currently live in more than one copy, and for each copy say whose need created it and what on-estate alternative would meet that need; think of the last data request you saw granted quickly under deadline pressure, and say whether it was placed — right layer, right owner, right access — or merely accommodated, and what the accommodation cost; and name one artifact in your world that began as exploration and quietly became production, and say what promotion to governed, scheduled, owned status would require. Every concept opens with three questions that locate where you actually stand, and your answers shape how deeply the Coach works the concept with you. Everyone begins with Module 1 — no skipping the foundations you only think you have.
Learn & Practice
Work each concept in conversation with the Coach — spoken or written — then practice it against realistic situations until it holds up.
Prove
Every concept ends in proof: answer the check cold and demonstrate the skill. Know it already? Test out and take credit immediately.
Capstone
Finish with two capstones — The Estate Build for Module 1 and The Governed Release for Module 2 — that pull the whole course together, and earn the certificate.
What You'll Learn
Build the lakehouse, then govern it and run it. Every skill in this course is the same discipline at a different depth: hold the data once, promote it as a sequence of promises, govern it through one catalog, and let placement, gates, lineage, and the bill — not copies and good intentions — carry the estate's promises to the people who consume its numbers.
Module 1 builds the estate. The Lakehouse Seat; Lakehouse Architecture; The Estate Map; Landing Data Well; The Medallion Discipline; Notebooks with Discipline; Compute Choices; Workflows That Run Themselves; and SQL on the Lakehouse — the seat itself, the architecture underneath it, the map with owners, landing by each source's temper, promotion through bronze, silver, and gold, the disciplined work surface, compute chosen by shape, workflows that repair themselves, and analysts served from the same tables.
Module 2 governs it and runs it. Unity Catalog in Practice; Quality You Can Prove; Layout, Performance, and Cost; Streaming on the Lakehouse; Sharing Without Copies; Machine Learning on the Same Estate; Promotion Without Drama; Running the Platform; and The Lakehouse Practitioner's Standard — one governance layer for the whole estate, quality gates with quarantine, layout and cost read from evidence, streams and shares without copies, models built on the same estate, release without drama, incidents run by blast radius, and the standard you sign.
And it holds its boundary throughout. This course owns the operating craft of one platform — Databricks — and nothing else. It does not teach Snowflake operation, which is Signature Course No. 350's ground — a rival platform that does a similar job a different way — and it does not teach the platform-neutral dbt transformation discipline, which No. 430 owns: where transformed data appears here, it appears as tables on this platform, promoted and governed by this platform's means.
What you will learn
- Hold the lakehouse seat: state what the platform owns, place each kind of work — engineering, analytics, machine learning — on the one estate, and refuse the copies that recreate the sprawl.
- Reason from the architecture: storage apart from compute, open table formats with transactional behavior, and what each choice makes possible and what it costs.
- Map the estate so every workspace, catalog, schema, and table has a home and a named owner.
- Land data well: choose the ingestion pattern that fits how each source behaves, and land raw data faithfully before anyone transforms it.
- Promote tables through the medallion discipline — bronze, silver, gold — as promises about fitness, and serve each question from the layer that can honestly answer it.
- Keep notebooks disciplined: explore freely, then ship parameterized, modular, reviewable code with no hidden state.
- Choose compute by workload shape — job compute, interactive compute, SQL warehouses, serverless options — and read the bill as a design signal.
- Build workflows that run themselves: dependency graphs, retries, alerts, idempotent tasks, and a repair path when a run fails partway.
- Serve SQL consumers from the same governed tables, sized for their query shape and concurrency, without extracts and copies.
- Govern the estate through its catalog: least-privilege access at the right level, lineage you can follow, and one answer to every question about a table.
- Prove quality at promotion gates: checks, quarantine for data that fails, and freshness stated honestly for every served table.
- Diagnose performance and cost from scan behavior, layout, and clustering, and attribute spend to the work that caused it.
- Stream into lakehouse tables with checkpoint discipline, late-data handling, and upserts that do not corrupt the table.
- Share data with partners and other teams as live, governed access — never as exported copies that escape governance.
- Build machine learning on the same estate: features from governed tables, tracked experiments, registered models, and serving under the same access rules.
- Promote work between environments under version control and review, respond to platform incidents by blast radius, and hold the practitioner's standard when pressure argues for a shortcut.
Everything in the course
- All 18 concepts of Databricks and the Lakehouse in Practice: One Platform for Data and AI Work, in 2 modules
- A starting-point check first — the Coach finds where you actually stand before teaching
- Learn, Practice, Prove for every concept — no passive video watching
- A test-out on every concept: prove you know it and move on
- The Voice Coach: talk with the Coach out loud — it speaks, listens, and replies
- A personal Learner Record of your work across the course
- Two capstone exercises: The Estate Build and The Governed Release
- A printable session summary whenever you pause
- The Lighthouse Coach completion certificate (Signature Series)
- Your progress is saved as you go — stop anytime, resume where you left off
Built for the people who run the estate the business reports from
Data engineers — who land, promote, and serve data on a Databricks estate and need the full operating craft, not just the next pipeline; and analytics engineers and senior analysts who build and consume lakehouse tables and need to know what a governed, well-promoted table promises them, and what to demand when it does not.
Machine learning engineers and data scientists — who build features and models from estate data and need the platform habits that keep that work governed, reproducible, and connected to the tables the business trusts. This course assumes your ground; it does not re-teach it.
Platform and data team leads — who set estate conventions, grant access, review cost, and answer for the platform, and who need a standard they can hold a whole team to; and BI and reporting leads who serve business users from lakehouse tables and need the freshness, quality, and cost judgment to do it without spawning private copies. This course assumes working data fluency — you can write SQL, you have handled tabular data in files or a warehouse, and you understand what a pipeline is; it assumes no prior Databricks experience.
Prefer to learn live and in person? The same material anchors Cognosco's one-day programs — browse the in-person catalog.
Start with The Lakehouse Seat
$195 — introductory price. One payment. No subscription, no password to manage.
Here is exactly what happens when you enroll:
- Pay securely with Stripe — you are taken straight into the course
- Create your learner profile and begin the Module 1 starting-point check
- Save the access key you are given — it restores your enrollment on any device
- Learn at your pace; your progress is stored in your browser on your device
For the full voice experience, use Chrome and allow the microphone when asked. Typing your answers works everywhere, all the time. Questions before you enroll? Email hello@cognoscolearning.com.
Before you enroll
What is a Socratic coaching session?
A conversation, not a video. Your coach asks a question; you answer — out loud by voice, or by typing — and the coach responds to what you said: naming the misconception it hears, affirming what you got right, and asking the next question. You advance only when you have mastered each concept, so a finished course means the learning held.
How long does it take — and how long do I have?
About 30 minutes per concept. Learn in sittings of any length; your progress is saved as you go. You have a full year from purchase to finish, and you can revisit and retake within that year.
What does the certificate verify?
That you completed every concept and both capstones of this course. Anyone can confirm a Cognosco certificate online — enter its certificate ID on our verification page.
What if it isn't for me — what are the refunds?
If you have not started, cancel for a full refund within seven days of purchase. Once you have started, there is no cash refund — stop before finishing and we credit the full amount you paid toward any other course in the library (credit valid one year from your original purchase). Once you complete the course, no refund or credit applies.
More Signature Courses are coming
Databricks and the Lakehouse in Practice: One Platform for Data and AI Work is Signature Course No. 432. Leave your email and we'll send you news of future Signature Courses and Lighthouse updates as they are announced — nothing else.