Data Engineering on Google Cloud
Signature Course No. 217 — A Signature AI Socratic Coaching Course.
A New Kind of Learning
Socratic coaching, delivered by an agentic AI coach.
Not a course you watch. An AI coach you work with.
The Lighthouse Coach begins by discovering how you think about the subject, teaches what is missing, and gives you realistic practice before asking you to prove that you can use it. You may test out of concepts you already understand, while capstones turn the learning into a practical plan, decision, conversation, or other real-world result.
The curriculum is deliberately authored; the AI delivers it through coaching. It is not an AI randomly generating lessons.
A coach that teaches by asking — not by lecturing
The Lighthouse Coach is an AI Socratic coach built on Cognosco Learning's Data Engineering on Google Cloud course, in the Personal Effectiveness & Well-Being category. It does not play videos at you. It holds a conversation: it asks you a question, listens to your answer, names the misconception it hears, affirms what you got right, and asks the next question — the way a great coach works in the room.
Every business runs twice — once in the world, and once in its data. Data engineering is the craft of making the second running faithful to the first, and this course teaches that craft on the platform where you will practice it: Google Cloud, named and used as itself.
You learn the platform as a map. Cloud Storage keeps the raw stuff exactly as it arrived; Pub/Sub catches events the moment they happen; Dataflow processes data in stream and batch; BigQuery, the warehouse, answers what all of the data, taken together, says; and the operational databases answer what one record says, right now. Each piece does its own job — and a design that asks a piece to do another piece's job fails in the gaps between services.
Then you run the estate in production. Batch pipelines idempotent by design and safe to re-run; streaming pipelines on windows, watermarks, and written late-data policy; orchestration that conducts by confirmed inputs and backfills without corrupting history; observability that reconciles data instead of applauding jobs; governance that keeps the estate explainable; serving fitted to people, applications, and models; and cost discipline, because on a metered platform every design choice is also a purchase.
It works in two movements. First, Module 1 — Getting Data In and Keeping It Right — work through Concepts 1–9, finishing with The Estate, Designed; then, Module 2 — Pipelines That Run Themselves — work through Concepts 10–18, finishing with The Estate, in Production.
Both capstones produce real artifacts — The Estate, Designed, a complete ingestion-and-storage design for Halloway Markets' estate, with its fault ledger stating what the design does not yet fix; and The Estate, in Production, a production plan and run-book for the same estate — pipelines, orchestration, observability, governance, serving, and a price attached choice by choice, closed under the standard you sign.
The honesty discipline is part of the course. This course teaches practitioner data engineering on Google Cloud, end to end. Platform facts are perishable and are framed in place with a direction to check the current documentation; the book states no price, quota, or limit as a flat fact, and every worked figure is the running company's own, shown with its arithmetic, or a labeled invented scenario figure.
The course is self-paced and always on — roughly 30 minutes per concept, about 9 hours in full, taken in as many sittings as you like. You can type your answers, or talk out loud: the Voice Coach speaks its questions and listens to your spoken replies. Learners who already know the material can test out concept by concept.
Data Engineering on Google Cloud is part of The Lighthouse Signature Series — the online counterpart to the one-day, in-person learning Cognosco Learning has delivered since 2002.
Course Facts
One full concept, coached end to end — free: verify your email and we’ll send you a link to start.
Already enrolled? Enter the course →
Diagnose → Learn & Practice → Prove → Capstone
Every learner moves through the same discipline a Cognosco instructor would insist on in the room.
Diagnose
The Coach starts where the course starts: with what you actually bring. A warehouse table is a constructed artifact, resting on choices about what was captured, what was rejected, which source won a disagreement, and how late arrivals were handled — so the Coach begins at the map, not at the dashboard. Every concept opens with three questions that locate where you actually stand, and your answers shape how deeply the Coach works the concept with you. Everyone begins with Module 1 — no skipping the foundations you only think you have.
Learn & Practice
Work each concept in conversation with the Coach — spoken or written — then practice it against realistic situations until it holds up.
Prove
Every concept ends in proof: answer the check cold and demonstrate the skill. Know it already? Test out and take credit immediately.
Capstone
Finish with two capstones — The Estate, Designed for Module 1 and The Estate, in Production for Module 2 — that pull the whole course together, and earn the certificate.
What You'll Learn
The map comes first. What each piece of Google Cloud is for — what question it answers, what it refuses to do, and what it hands its output to — with the running company's estate learned whole, so every later figure can be derived from it.
Module 1 gets data in and keeps it right. The batch-or-stream fork priced from the act the data feeds, the four ingestion patterns, storage placed by access pattern, physical design whose arithmetic is shown, transformation placed where its shape belongs, quality stopped at the door, and access designed before the first analyst arrives.
Module 2 makes pipelines run themselves. Idempotent batch pipelines, streaming pipelines governed by windows, watermarks, and late-data policy, an operated warehouse, orchestration with honest backfills, and signals that make failure loud.
And it keeps the estate explainable and priced. Catalog, lineage, and retention over the whole estate; serving fitted to dashboards, applications, and models; and every design choice priced in the platform's meter shapes — closing with the data engineer's standard you sign.
What you will learn
- Map a data problem onto Google Cloud's storage, messaging, processing, and warehouse services — and defend the mapping, workload by workload
- Ingest files, database changes, event streams, and API feeds into a governed landing zone, and choose storage from the access pattern, not from habit
- Design schemas, partitioning, and clustering that keep queries fast and bills proportionate, decide batch versus streaming by what a decision loses by waiting, and build pipelines in both shapes
- Stop bad data at the door, control access with least-privilege design, and orchestrate, govern, serve, and price the whole estate so failures are loud and every surprise bill is traceable to a choice
Everything in the course
- All 18 concepts of Data Engineering on Google Cloud, in 2 modules
- A starting-point check first — the Coach finds where you actually stand before teaching
- Learn, Practice, Prove for every concept — no passive video watching
- A test-out on every concept: prove you know it and move on
- The Voice Coach: talk with the Coach out loud — it speaks, listens, and replies
- A personal Learner Record of your work across the course
- Two capstone exercises: The Estate, Designed and The Estate, in Production
- A printable session summary whenever you pause
- The Lighthouse Coach completion certificate (Signature Series)
- Your progress is saved as you go — stop anytime, resume where you left off
Built for people who build pipelines
Data engineers — who build and run pipelines for a living and need the platform-specific judgment that separates a pipeline that works in a demo from one that survives a holiday weekend.
Analytics engineers and data analysts moving into building — who already query the warehouse and now own the pipelines that feed it.
Software engineers, and platform and operations staff — whose applications produce the events, files, and database changes everyone else depends on, and who keep a cloud data estate running, secure, and affordable. The course assumes you can write SQL, read a log file without flinching, and find your way around a cloud console; it assumes no prior Google Cloud data work.
Prefer to learn live and in person? The same material anchors Cognosco's one-day programs — browse the in-person catalog.
Start with The Estate, Designed
$195 — introductory price. One payment. No subscription, no password to manage.
Here is exactly what happens when you enroll:
- Pay securely with Stripe — you are taken straight into the course
- Create your learner profile and begin the Module 1 starting-point check
- Save the access key you are given — it restores your enrollment on any device
- Learn at your pace; your progress is stored in your browser on your device
For the full voice experience, use Chrome and allow the microphone when asked. Typing your answers works everywhere, all the time. Questions before you enroll? Email hello@cognoscolearning.com.
More Signature Courses are coming
Data Engineering on Google Cloud is Signature Course No. 217. Leave your email and we'll send you news of future Signature Courses and Lighthouse updates as they are announced — nothing else.