Research Methods and Study Design: Ask Questions Evidence Can Answer
Signature Course No. 461 — A Signature AI Socratic Coaching Course.
No prior methods course needed — your coach starts where you are.
A New Kind of Learning
Socratic coaching, delivered by an agentic AI coach.
Not a course you watch. An AI coach you work with.
The Lighthouse Coach begins by discovering how you think about the subject, teaches what is missing, and gives you realistic practice before asking you to prove that you can use it. You may test out of concepts you already understand, while capstones turn the learning into a practical plan, decision, conversation, or other real-world result.
The curriculum is deliberately authored; the AI delivers it through coaching. It is not an AI randomly generating lessons.
A coach that teaches by asking — not by lecturing
The Lighthouse Coach is an AI Socratic coach built on Cognosco Learning's Research Methods and Study Design: Ask Questions Evidence Can Answer course, in the Personal Effectiveness & Well-Being category. It does not play videos at you. It holds a conversation: it asks you a question, listens to your answer, names the misconception it hears, affirms what you got right, and asks the next question — the way a great coach works in the room.
A study can only answer the question its design actually asks. Most studies begin as a wish — to know whether a program works, whether a condition is spreading, what people actually do — stated too broadly for any evidence to engage. This course teaches the discipline that converts a wish into a study: a question with a population, a comparison, an outcome, and a time frame, and a finding stated in advance that could answer it no.
It starts with the question. Before any design family is named, you learn to narrow the interest, table the variables and their roles, and turn each concept into observations another researcher could repeat. Only then do the five great families — experimental, quasi-experimental, observational, survey, and qualitative — get chosen, by matching the shape of the design to the shape of the question.
It works in two movements. First, Module 1 — From a Wish to a Design — work through Concepts 1–9: A Question Evidence Can Answer; Concepts, Variables, and Claims; Operationalization; Design Families at a Glance; Experimental Designs; Quasi-Experimental Designs; Observational and Correlational Designs; Survey Designs; and Qualitative Designs — finishing with The Design Brief. Then, Module 2 — Making the Design Hold — work through Concepts 10–18: Sampling; Sampling Error, Bias, and Representativeness; Measurement Quality; Internal Validity; External and Construct Validity; Confounding and Control; Analysis Planning Before Data Exist; Ethics, Feasibility, and Practical Design; and Reporting What a Design Can and Cannot Support — finishing with The Protocol That Survives Scrutiny.
Both capstones produce real artifacts — a design brief for a county screening study, with its question narrowed, its variables tabled, its measures operationalized, and its two lists of what the study will and will not entitle anyone to conclude; and a full design protocol for a state workforce study — sampling, measurement, threat audit, analysis plan, and a claims register in two columns — that a board signs before any data are collected.
The honesty standard is part of the course. Statistics stay at the level of design judgment throughout: you will not compute test statistics or be drilled on formulas, because the consequential decisions — the question, the comparison, the sample, the measures, the analysis plan — are all made before data exist, when they are cheap to change and impossible to fake. And the course promises working design judgment and nothing beyond it: no certification, qualification, funding outcome, publication outcome, or research result is promised to any learner.
The course is self-paced and always on — roughly 30 minutes per concept, about 9 hours in full, taken in as many sittings as you like. You can type your answers, or talk out loud: the Voice Coach speaks its questions and listens to your spoken replies. Learners who already know the material can test out concept by concept.
Research Methods and Study Design: Ask Questions Evidence Can Answer is part of The Lighthouse Signature Series — the online counterpart to the one-day, in-person learning Cognosco Learning delivers.
Course Facts
One full concept, coached end to end — free: verify your email and we’ll send you a link to start.
Already enrolled? Enter the course →
Diagnose → Learn & Practice → Prove → Capstone
Every learner moves through the same discipline a Cognosco instructor would insist on in the room.
Diagnose
The Coach starts where the course starts: with your question. State the study you most want answered in one sentence, then underline its population, its comparison, and its outcome — which parts are missing? Name the finding that would genuinely change your mind about it. And say which failure shape comes most naturally to you: the conclusion inside the question, the unobservable key term, or three questions in one coat. Every concept opens with three questions that locate where you actually stand, and your answers shape how deeply the Coach works the concept with you. Everyone begins with Module 1 — no skipping the foundations you only think you have.
Learn & Practice
Work each concept in conversation with the Coach — spoken or written — then practice it against realistic situations until it holds up.
Prove
Every concept ends in proof: answer the check cold and demonstrate the skill. Know it already? Test out and take credit immediately.
Capstone
Finish with two capstones — The Design Brief for Module 1 and The Protocol That Survives Scrutiny for Module 2 — that pull the whole course together, and earn the certificate.
What You'll Learn
The question governs everything. No design choice in this course is good or bad in itself; it is good or bad for a question. A random sample cannot rescue a question with no comparison in it, and a randomized experiment cannot answer a question about what an experience means to the people living it. Every concept returns to the same test: what question does this move serve?
Module 1 builds the shape of a study. The researchable question and its parts; concepts, variables, and claims, with the roles of mediator, moderator, and confounder; operationalization — indicator, procedure, and rule for values; and the five design families, one at a time, each with the kind of question it exists to answer, the comparison it builds, and the claim it can and cannot carry.
Module 2 makes the design hold. Sampling and its honest limits; measurement quality — reliability, validity, and error; the validity family and its threats; confounding answered by design before arithmetic; the analysis planned before a single datum exists; the ethics and feasibility screen; and the closing audit of reporting, where every claim is matched to what the design can support.
And it holds its boundary throughout. The method is the subject: this course teaches no software, no automated research assistant, and no discipline's subject matter. A study of reading, of clinic attendance, of workplace safety, or of voting appears only as a set of design decisions — what question was asked, what was compared with what, who was included, what was counted, and what the resulting evidence can carry.
What you will learn
- Turn a broad interest into a researchable question with a population, a comparison, and an outcome evidence can reach
- Name variables, claims, and the roles variables play — cause, effect, mediator, moderator, and confounder
- Operationalize a concept: turn an idea into observations, measures, and rules another researcher could repeat
- Choose among experimental, quasi-experimental, observational, survey, and qualitative designs by matching the design to the question
- Build sampling plans and state their honest limits — who a finding covers, and who it does not
- Judge measurement: reliability, validity of measures, and the errors each design invites
- Spot validity threats and confounding, and answer them with design moves made in advance
- Plan the analysis before data exist, and report findings with claims matched to what the design can support
Everything in the course
- All 18 concepts of Research Methods and Study Design: Ask Questions Evidence Can Answer, in 2 modules
- A starting-point check first — the Coach finds where you actually stand before teaching
- Learn, Practice, Prove for every concept — no passive video watching
- A test-out on every concept: prove you know it and move on
- The Voice Coach: talk with the Coach out loud — it speaks, listens, and replies
- A personal Learner Record of your work across the course
- Two capstone exercises: The Design Brief and The Protocol That Survives Scrutiny
- A printable session summary whenever you pause
- The Lighthouse Coach completion certificate (Signature Series)
- Your progress is saved as you go — stop anytime, resume where you left off
Built for people who propose, commission, or judge studies
Graduate students and early researchers — who must propose a study that a committee, a funder, or a review board will judge on its design before a single result exists; and government and nonprofit evaluators who are asked whether a program worked and must build a design that can answer that question honestly, often without the power to assign anyone to anything.
Program managers and policy staff — who commission, fund, or act on studies and need to tell a design that can carry a decision from one that merely produces numbers.
Professionals in any field — health, education, social services, business, public administration — who read research critically and want to see, in any report, which design move is doing the work and which claim outruns it. This course assumes no prior methods course and no statistics background beyond ordinary arithmetic and comfort with percentages.
Prefer to learn live and in person? The same material anchors Cognosco's one-day programs — browse the in-person catalog.
Start with A Question Evidence Can Answer
$195 — introductory price. One payment. No subscription, no password to manage.
Here is exactly what happens when you enroll:
- Pay securely with Stripe — you are taken straight into the course
- Create your learner profile and begin the Module 1 starting-point check
- Save the access key you are given — it restores your enrollment on any device
- Learn at your pace; your progress is stored in your browser on your device
For the full voice experience, use Chrome and allow the microphone when asked. Typing your answers works everywhere, all the time. Questions before you enroll? Email hello@cognoscolearning.com.
Before you enroll
What is a Socratic coaching session?
A conversation, not a video. Your coach asks a question; you answer — out loud by voice, or by typing — and the coach responds to what you said: naming the misconception it hears, affirming what you got right, and asking the next question. You advance only when you have mastered each concept, so a finished course means the learning held.
How long does it take — and how long do I have?
About 30 minutes per concept. Learn in sittings of any length; your progress is saved as you go. You have a full year from purchase to finish, and you can revisit and retake within that year.
What does the certificate verify?
That you completed every concept and both capstones of this course. Anyone can confirm a Cognosco certificate online — enter its certificate ID on our verification page.
What if it isn't for me — what are the refunds?
If you have not started, cancel for a full refund within seven days of purchase. Once you have started, there is no cash refund — stop before finishing and we credit the full amount you paid toward any other course in the library (credit valid one year from your original purchase). Once you complete the course, no refund or credit applies.
More Signature Courses are coming
Research Methods and Study Design: Ask Questions Evidence Can Answer is Signature Course No. 461. Leave your email and we'll send you news of future Signature Courses and Lighthouse updates as they are announced — nothing else.