LEBOK Wiki
Prototype — not authoritative. A learning-engineering product under development, cloned from the lebok.wiki of record. Much content is AI-drafted and pending expert review.About & pedagogy →

4.6 Empirical Methods and Experimental Techniques

Source:lebok.wiki/en/knowledge-area-4-engineering-foundations/4-2-engineering-design/4-2-2-levels-of-abstraction-and-encapsulation/4-6-empirical-methods-and-experimental-techniques
Retrieved:2026-04-17
Confidence:HIGH

This topic covers Empirical Methods and Experimental Techniques vital to the engineering process, as they enable engineers to validate solutions through rigorous testing and data analysis. Learning engineering relies on empirical methods to assess the efficacy of educational interventions, making data-informed adjustments as needed.

  • Role of Experimentation: SWEBOK notes, “The engineering process involves proposing solutions or models of solutions and conducting experiments or tests to study those proposed solutions or models. Thus, engineers must understand how to create an experiment and analyze the results to evaluate proposed solutions.”

  • Controlled Experiments: Involve manipulating specific variables while controlling others to assess their impact on learning outcomes. Controlled experiments are used to test hypotheses about instructional techniques, user interface designs, or feedback mechanisms.

  • A/B Testing: This experimental technique tests different versions of a learning intervention to determine which one performs better in terms of learner engagement, comprehension, or retention.

  • Field Testing: Unlike controlled experiments, field testing evaluates learning solutions in authentic settings, providing insights into how they perform under real-world conditions.

Further Reading

Source: wrgr/lecommons — curated by the learning engineering community. Confidence: medium — lecommons-curated; not yet independently expert-validated in this context. To validate or challenge any item: use the Edit button on this page. Upgrading confidence from medium → high requires expert sign-off.

Landmark Academic Papers

  • Design principles for virtual humans in educational technology environments — Scotty D. Craig, Nicolaus L. Schroeder (2018). International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-017-0148-y · ~150 citations · tier: contemporary

    Synthesized human-factors engineering principles for designing pedagogical agents. Showed that voice, appearance, and persona of virtual instructors systematically affect learner cognitive load and perceived credibility — establishing that LE must integrate psychological design alongside algorithmic design. Source: lecommons/landscape/data/papers.json · ID: LE-LS-AP-009 · confidence: medium · expert-validated: false

  • The voice quality of pedagogical agent impacts learning and agent perceptions — Ryan F. Siegle, Scotty D. Craig (2024). Journal of Computer Assisted Learning · doi:10.1111/jcal.12997 · ~20 citations · tier: contemporary

    Empirically demonstrated that voice quality (prosody, naturalness, warmth) of a pedagogical agent significantly affects both learning outcomes and learner perception. Illustrates the meticulous human factors engineering required in modern AI-driven learning systems. Source: lecommons/landscape/data/papers.json · ID: LE-LS-AP-010 · confidence: medium · expert-validated: false

Key People

  • Scotty D. Craig (profile), Arizona State University (active 2000s–present) — Human factors researcher; virtual humans and pedagogical agents specialist

    Systematically investigated design principles for virtual humans and pedagogical agents in learning environments Source: lecommons/landscape/data/people.json · ID: LE-LS-PP-014 · confidence: medium · expert-validated: false

Programs & Initiatives

  • Human Factors and Ergonomics Society (CO) · link

    Professional society for human factors and ergonomics. Publishes Human Factors journal and organizes the annual HFES conference. The Training Systems technical group directly addresses LE-relevant human factors in instructional systems. Source: lecommons/site/src/data/programs_people_registry.json · ID: LE-PP-133 · confidence: medium · expert-validated: false

  • INCOSE Systems Engineering Body of Knowledge (SEBoK) (CO) · link

    Open wiki-based body of knowledge for systems engineering. Includes the Human Systems Integration knowledge area. The SE process framework (requirements, architecture, integration, verification) is the engineering process backbone that LE adapts for learning system development. Source: lecommons/site/src/data/programs_people_registry.json · ID: LE-PP-134 · confidence: medium · expert-validated: false

Lecommons enrichment applied 2026-04-17. All items pending expert validation. See wrgr/lecommons for source data and curation methodology.

←4.5.1 Simulation and Prototyping
4.7 Applying Engineering Foundations in Learning Engineering→