4.4.1 Definition of Iterative Design

Iterative Design: Defined in SWEBOK as “a cyclical process in which designs are refined based on evaluation and testing, with each iteration building on the last.”
In learning engineering, iterative design enables continuous enhancement of educational interventions, adapting solutions based on learner data and feedback.

From the Learning Engineering Toolkit

The Learning Engineering Toolkit presents learning engineering as a practice built on feedback loops that use data to refine learning solutions step by step. [LET-04] Chapter 4 shows this with the Open edX platform, which was built so that courses could be improved iteratively from the data they generated. [LET-04] To enable that iteration, every action within a course was captured, stored, and kept in an engineered format. [LET-04] The platform also allowed A/B testing of learning activities, randomly handing learners different versions and gathering data to see which performed better. [LET-04]

The chapter ties iteration directly to the models engineers depend on. Among its condensed lessons for using feedback in education, it urges engineers to pick a learning theory on purpose, gauge how well it works, and adjust the model repeatedly as data comes in. [LET-04] In control-theory language, a learning theory serves as the transfer function of a learning system, and since every learner has an individual transfer function that can shift over time, deliberate design hands out problems at suitable difficulty and keeps improving the underlying model with the data collected from the learners who attempt them. [LET-04]

Iterative design also reflects the way engineers handle data differently from research scientists. Where some scientific studies discard outliers as noise, engineers pay special attention to outliers—the particular circumstances in which a system tends to break down. [LET-04] That focus turns iteration into a way of exposing and fixing weaknesses in context rather than smoothing them away. The chapter observes that strong learning engineering leans on a wide range of tested, well-established techniques with well-replicated results, refining how they are applied instead of striking out into untried territory. [LET-04] Finally, data-driven feedback loops are said to guide the iterative learning engineering process itself, binding design refinement to instrumentation and analysis. [LET-04]

Sources from the Learning Engineering Toolkit

[LET-04]Avron Barr, Brandt Dargue, Jim Goodell & Brandt Redd (2023). Chapter 4: Learning Engineering is Engineering. In Jim Goodell & Janet Kolodner, Learning Engineering Toolkit (pp. 125–151). Routledge / Taylor & Francis. doi:10.4324/9781003276579

Source: wrgr/lecommons — curated by the learning engineering community. Confidence: medium — lecommons-curated; not yet independently expert-validated in this context. To validate or challenge any item: use the Edit button on this page. Upgrading confidence from medium → high requires expert sign-off.

Landmark Academic Papers

Design principles for virtual humans in educational technology environments — Scotty D. Craig, Nicolaus L. Schroeder (2018). International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-017-0148-y · ~150 citations · tier: contemporary

Synthesized human-factors engineering principles for designing pedagogical agents. Showed that voice, appearance, and persona of virtual instructors systematically affect learner cognitive load and perceived credibility — establishing that LE must integrate psychological design alongside algorithmic design. Source: lecommons/landscape/data/papers.json · ID: LE-LS-AP-009 · confidence: medium · expert-validated: false
The voice quality of pedagogical agent impacts learning and agent perceptions — Ryan F. Siegle, Scotty D. Craig (2024). Journal of Computer Assisted Learning · doi:10.1111/jcal.12997 · ~20 citations · tier: contemporary

Empirically demonstrated that voice quality (prosody, naturalness, warmth) of a pedagogical agent significantly affects both learning outcomes and learner perception. Illustrates the meticulous human factors engineering required in modern AI-driven learning systems. Source: lecommons/landscape/data/papers.json · ID: LE-LS-AP-010 · confidence: medium · expert-validated: false

Key People

Scotty D. Craig (profile), Arizona State University (active 2000s–present) — Human factors researcher; virtual humans and pedagogical agents specialist

Systematically investigated design principles for virtual humans and pedagogical agents in learning environments Source: lecommons/landscape/data/people.json · ID: LE-LS-PP-014 · confidence: medium · expert-validated: false

Programs & Initiatives

Human Factors and Ergonomics Society (CO) · link

Professional society for human factors and ergonomics. Publishes Human Factors journal and organizes the annual HFES conference. The Training Systems technical group directly addresses LE-relevant human factors in instructional systems. Source: lecommons/site/src/data/programs_people_registry.json · ID: LE-PP-133 · confidence: medium · expert-validated: false
INCOSE Systems Engineering Body of Knowledge (SEBoK) (CO) · link

Open wiki-based body of knowledge for systems engineering. Includes the Human Systems Integration knowledge area. The SE process framework (requirements, architecture, integration, verification) is the engineering process backbone that LE adapts for learning system development. Source: lecommons/site/src/data/programs_people_registry.json · ID: LE-PP-134 · confidence: medium · expert-validated: false