LEBOK Wiki
Prototype — not authoritative. A learning-engineering product under development, cloned from the lebok.wiki of record. Much content is AI-drafted and pending expert review.About & pedagogy →
📖

Authored from the Learning Engineering Toolkit — pending expert review

This page was authored on 2026-07-16 directly from the source text of the Learning Engineering Toolkit (Jim Goodell & Janet Kolodner (Eds.), 2023). Every factual claim carries an inline <cite> citation to the specific chapter it draws on; the full references are listed at the foot of the page. The prose is grounded in the primary source but has not yet been validated by a subject-matter expert. Use the Edit button to validate, correct, or expand.

Chapters: LET-14 (Chapter 14), LET-10 (Chapter 10)

11.5 Professional Standards in Learning Engineering

Professional standards in learning engineering serve two related but distinct functions: enabling interoperability between systems and organizations, and establishing accountability for practice quality. Without standards, LE systems cannot exchange data, components cannot be reused across platforms, and there is no shared basis for evaluating whether a learning intervention was well-designed. With standards, the field gains the infrastructure for cumulative improvement — each practitioner building on documented, validated practice rather than starting from scratch.

The Standards Landscape. The LE standards landscape spans technical, practice, and ethical dimensions. On the technical side, IEEE has developed a family of standards that form the interoperability infrastructure for learning systems: IEEE 1484.1 (LTSA) specifies a reference architecture for learning systems interoperability [LE-LS-SG-001]; IEEE 9274 / xAPI provides the data schema for tracking learning experiences across platforms [LE-LS-SG-002]; IEEE P2247 specifies interoperability requirements for Adaptive Instructional Systems [LE-LS-SG-003]; IEEE 1484.20.2 standardizes competency definition schema [LE-LS-SG-004]; and IEEE LOM specifies learning object metadata [LE-LS-SG-005]. Together, these standards create the technical vocabulary and architecture that allow LE systems to interoperate at scale.

ICICLE Practice Standards. Beyond technical standards, IEEE ICICLE [LE-LS-CO-001] has developed practice standards through its Body of Knowledge process — specifying what competencies a learning engineer should hold, what process standards LE work should meet, and what quality indicators should be expected of LE outputs. The LEAMM (Learning Engineering Adoption Maturity Model) [LE-LS-GL-009] provides an organizational-level framework for assessing how systematically an institution is applying LE practice standards. Jim Goodell's infrastructure work on the Learning Engineering Toolkit and IEEE ICICLE [LE-LS-PP-012] has been central to translating standards aspirations into practitioner-accessible guidance.

Quality Frameworks and Accountability. "High-Leverage Opportunities for Learning Engineering" identifies empirical validation — A/B testing at scale, randomized controlled trials, longitudinal outcome tracking — as a core infrastructure investment for the field [LE-LS-GL-003]. Quality in LE is not merely a checklist: it requires demonstrated learning outcomes, not just adherence to design templates. The Generalizable LEAMM model operationalizes quality as a progression from ad-hoc practice to systematic evidence-based design, with each level characterized by increasing rigor in measurement and iteration [LE-LS-AP-013].

Standards as Enablers of Equity. Federal policy guidance on AI in education has established that standards for learning systems must include equity requirements — protections against algorithmic bias, requirements for data representativeness, and disclosure of system limitations [LE-LS-GL-004]. Standards are not neutral technical documents; they encode values. LE practitioners who engage with standards processes have the opportunity to ensure that equity and learner welfare considerations are built into the technical infrastructure of the field, not treated as add-ons.

This section covers two core dimensions of professional standards: Section 11.5.1 examines standards for quality and effectiveness, and Section 11.5.2 examines ethics and professional conduct.


Subsections:


From the Learning Engineering Toolkit

Chapter 14 (Software and Technology Standards as Tools) presents standards as essential professional infrastructure. It describes them as formally published documents recording agreed conventions for data and software — covering structure, definition, transmission, tagging, and use — and argues that adopting them in place of bespoke or proprietary designs boosts interoperability and helps learning solutions scale. [LET-14] No single standard delivers interoperability on its own; it depends on several coordinated layers, often maintained by different standards bodies. [LET-14]

The chapter directs learning engineers to the organizations that create and steward these standards, among them the IEEE Learning Technology Standards Committee, the Internet Engineering Task Force, IMS Global, the Postsecondary Electronic Standards Council, the Dublin Core Metadata Initiative, and the World Wide Web Consortium. [LET-14] It notes that a learning engineer need not master every applicable standard, but that teams tackling technology-heavy or large-scale projects should bring in expert guidance early so the right combination of standards is built into the design from the start. [LET-14]

The chapter also shows standards work as live professional activity in the field. Its coauthors contributed to the IEEE standard classifying adaptive instructional systems, which sorts AIS components into four groups — learner model, adaptive engine, content model, and interface — and the book's lead author, Jim Goodell, chairs the IEEE workgroup developing standards for more modular, interoperable AIS architectures. [LET-14]

Chapter 10 (Tools for Teaming) ties standards to the way teams operate. It counts command of relevant regulations and technical standards among the capabilities a learning engineering problem may require, which is why standards literacy belongs on a cross-functional team. [LET-10] For the creation phase, the chapter suggests teams assemble internal reference materials to steer the work — standards, experimentation protocols, and style guides among them — along with arrangements for who will handle peer review and final approvals. [LET-10] Read side by side, the two chapters cast standards as both external infrastructure the field sustains and internal discipline that professional teams take on. [LET-14], [LET-10]

Sources from the Learning Engineering Toolkit

  1. [LET-14]Jim Goodell, Andrew J. Hampton, Richard Tong & Sae Schatz (2023). Chapter 14: Software and Technology Standards as Tools. In Jim Goodell & Janet Kolodner, Learning Engineering Toolkit (pp. 311–331). Routledge / Taylor & Francis. doi:10.4324/9781003276579
  2. [LET-10]Dina Kurzweil & Erin S. Barry (2023). Chapter 10: Tools for Teaming. In Jim Goodell & Janet Kolodner, Learning Engineering Toolkit (pp. 255–267). Routledge / Taylor & Francis. doi:10.4324/9781003276579

Further Reading

Source: wrgr/lecommons — curated by the learning engineering community. Confidence: medium — lecommons-curated; not yet independently expert-validated in this context. To validate or challenge any item: use the Edit button on this page. Upgrading confidence from mediumhigh requires expert sign-off.

Landmark Academic Papers

  • Design Experiments: Theoretical and Methodological Challenges in Creating Complex Interventions in Classroom Settings — Ann L. Brown (1992). Journal of the Learning Sciences · doi:10.1207/s15327809jls0202_2 · ~2,800 citations · tier: foundational

    The most-cited paper in JLS history. Established design-based research as the canonical methodology for testing engineered learning interventions in authentic classroom settings. Source: lecommons/landscape/data/papers.json · ID: LE-LS-AP-003 · confidence: medium · expert-validated: false

  • Generalizable Learning Engineering Adoption Maturity Model — Shawn Blake-Plock, Scotty D. Craig, Emily Czerwinski et al. (2025). Journal of Learning Engineering (preprint/proceedings) · tier: contemporary

    Defines a multi-level organizational capability model for assessing and advancing an institution's LE practice. Source: lecommons/landscape/data/papers.json · ID: LE-LS-AP-013 · confidence: medium · expert-validated: false

Policy, Reports & Grey Literature

  • Artificial Intelligence and the Future of Teaching and Learning: Insights and Recommendations — U.S. Department of Education, Office of Educational Technology (2023). U.S. Department of Education · link

    First major federal policy document addressing AI in education with explicit civil-rights framing. Mandated algorithmic fairness and data representation requirements. Source: lecommons/landscape/data/grey_literature.json · ID: LE-LS-GL-004 · confidence: low · expert-validated: false

  • High-Leverage Opportunities for Learning Engineering — Ryan S. Baker, Ulrich Boser, Allison Shelley (2021). University of Pennsylvania Center for Learning Analytics

    The field's most comprehensive contemporary roadmap. Source: lecommons/landscape/data/grey_literature.json · ID: LE-LS-GL-003 · confidence: low · expert-validated: false

Key People

  • Jim Goodell (profile) — LE Toolkit; co-chaired ICICLE; professional LE infrastructure
    Source: lecommons/landscape/data/people.json · ID: LE-LS-PP-012 · confidence: medium · expert-validated: false

Organizations, Conferences & Journals

  • IEEE ICICLE — Industry Consortium on Learning Engineering (consortium) · link

    Source: lecommons/landscape/data/organizations.json · ID: LE-LS-CO-001 · confidence: medium · expert-validated: false
  • The Simon Initiative — Carnegie Mellon University (research_center) · link

    Source: lecommons/landscape/data/organizations.json · ID: LE-LS-CO-002 · confidence: medium · expert-validated: false

Lecommons enrichment applied 2026-04-17. All items pending expert validation. See wrgr/lecommons for source data and curation methodology.


Community Recommended Reading

Items from the lecommons corpus identified as relevant to this topic. All text verbatim from lecommons sources. Confidence: medium. Expert validation required.

Learning Engineering Enlightenment: Think Like an Engineer — Ellen Wagner (2024, New Learning Frontier)

Wagner's 2024 follow-on to her long thread of LE-vs-ID articles. The sharpest version of her argument that the shift isn't tools, it's disposition: LEs reason like engineers about uncertainty and evidence.

Source: lecommons/site/src/content/reading-list/learning-engineering-enlightenment-think-like-an-engineer.mdx · ID: lecommons-rl-learning-engineering-enlightenment-think-like-an-engineer · type: reading list item · confidence: medium · expert-validated: false

Online Education: A Catalyst for Higher Education Reforms (2016, MIT Online Education Policy Initiative)

MIT policy report arguing that online education should catalyze structural reform in higher ed — an early institutional signal that learning needs engineering-style discipline, not just more technology.

Source: lecommons/site/src/content/reading-list/online-education-a-catalyst-for-higher-education-reforms.mdx · ID: lecommons-rl-online-education-a-catalyst-for-higher-education-reforms · type: reading list item · confidence: medium · expert-validated: false

Why Did We Do That? A Systematic Approach to Tracking Decisions in the Design and Iteration of Learning Experiences — Lauren Totino, Aaron Kessler (2023, Journal of Applied Instructional Design)

Totino and Kessler's practical protocol for decision tracking across LE projects. Pairs well with our Field Note on Five Whys — this paper operationalizes the evidence-decision-tracker discipline ICICLE publishes.

Source: lecommons/site/src/content/reading-list/why-did-we-do-that-a-systematic-approach-to-tracking-decisions-in-the-.mdx · ID: lecommons-rl-why-did-we-do-that-a-systematic-approach-to-tracking-decisions-in-the- · type: reading list item · confidence: medium · expert-validated: false

Chapter 3: LE Toolkit — Introduction (open access chapter) — Jim Goodell (2022)

Introductory chapter of the Learning Engineering Toolkit. Frames learning engineering as an evidence-based, iterative design practice. Provides field overview for practitioners and researchers entering the discipline.

Source: goodell-ch3-introduction · book: Learning Engineering Toolkit (Goodell & Kolodner, 2022) · confidence: medium · expert-validated: false

Chapter 5: LE Toolkit — Learning Engineering is a Process (open access chapter) — Aaron Kessler, Scotty Craig, Jim Goodell, Dina Kurzweil, Scott Greenwald (2022)

Defines learning engineering as an iterative, evidence-based problem-solving process. Covers five-phase LE process: challenge identification, solution creation, implementation, data investigation, and continuous iteration. Technology-agnostic principles applicable to AI-driven and low-tech interventions.

Source: goodell-ch5-le-is-a-process · book: Learning Engineering Toolkit (Goodell & Kolodner, 2022) · confidence: medium · expert-validated: false

Chapter 6: LE Toolkit — Learning Engineering Applies the Learning Sciences (open access chapter) — Jim Goodell, Janet Kolodner, Aaron Kessler (2022)

Covers the learning-sciences foundations of LE practice. Demonstrates how cognitive science, motivation theory, and evidence-based instructional methods are applied by learning engineers to design, build, and evaluate learning experiences.

Source: goodell-ch6-le-applies-learning-sciences · book: Learning Engineering Toolkit (Goodell & Kolodner, 2022) · confidence: medium · expert-validated: false

Context enrichment applied 2026-04-17. See wrgr/lecommons for source data.