DID FinderBack
Source
DI-PSSS-81524D

Training Evaluation Document

The Training Evaluation Document specifies the personnel, resources, organization, functions, procedures, and requirements for evaluating training and training equipment.

Approval DateDecember 18, 2019
AMSC NumberN10132
Preparing ActivityAS
Project NumberPSSS-2020-002
OPR—
DTIC ApplicableNo
GIDEP ApplicableNo
LimitationNone
Applicable FormsNone
Approval Limitation—
Form Version—
DID Formatfree_text
963C CompliantYes
DISTRIBUTION STATEMENT A: Approved for public release; distribution is unlimited.
Supersedes
DI-SESS-81524C
Related
—

Description & Purpose

—

Application & Interrelationship

—

Use & Relationship

The Training Evaluation Document specifies the personnel, resources, organization, functions, procedures, and requirements for evaluating training and training equipment. It also includes requirements for data resulting from a training evaluation.

This Data Item Description (DID) contains the preparation instructions for the content and format of the Training Evaluation Document.

This DID contains the format, content, and intended use information for the data product resulting from the performance requirements described by 3.2.8 of MILPRF-29612B, and is applicable to the acquisition of training data products. Data product performance evaluation criteria are specified in 4.3.8 of MIL-PRF29612B.

It is not intended that all the requirements contained herein be applied to every program or program phase. Any individual data requirement contained in this DID is subject to deletion tailoring.

This DID supersedes DI-SESS-81524C.

Preparation Instructions

1Reference documents.None.
2Format.The contractor format is acceptable. Standard digital data, when specified must be in compliance with the content and format requirements specified in the DoD Data Architecture (DDA) and the Defense Data Dictionary System (DDDS). The deliverable of the product required by this DID meets the intent and requirements of DODINST 5000.02.
3Content.The Training Evaluation Document shall contain the following:
3.1Front matter.The content of front matter shall be in accordance with Appendix A of MILPRF29612B.
3.2Introduction.The introduction shall provide a brief overview of the Training Evaluation Document.
3.3Part 1: Training evaluation planning data.The training evaluation planning data shall include the following:
3.3.1Purpose of the planned evaluation, or validation.
3.3.2Scope of the evaluation (e.g., learning objectives, critical standards).
3.3.3Type of planned evaluation (e.g. summative, formative, training effectiveness, training capabilities, cost effectiveness, test items, course or materials review)
3.3.4Method of evaluation (e.g. empirical, analytic, internal, external).
3.3.5Types of information to be collected (e.g. opinion, observation, performance).
3.3.6Procedures to be used for collecting information as follows:
3.3.6.1Criteria to select size and composition of target population sample.
3.3.6.2Criteria for site selection.
3.3.6.3Methods for collection of information about student target population sample participants.
3.3.6.4Criteria for selection of instructors.
3.3.6.5Methods for collection of information about instructor participants.
3.3.6.6Methods to be used to prepare facilities and equipment prior to conduct evaluation.
3.3.6.7Methods to be used to prepare students and instructors to participate in the evaluation.
3.3.6.8Methods for administration of evaluation.
3.3.6.9Methods for collection of student reactions to the training during the presentation.
3.3.6.10Methods for observation of the presentation of training.
3.3.6.11Methods for collection of student and instructor comments at the conclusion of training.
3.3.6.12Methods for the recording of data.
3.3.6.13Methods for the conduct of interviews.
3.3.6.14Methods for participants to provide additional data following the completion of the actual evaluation.
3.3.6.15Methods for determining validity and reliability of the evaluation.
3.3.6.16Methods for conducting individual trials.
3.3.6.17Methods for conducting small group trials.
3.3.6.18Methods for conducting operational trials.
3.3.6.19Methods for conducting test validation.
3.3.6.20Methods for conducting content validation.
3.3.6.21Methods for correcting training materials.
3.3.6.22Methods for revising training materials.
3.3.6.23Methods for conducting tests.
3.3.6.24Methods for correcting tests.
3.3.6.25Methods for revising tests.
3.3.6.26Methods for validating corrected materials.
3.3.6.27Methods for validating corrected tests.
3.3.7Procedures to be used for data analysis as follows:
3.3.7.1Criteria for assessing performance.
3.3.7.2Criteria and procedures for validation of the evaluation.
3.3.7.3Analytical treatment of data (e.g. statistical treatment).
3.3.7.4Criteria and procedures for estimating criticality of deficiencies.
3.3.7.5Criteria for accepting tests as validated.
3.3.7.6Criteria for accepting training materials as validated.
3.3.7.7Criteria and procedures for demonstrating impact on cost effectiveness and Return On Investment (ROI).
3.3.7.8Procedures to be used for reporting the findings.
3.3.7.9Procedures to be used for reporting the conclusions.
3.3.7.10Procedures to be used for reporting the recommendations
3.3.7.11Procedures used to report changes required based on trials.
3.3.7.12The data collection instruments to be used (e.g., tests, checklists, questionnaires.
3.3.7.13Schedule for data collection and performing the evaluations and validation trials.
3.3.7.14A description of resource requirements (e.g., personnel, materials, special equipment, travel funds, facilities) for each evaluation or validation trial.
3.3.7.15Responsibility for testing and responsibility for conducting the evaluations and validation trials.
3.3.7.16Roles and responsibilities of all personnel to be involved (e.g., command, students, evaluators, graduates, supervisors of graduates) in each evaluation and validation trial.
3.3.7.17Identification of the agencies and decision authorities who will receive the report.
3.3.7.18Listing of the proposed evaluation sites.
3.4Part 2: Training evaluation results data.This data shall provide a description of the purpose, scope, and intended use of the training evaluation results, and shall include the following:
3.4.1Introduction.The introduction shall describe the following:
3.4.1.1Method of evaluation.
3.4.1.2Types of information collected.
3.4.1.3Procedures and instruments used for collecting information.
3.4.1.4Procedures for data analysis.
3.4.1.5Background paragraph that explains history and circumstances requiring evaluation.
3.4.1.6Background paragraph that explains history and circumstances requiring validation.
3.4.1.7Problem paragraph that provides a statement of any problem or deficiency discovered by the evaluation.
3.4.1.8Program paragraph that provides a statement of any problem or deficiency discovered by the validation.
3.4.1.9Data collection deficiencies.
3.4.1.10Results of individual trials.
3.4.1.11Results of small group validation trials.
3.4.1.12Results of operational validation trials.
3.4.1.13Results of test validation.
3.4.1.14Changes made to training materials as a result of previous validation trials.
3.4.1.15Results of cost effectiveness and Return of Investment (ROI) analyses.
3.4.2Summary of findings.The summary shall provide a description of the data collected during the evaluation.
3.4.3Conclusion and recommendations.Conclusions and recommendations shall include:
3.4.3.1A description of whether or not the product met the established validation criteria and is acceptable for training.If the product did not meet the criteria, this data shall provide specific recommendations for correcting product deficiencies and its impact on the delivery schedule. In the case of test and training material validation trials, this data shall provide descriptions of changes made to test and training materials after each validation performed.
3.4.3.2A description of the cost effectiveness and Return of Investment (ROI) benefits of the training.
3.5Part 3: Instructional delivery system test and evaluation data.This data shall include:
3.5.1A description of the development tests and identification of the structure of anticipated contractual acceptance plans.
3.5.2A description of the operational test and evaluation as follows:
3.5.2.1The need for operational test.
3.5.2.2The operational critical issues as follows:
3.5.2.2.1Operational test and evaluation objectives.
3.5.2.2.2Suitability tests (e.g., mobility, reliability, maintainability, interoperability, compatibility, human factors, availability, transportability, safety, training requirements, supportability).
3.5.2.2.3Feasibility of combined developmental and operational tests.
3.5.2.2.4Need for the development of training effectiveness evaluation plan.
3.5.2.2.5The office of primary responsibility for plan preparation and coordination.
3.5.2.2.6The agency(s) responsible for operational test and evaluation.
3.5.2.3A tabulation of the required key operational characteristics of the training system, showing performance variables, goals, and thresholds expressed in terms of operational suitability and training capabilities.
3.5.2.4Special test requirements (e.g., special test equipment, ranges, students).
3.5.3A description of the training effectiveness evaluation as follows:
3.5.3.1Originator of the training effectiveness evaluation plan.
3.5.3.2The training test agent.
3.5.3.3The purpose of the training effectiveness evaluation.
3.5.3.4Training effectiveness evaluation resource requirements.
3.5.3.5Training effectiveness evaluation information sources.
3.5.3.6Possible constraints on data collection in the training and operational settings.
3.5.3.7Possible evaluation designs.
4Standard digital data.Standard digital data shall be delivered for the Standard Data Elements (SDEs).

References

—
Schema v3.0Community-maintained · Verify against ASSIST
Community-maintained — not an official government database.
Verify against ASSIST·GitHub·About·Disclaimer