DI-IPSC-81439A

Software TEST Description (STD)

This Data Item Description (DID) details the preparation of Software Test Descriptions (STD), outlining test preparations, cases, and procedures for qualification testing of CSCI or software systems, ensuring acquirer assessment capability.

Approval DateDecember 15, 1999

AMSC NumberN7364

Preparing Activity—

Project Number—

OPRN/SPAWAR

DTIC Applicable—

GIDEP Applicable—

Limitation—

Applicable Forms—

Approval Limitation—

Form Version—

DID Formatdd_form_1664

963C CompliantNo

DISTRIBUTION STATEMENT A: Approved for public release; distribution is unlimited.

Supersedes

DI-IPSC-81439

—

Description & Purpose

The Software Test Description (STD) describes the test preparations, test cases, and test procedures to be used to perform qualification testing of a Computer Software Configuration Item (CSCI) or a software system or subsystem. The STD enables the acquirer to assess the adequacy of the qualification testing to be performed.

Application & Interrelationship

This Data Item Description (DID) contains the format and content preparation instructions for the data product generated by specific and discrete task requirements as delineated in the contract. This DID is used when the developer is tasked to define and record the test preparations, test cases, and test procedures to be used for CSCI qualification testing or for system qualification testing of a software system.

Use & Relationship

—

Preparation Instructions

1Reference documents.None.

2General instructions.

2.1Automated techniques.Use of automated techniques is encouraged. The term "document" in this DID means a collection of data regardless of its medium.

2.2Alternate presentation styles.Diagrams, tables, matrices, and other presentation styles are acceptable substitutes for text when data required by this DID can be made more readable using these styles.

3Format.Following are the format requirements. The description shall be in contractor format unless otherwise specified on the Contract Data Requirements List (CDRL)(DD 1423). The CDRL should specify whether deliverable data are to be delivered on paper or electronic media; are to be in a given electronic form (such as ASCII, CALS, or compatible with a specified word processor or other support software); may be delivered in developer format rather than in the format specified herein; and may reside in a computer-aided software engineering (CASE) or other automated tool rather than in the form of a traditional document.

4Content.The description shall contain the following: The numbers shown designate the paragraph numbers to be used in the document.

4.1Title page or identifier.The document shall include a title page containing, as applicable: document number; volume number; version/revision indicator; security markings or other restrictions on the handling of the document; date; document title; name, abbreviation, and any other identifier for the system, subsystem, or item to which the document applies; contract number; CDRL item number; organization for which the document has been prepared; name and address of the preparing organization; and distribution statement. For data in a database or other alternative form, this information shall be included on external and internal labels or by equivalent identification methods.

4.2Table of contents.The document shall contain a table of contents providing the number, title, and page number of each titled paragraph, figure, table, and appendix. For data in a database or other alternative form, this information shall consist of an internal or external table of contents containing pointers to, or instructions for accessing, each paragraph, figure, table, and appendix or their equivalents.

4.3Page numbering/labeling.Each page shall contain a unique page number and display the document number, including version, volume, and date, as applicable. For data in a database or other alternative form, files, screens, or other entities shall be assigned names or numbers in such a way that desired data can be indexed and accessed.

4.4Response to tailoring instructions.If a paragraph is tailored out of this DID, the resulting document shall contain the corresponding paragraph number and title, followed by "This paragraph has been tailored out." For data in a database or other alternative form, this representation need occur only in the table of contents or equivalent.

4.5Multiple paragraphs and subparagraphs.Any section, paragraph, or subparagraph in this DID may be written as multiple paragraphs or subparagraphs to enhance readability.

4.6Standard data descriptions.If a data description required by this DID has been published in a standard data element dictionary specified in the contract, reference to an entry in that dictionary is preferred over including the description itself.

4.7Substitution of existing documents.Commercial or other existing documents may be substituted for all or part of the document if they contain the required data.

4.8Scope.This section shall be divided into the following paragraphs.

4.8.1Identification.This paragraph shall contain a full identification of the system and the software to which this document applies, including, as applicable, identification number(s), title(s), abbreviation(s), version number(s), and release number(s).

4.8.2System overview.This paragraph shall briefly state the purpose of the system and the software to which this document applies. It shall describe the general nature of the system and software; summarize the history of system development, operation, and maintenance; identify the project sponsor, acquirer, user, developer, and support agencies; identify current and planned operating sites; and list other relevant documents.

4.8.3Document overview.This paragraph shall summarize the purpose and contents of this document and shall describe any security or privacy considerations associated with its use.

4.9Referenced documents.This section shall list the number, title, revision, and date of all documents referenced in this document. This section shall also identify the source for all documents not available through normal Government stocking activities.

4.10Test preparations.This section shall be divided into the following paragraphs. Safety precautions, marked by WARNING or CAUTION, and security and privacy considerations shall be included as applicable.

4.10.1(Project-unique identifier of a test).This paragraph shall identify a test by project-unique identifier, shall provide a brief description, and shall be divided into the following subparagraphs. When the information required duplicates information previously specified for another test, that information may be referenced rather than repeated.

4.10.1.1Hardware preparation.This paragraph shall describe the procedures necessary to prepare the hardware for the test. Reference may be made to published operating manuals for these procedures. The following shall be provided, as applicable:

4.10.1.1.1The specific hardware to be used, identified by name and, if applicable, number

4.10.1.1.2Any switch settings and cabling necessary to connect the hardware

4.10.1.1.3One or more diagrams to show hardware, interconnecting control, and data paths

4.10.1.1.4Step-by-step instructions for placing the hardware in a state of readiness

4.10.1.2Software preparation.This paragraph shall describe the procedures necessary to prepare the item(s) under test and any related software, including data, for the test. Reference may be made to published software manuals for these procedures. The following information shall be provided, as applicable:

4.10.1.2.1The specific software to be used in the test

4.10.1.2.2The storage medium of the item(s) under test (e.g., magnetic tape, diskette)

4.10.1.2.3The storage medium of any related software (e.g., simulators, test drivers, databases)

4.10.1.2.4Instructions for loading the software, including required sequence

4.10.1.2.5Instructions for software initialization common to more than one test case

4.10.1.3Other pre-test preparations.This paragraph shall describe any other pre-test personnel actions, preparations, or procedures necessary to perform the test.

4.11Test descriptions.This section shall be divided into the following paragraphs. Safety precautions, marked by WARNING or CAUTION, and security and privacy considerations shall be included as applicable.

4.11.1(Project-unique identifier of a test).This paragraph shall identify a test by project-unique identifier and shall be divided into the following subparagraphs. When the required information duplicates information previously provided, that information may be referenced rather than repeated.

4.11.1.1(Project-unique identifier of a test case).This paragraph shall identify a test case by project-unique identifier, state its purpose, and provide a brief description. The following subparagraphs shall provide a detailed description of the test case.

4.11.1.1.1Requirements addressed.This paragraph shall identify the CSCI or system requirements addressed by the test case. (Alternatively, this information may be provided in 5.a.)

4.11.1.1.2Prerequisite conditions.This paragraph shall identify any prerequisite conditions that must be established prior to performing the test case. The following considerations shall be discussed, as applicable:

4.11.1.1.2.1Hardware and software configuration

4.11.1.1.2.2Flags, initial breakpoints, pointers, control parameters, or initial data to be set/reset prior to test commencement

4.11.1.1.2.3Preset hardware conditions or electrical states necessary to run the test case

4.11.1.1.2.4Initial conditions to be used in making timing measurements

4.11.1.1.2.5Conditioning of the simulated environment

4.11.1.1.2.6Other special conditions peculiar to the test case

4.11.1.1.3Test inputs.This paragraph shall describe the test inputs necessary for the test case. The following shall be provided, as applicable:

4.11.1.1.3.1Name, purpose, and description (e.g., range of values, accuracy) of each test input

4.11.1.1.3.2Source of the test input and the method to be used for selecting the test input

4.11.1.1.3.3Whether the test input is real or simulated

4.11.1.1.3.4Time or event sequence of test input

4.11.1.1.3.5The manner in which the input data will be controlled to:

4.11.1.1.3.5.1Test the item(s) with a minimum/reasonable number of data types and values

4.11.1.1.3.5.2Exercise the item(s) with a range of valid data types and values that test for overload, saturation, and other "worst case" effects

4.11.1.1.3.5.3Exercise the item(s) with invalid data types and values to test for appropriate handling of irregular inputs

4.11.1.1.3.5.4Permit retesting, if necessary

4.11.1.1.4Expected test results.This paragraph shall identify all expected test results for the test case. Both intermediate and final test results shall be provided, as applicable.

4.11.1.1.5Criteria for evaluating results.This paragraph shall identify the criteria to be used for evaluating the intermediate and final results of the test case. For each test result, the following information shall be provided, as applicable:

4.11.1.1.5.1The range or accuracy over which an output can vary and still be acceptable

4.11.1.1.5.2Minimum number of combinations or alternatives of input and output conditions that constitute an acceptable test result

4.11.1.1.5.3Maximum/minimum allowable test duration, in terms of time or number of events

4.11.1.1.5.4Maximum number of interrupts, halts, or other system breaks that may occur

4.11.1.1.5.5Allowable severity of processing errors

4.11.1.1.5.6Conditions under which the result is inconclusive and re-testing is to be performed

4.11.1.1.5.7Conditions under which the outputs are to be interpreted as indicating irregularities in input test data, in the test database/data files, or in test procedures

4.11.1.1.5.8Allowable indications of the control, status, and results of the test and the readiness for the next text case (may be output of auxiliary test software)

4.11.1.1.5.9Additional criteria not mentioned above.

4.11.1.1.6Test procedure.This paragraph shall define the test procedure for the test case. The test procedure shall be defined as a series of individually numbered steps listed sequentially in the order in which the steps are to be performed. For convenience in document maintenance the test procedures may be included as an appendix and referenced in this paragraph. The appropriate level of detail in each test procedure depends on the type of software being tested. For some software, each keystroke may be a separate test procedure step; for most software, each step may include a logically related series of keystrokes or other actions. The appropriate level of detail is the level at which it is useful to specify expected results and compare them to actual results. The following shall be provided for each test procedure, as applicable:

4.11.1.1.6.1Test operator actions and equipment operation required for each step, including commands, as applicable, to:

4.11.1.1.6.1.1Initiate the test case and apply test inputs

4.11.1.1.6.1.2Inspect test conditions

4.11.1.1.6.1.3Perform interim evaluations of test results

4.11.1.1.6.1.4Record data

4.11.1.1.6.1.5Halt or interrupt the test case

4.11.1.1.6.1.6Request data dumps or other aids, if needed

4.11.1.1.6.1.7Modify the database/data files

4.11.1.1.6.1.8Repeat the test case if unsuccessful

4.11.1.1.6.1.9Apply alternate modes as required by the test case

4.11.1.1.6.1.10Terminate the test case

4.11.1.1.6.2Expected result and evaluation criteria for each step

4.11.1.1.6.3If the test case addresses multiple requirements, identification of which test procedure step(s) address which requirements. (Alternatively, this information may be provided in 5.)

4.11.1.1.6.4Actions to follow in the event of a program stop or indicated error, such as:

4.11.1.1.6.4.1Recording of critical data from indicators for reference purposes

4.11.1.1.6.4.2Halting or pausing time-sensitive test-support software and test apparatus

4.11.1.1.6.4.3Collection of system and operator records of test results

4.11.1.1.6.5Procedures to be used to reduce and analyze test results to accomplish the following, as applicable:

4.11.1.1.6.5.1Detect whether an output has been produced

4.11.1.1.6.5.2Identify media and location of data produced by the test case

4.11.1.1.6.5.3Evaluate output as a basis for continuation of test sequence

4.11.1.1.6.5.4Evaluate test output against required output

4.11.1.1.7Assumption and constraints.This paragraph shall identify any assumptions made and constraints or limitations imposed in the description of the test case due to system or test conditions, such as limitations on timing, interfaces, equipment, personnel, and database/data files. If waivers or exceptions to specified limits and parameters are approved, they shall be identified and this paragraph shall address their effects and impacts upon the test case.

4.12Requirements traceability.This paragraph shall contain:

4.12.1Traceability from each test case in this STD to the system or CSCI requirements it addresses. If a test case addresses multiple requirements, traceability from each set of test procedure steps to the requirement(s) addressed. (Alternatively, this traceability may be provided in 4.x.y.1.)

4.12.2Traceability from each system or CSCI requirement covered by this STD to the test case(s) that address it. For CSCI testing, traceability from each CSCI requirement in the CSCI's Software Requirements Specification (SRS) and associated Interface Requirements Specifications (IRSs). For system testing, traceability from each system requirement in the system's System/Subsystem Specification (SSS) and associated IRSs. If a test case addresses multiple requirements, the traceability shall indicate the particular test procedure steps that address each requirement.

4.13Notes.This section shall contain any general information that aids in understanding this document (e.g., background information, glossary, rationale). This section shall include an alphabetical listing of all acronyms, abbreviations, and their meanings as used in this document and a list of any terms and definitions needed to understand this document.

4.14Appendices.Appendices may be used to provide information published separately for convenience in document maintenance (e.g., charts classified data). As applicable, each appendix shall be referenced in the main body of the document where the data would normally have been provided. Appendixes may be bound as separate documents for ease in handling. Appendixes shall be lettered alphabetically (A, B, etc.).

References

—

Schema v3.0Community-maintained · Verify against ASSIST

Community-maintained — not an official government database.
Verify against ASSIST·GitHub·About·Disclaimer