The Project Test Plan Document

The project test plan is a document that outlines for project stakeholders the product functions to be tested, what specific tests will be performed, the approach to be take for those tests, what to test and what not to test, how the tests will be performed, who will be responsible for performing each test, what results are expected, what is considered a successful test and a failed test, and exit criteria for any series of tests as well as for the testing phase as a whole. A well defined test plan must also describe, in explicit detail, the method, goals, approaches, etc to be used for each test. three basic phases that include:

Test Preparation: Preparing for Tests

Preparation for testing is a vital part of the test planning process. This stage outlines the tests to be performed, and if necessary, creates the environment in which to perform those tests. Some of the documents necessary to effectively prepare for testing include:
The Test Plan - describes what testing will be done, to what quality standard, with what resource, within what timeframe, and outlines any risks/issues and how they will be addressed. A well defined test plan should also outline items such as:
- Items to test and not to test such as test product features, interfaces, reporting tools
- Risks, issues, mitigation strategies, and contingencies plans
- Testing approach defining methods and tools to be used for testing
- Item pass/fail criteria specifying what constitutes a successful test
- Entry and exit criteria specifying what constitutes a completed test
- Test deliverables such as a test plan, test cases, test tools
- Environmental needs outlining any requirements for where testing will take place
- Staffing and training needs
- Acceptance criteria
Test Design Specification - describes what needs to be tested. This document evolves from requirements and design specification documents. This document also outlines items such as what features to test, the approach to be taken, what the expected test results are, and what constitutes a successful and failed test.
Test Case Specification - produced after the test design is completed these documents are unique to the item being tested. These documents outline the actual tests, procedures, reporting requirements, the individuals involved in the testing process, etc that will be used validate each of the project's different functional requirements as specified in the requirements and design definition documents.

Test Execution: Performing Tests

The schedule of what test cases will be executed when is outlined within the project's test plan which will be executed by the project's testing team. Depending on what is being tested at which point within the project's life cycle informal testing may be performed by developers, quality assurance, users, etc. However, final testing will be formally performed by individuals identified within the test plan. One essential prerequisite to testing is to at least have a completed software module to test, preferably a fully functional version of the software to be tested. Once ready, methods of testing may include:
- Compatibility Testing - tests the system, or a component of it, against existing systems, hardware, software, etc to ensure compatibility.
- Conformance Testing - verifies the systems conformance to industry/organizational standards, Federal/organizational mandates and regulations, etc.
- Functional Testing - verifies that the system indeed conforms to documented functional specifications and ensures that the product delivered indeed satisfies the requirements as agreed upon by the client.
- Load Testing - executes performance tests and stress tests to ensure that the system can handle all expected, and exceptional, levels of demands upon the system.
- Performance Testing - executed to better understand the scalability of the system, to benchmark performance, identify performance bottlenecks, etc.
- Regression Testing - retests previously tested system components to ensure that any reported defects have been corrected and that no new quality issues have been introduced.
- Stress Testing - tests that evaluate the system, or component of it, at or beyond the limits of its specified requirements to determine the load under which it fails and how.
- System Testing - tests the entire system from end-to-end.
- Unit Testing - tests individual components or modules of the system for the purpose of finding defects.
- User Acceptance Testing - tests executed by the user to ensure that the product delivered indeed satisfies the requirements as agreed upon by the client.
- Vulnerability Assessment Testing - tests that identify, quantify, and prioritize system vulnerabilities
- Test Log/Reporting - As each test is performed it is important to document the details and results of those tests. A test log is commonly used to accomplish this. The log records information regarding what test cases have been run and the results of those tests. This log includes items such as a description of the test, the assignment of each test to one or more individuals, a target date by which the test needs to be completed, and other related information. If a test has failed, a test incident report should be filed to record the issue for future resolution.

Evaluation: Validating/Evaluating Testing

This simply involves evaluating the test results to verify that the product tests performed in accordance with defined requirements as agreed upon by the client. The confirmed results are then recorded using a test summary document. A test summary document records all pertinent information about the testing of the product. It would document items such as:
- An assessment of actual testing vs planned testing
- A critical assessment about the quality of the system
- The number of incidents raised and any remaining outstanding issues