To create an STM test suite
Before you begin
As required, review the STM test suite design considerations information in this chapter before starting this procedure.
Before performing this procedure, you must configure the STM test policy and test definitions to be included in the STM test suite.
Steps
1 |
Choose Tools→Service Test Manager (STM) from the NFM-P main menu. The Service Test Manager (STM) form opens. |
2 |
Click Create and choose Test Suite. The Test Suite (Create) form opens. |
3 |
Configure the required parameters. The MEF35 and NE Schedulable parameters are mutually exclusive. The MEF35 parameter must be selected if the test suite will contain a test policy that uses PM Session Test Definitions. The NE Schedulable, Validation Test Suite, and Timeout parameters are configurable when the MEF35 Mode parameter is not selected. You must select the NE Schedulable parameter if the test suite you are creating will use an NE-schedulable test policy. The Validation Test Suite parameter is configurable when the Entity Type parameter is set to a type that supports validation, for example a VLL service. The First-run Execution Sequence and Last-run Execution Sequence parameters are configurable when the MEF35 Mode parameter is not selected. The Accounting Files parameter is configurable when the NE Schedulable parameter is selected. The Continuously Executed and Test Result Storage parameters are configurable when the Accounting Files parameter is selected. |
4 |
If you chose None as the option for the Entity Type parameter in Step 3, go to Step 8. Otherwise go to Step 5. |
5 |
Add a test policy to the test suite.
|
6 |
Define the network entities for the test suite.
|
7 |
If you selected the MEF35 Mode parameter in Step 3, go to Step 12. |
8 |
Define first-run tests.
|
9 |
Define last-run tests.
|
10 |
Click Apply to save the changes. Additional buttons become available at the bottom of the form. |
11 |
If you chose None as the option for the Entity Type parameter in Step 3, go to Step 16. Otherwise, go to Step 12. |
12 |
Click on the Generated Tests tab or the Generated PM Sessions Tests tab, as applicable. |
13 |
Click Generate Tests. The Generate Tests button is available only when you have a policy and at least one entity associated with the STM test suite. The NFM-P begins generating tests for the test suite based on the test policy. The tests appear in a list on the Generated Tests form as they are generated. The name of the originating tested entity for each test is also displayed on the list, for quick reference. Note: When the test policy or the configuration of an entity on the Tested Entities tab changes, you must regenerate the tests in the test suite by clicking Generate Tests. Note: When tests have been generated in a test suite which has a test policy already associated with it, these tests will not be altered (deleted and recreated, or set to default tests), when Generate Tests is clicked again. Note: Any of the tests generated by a test suite can be deleted directly from the list on the Generated Tests tab. Select the tests that you want to delete and click Delete. Note: For a test suite containing a P2MP LSP Ping Test Policy, the test suite generator will generate one test per S2L path (for P2MP LSP) or one test per leaf node address (for P2MP LDP). |
14 |
Click on the Generation Error Logs tab to view the log files that the NFM-P creates before and during test generation. The Stage drop-down allows you to select the type of logs to examine, including pre-generation and deployment information. Note: Generation Error Logs messages appear only when failures occur during the test generation process. |
15 |
Click on the Generated Artifacts tab to view a list of all objects created at the time of Test Suite creation or while generating the contained tests. Objects include: MDs, MAs, Global MEGs, MEPs, Bin Groups, tests (including SAA and PM Session), and accounting policies. The Stage drop-down allows you to select the type of information to examine. Note: The Generated Artifacts tab will not show objects that already existed prior to generating the tests and are just being reused by those tests. Only newly-created objects are displayed. Note: If objects are manually deleted, they will also be removed from the Generated Artifacts list. For example, if a MEP is deleted, the MEP object and the tests originating from the MEP will all be deleted from the list. If a GMEG is deleted, then all MAs, MEPs, and tests associated with the GMEG will also be deleted from the list. |
16 |
Close the forms. See To execute an STM test suite for information about executing a test suite. End of steps |