To modify an STM test suite and view additional information

Steps
 

You can modify an STM test suite using two methods. Perform one of the following:

  1. Modify the test suite using the STM. Go to Step 2.

  2. Add an entity to the test suite from the entity to be tested. Go to Step 9.


Choose Tools→Service Test Manager (STM) from the NFM-P main menu. The Service Test Manager (STM) form opens.


Choose Test Suite (Assurance) from the object drop-down menu and click Search. A list of test suites appears.


Choose a test suite and click Properties. The Test Suite (Edit) form opens.


Configure the required parameters on the General tab.

Some parameters are configurable only during test suite creation, and cannot be modified for existing test suites.


Modify the components of the test suite.

The following tabs list components of a test suite. Add, remove, or modify components as required.

  • Test Policy tab — displays the test policy that is associated with the test suite

  • Tested Entities tab — lists the entities that are the subjects of the tests in the test suite

  • First-run Tests tab — lists the group of tests in the test suite that run first

  • Generated Tests tab — lists the generated tests that are included in the test suite

  • Last-run Tests tab — lists the group of tests in the test suite that run last

To configure a test suite component list item, select the item and click Properties.


View additional information.

The following tabs display information about the creation and execution of the test suite:

  • Results tab — lists the per-run results that are returned by each execution of the test suite

  • Individual Test Results tab — lists all individual test results. This is similar to what is displayed when a Tested Entity is chosen and you click on Show Results.

  • Generation Error Logs tab — lists the log entries that are created before and during test generation for the test suite. The Stage drop-down menu allows you to select the type of logs to examine, including pre-generation and deployment information.

  • Generated Artifacts tab - Lists all objects created at the time of Test Suite creation or while generating the contained tests. Objects include: MDs, MAs, Global MEGs, MEPs, Bin Groups, tests (including SAA and PM Session), and accounting policies. The Stage drop-down menu allows you to select the type of information to examine.

  • Faults tab — displays the faults associated with the test suite

Note: Generation Error Logs messages only appear if any failures occur during the test generation process.

Note: The Generated Artifacts tab will not show objects that already existed prior to generating the tests and are just being reused by those tests. Only newly-created objects are displayed.

Note: If objects are manually deleted, they will also be removed from the Generated Artifacts list. For example, if a MEP is deleted, the MEP object and the tests originating from the MEP will all be deleted from the list. If a GMEG is deleted, then all MAs, MEPs, and tests associated with the GMEG will also be deleted from the list.

Note: You can use the Quick Filter on the test result tab pages to narrow down and limit the displayed results.


Save your changes and close the forms.


Open the Properties form of a supported entity that you want to add to a test suite; for example, a VLL or VPRN service or VPLS.


10 

Click on the Tests tab. The Test Suite tab is displayed.


11 

Click Add. The Add form appears.


12 

Click Search to display a list of test suites. Only test suites applicable to this type of entity will be displayed.


13 

Choose a test suite and click OK. The Add form closes and the selected test suite appears in the Test Suite tab.

The entity has now been added to this test suite. You can confirm this by clicking Properties to display the Test Suite (Edit) form. The added entity will appear on the list in the Tested Entities tab. You can also modify any other parameters of the test suite here, as detailed in Step 2 to Step 6 above.

Note: Once you have added the entity, you can also run the test suite from the Test Suite sub-tab by clicking Execute. See To execute an STM test suite for information about executing a test suite.

End of steps