STFbreadcrumb separatorSTFsbreadcrumb separatorSTF HomePagesbreadcrumb separatorT015
STF_WebPage_Template

Testing Task Force T015:
NFV API Conformance test specification maintenance and development

Who we are:

 

TTF Leader:
TTF Experts:

What we do

The TTF T015 specifies a conformance test plan for NFV APIs implemented according to the standards of ETSI ISG NFV SOL Working Group.

As part of the test plan, the TTF updates the existing NFV APIs test descriptions in Robot Framework language where necessary, and add new test descriptions when new requirements are introduced in the base specifications.

The TTF also produces documentation of the test descriptions which are embedded into the Robot Framework code, and are imported into the TST010 related document where they will either update existing test descriptions, or add new ones as a result of new functionality.

For more details, see our Terms of Reference

Why we do it

NFV products and operational deployments. ETSI ISG NFV is continuously updating the specifications of a set of critically important APIs as part of the stage 3 work defining the NFV architecture. In an effort to support the industry with this endeavour, and to allow companies to accurately measure their progress towards support of the ISG NFV standards, the ISG has constructed a comprehensive API conformance test suite (via NFV work item TST010). The test suite allows designers and consumers alike to accurately demonstrate their compliance to the APIs as defined by the ISG. It is vital that the industry has such a standard test suite that is agreed by the NFV community, and subsequently referred to by the industry at large in order to validate their designs in commercial situations.

The test suite is unique in the sense that it is an immediately usable work item because it also incorporates executable test scripts written in Robot Framework language in addition to the TST010 document. However, since the start of the TST010 test plan work item, the NFV-SOL specifications have not been static. New versions have been developed or are under development (namely 2.8.1, 3.5.1, 3.6.1 and first version of Release 4), with bug fixes and enhancements. Likewise, the test suite, and associated test code, cannot stay static. In order keep them relevant, they must also be enhanced in order to reflect the current status of the NFV SOL documents.

How we do it

The TTF activities will be split in four main development cycles, each one referring to a version of ETSI NFV SOL specifications for which the NFV API conformance test suite is updated or developed, namely v2.8.1, v3.5.1, v3.6.1 and first version of Release 4. Each of these development cycles will be in turn executed in three different phases.

First, the existing NFV API conformance test suite is analysed against testing requirements identified in the ETSI SOL specifications to identify potential gaps in the existing TST010 test suite and to document the testing requirements. After that, the TTF takes care to update (or develop from scratch in case of the new API resources or endpoints) the existing TST010 Robot Framework code to the new version. Finally, the updated Robot Framework code is properly documented following the format agreed with the TST Working Group, to enable automated generation of test descriptions to be integrated within the TST010 document in the related version. The documentation includes the definition of test objectives, test purposes, pre-conditions and post-conditions, among the others.

Deliverables

The NFV API conformance test plan produced by the TTF will be contributed to:

•    DGS/NFV-TST010ed281
•    DGS/NFV-TST010ed351
•    DGS/NFV-TST010ed361
•    DGS/NFV-TST010ed4xx

Time plan

TTF T015 plans to deliver:

•    DGS/NFV-TST010ed281 NFV API conformance test plan work item ISG approved by August 2021
•    DGS/NFV-TST010ed351 NFV API conformance test plan work item ISG approved by December 2021
•    DGS/NFV-TST010ed361 NFV API conformance test plan work item ISG approved by March 2022
•    DGS/NFV-TST010ed4xx NFV API conformance test plan work item ISG approved by June 2022
 

How to contact us

Should you want to get in contact with the TTF T015 team for more insights and updates on the ongoing activities and results, feel free to write an email to the TTF Leader.

This information is based upon STF working assumptions.

The views expressed do not necessarily represent the position of ETSI in this context.