Testing Task Force T015:
NFV API Conformance test specification maintenance and development
Who we are:
What we do
The TTF T015 specifies a conformance test plan for NFV APIs implemented
according to the standards of ETSI ISG NFV SOL Working Group.
As part of the test plan, the TTF updates the existing NFV APIs test
descriptions in Robot Framework language where necessary, and add new
test descriptions when new requirements are introduced in the base
specifications.
The TTF also produces documentation of the test descriptions which are
embedded into the Robot Framework code, and are imported into the TST010
related document where they will either update existing test
descriptions, or add new ones as a result of new functionality.
For more details, see our Terms
of Reference
Why we do it
NFV products and operational deployments. ETSI ISG NFV is continuously
updating the specifications of a set of critically important APIs as
part of the stage 3 work defining the NFV architecture. In an effort to
support the industry with this endeavour, and to allow companies to
accurately measure their progress towards support of the ISG NFV
standards, the ISG has constructed a comprehensive API conformance test
suite (via NFV work item TST010). The test suite allows
designers and consumers alike to accurately demonstrate their compliance
to the APIs as defined by the ISG. It is vital that the industry has
such a standard test suite that is agreed by the NFV community, and
subsequently referred to by the industry at large in order to validate
their designs in commercial situations.
The test suite is unique in the sense that it is an immediately usable
work item because it also incorporates executable test scripts written
in Robot Framework language in addition to the TST010 document. However,
since the start of the TST010 test plan work item, the NFV-SOL
specifications have not been static. New versions have been developed or
are under development (namely 2.8.1, 3.5.1, 3.6.1 and first version of
Release 4), with bug fixes and enhancements. Likewise, the test suite,
and associated test code, cannot stay static. In order keep them
relevant, they must also be enhanced in order to reflect the current
status of the NFV SOL documents.
How we do it
The TTF activities will be split in four main development cycles, each
one referring to a version of ETSI NFV SOL specifications for which the
NFV API conformance test suite is updated or developed, namely v2.8.1,
v3.5.1, v3.6.1 and first version of Release 4. Each of these development
cycles will be in turn executed in three different phases.
First, the existing NFV API conformance test suite is analysed against
testing requirements identified in the ETSI SOL specifications to
identify potential gaps in the existing TST010 test suite and to
document the testing requirements. After that, the TTF takes care to
update (or develop from scratch in case of the new API resources or
endpoints) the existing TST010 Robot Framework code to the new version.
Finally, the updated Robot Framework code is properly documented
following the format agreed with the TST Working Group, to enable
automated generation of test descriptions to be integrated within the
TST010 document in the related version. The documentation includes the
definition of test objectives, test purposes, pre-conditions and
post-conditions, among the others.
Deliverables
The NFV API conformance test plan produced by the TTF will be
contributed to:
• DGS/NFV-TST010ed281
• DGS/NFV-TST010ed351
• DGS/NFV-TST010ed361
• DGS/NFV-TST010ed4xx
Time plan
TTF T015 plans to deliver:
• DGS/NFV-TST010ed281 NFV API conformance test plan
work item ISG approved by August 2021
• DGS/NFV-TST010ed351 NFV API conformance test plan
work item ISG approved by December 2021
• DGS/NFV-TST010ed361 NFV API conformance test plan
work item ISG approved by March 2022
• DGS/NFV-TST010ed4xx NFV API conformance test plan
work item ISG approved by June 2022
Should you want to get in contact with the TTF T015 team for more
insights and updates on the ongoing activities and results, feel free
to write an email to the TTF Leader.