Specialist/Testing Task Force T013:
TDL and TOP Enhancements for RESTful API Services Testing
Who we are:
Team leader:
|
|
Team Members:
|
|
What we do
STFs 454, 476, 492, and 522 created the foundation for the Test
Description Language (TDL) in terms of well-defined modelling
concepts, a standardized graphical syntax and exchange format, as well
as support for structured test objective specifications. Further
efforts to boost the TDL adoption and application resulted in a TDL
open-source project (TOP) including implementations of essential tools
that can help users and tool vendors to get started with TDL. The
standardised mapping of TDL to TTCN-3 offers a consistent way to
bridge high level test descriptions and executable test cases and can
serve as a reference for mappings to other targets for executable
tests.
STF577 continued the work on TDL, concentrating on resolving the
submitted change requests to the TDL standard series and the TOP
tools, as well as ensuring that all parts remain consistent and that
the language features implemented in the TOP are consistent with the
specifications.
TTF T013 builds on the previous activities related to TDL, focusing on
new features and improvements for TDL and TOP to better support the
methodologies for the specification and testing of RESTful API
services outlined in EG 203 647, in particular regarding the support
of data type definitions in OpenAPI and the realisation of test
execution engine for supporting RESTful API testing. Additionally, a
standardised textual syntax for test descriptions and test purposes
has been one of the most requested additions to TDL, in order to
increase the confidence in adopting it.
For more details, see our Terms
of Reference
Why we do it
TDL bridges the gap between declarative test purpose specifications
(what shall be tested?) and imperative test case specifications (how
shall it be tested?) by offering a standardised language for the
specification of test descriptions.
Test descriptions in a standardised language ease the development of
executable tests and make test specifications easier to review by
non-testing experts. This can improve the general productivity and
quality of test development in industry as well as in the
standardisation process by relieving test engineers from working on
details of test implementations. An extension to TDL addresses
structured test objective specification to bring test purpose
specifications into the modelling world and streamline the test
specification process even further, especially in the standardisation
processes at ETSI.
The TOP project aims to accelerate the adoption of TDL by lowering
the barrier to entry for both users and tool vendors in getting
started with using TDL. It comprises graphical and textual editors, as
well as validation facilities and other supporting tools.
The work on the definition of a methodology for specification and
testing of RESTful APIs within STF 576 culminating in EG 203 647
identified potential new features and improvements for TDL and TOP to
better support the outlined methodologies.
While there is a standardised way of deriving test cases in TTCN-3
from test descriptions in TDL defined in Part 6 of the TDL standards,
there are different ways of deriving test descriptions from test
purposes. A guideline with a well-defined way to derive test
descriptions from structured test objectives to support a (semi-)
automatic workflow would benefit users and streamline test
specification processes by setting clear expectations for the
resulting test descriptions.
How we do it
The activities of the TTF are coordinated on a regular basis with a
dedicated working group assembled by TC MTS to ensure that the work of
the TTF is aligned with expectations and requirements from the different
stakeholders. The working group is also supporting the work of the TTF
by providing technical guidance on key technical issues.
The TTF interacts with different stakeholders by showcasing the ongoing
work on TDL and its implementation, as well as different application
scenarios in a summary or hands-on manner, depending on the specific
audience. Further dissemination activities from the TTF members include
raising awareness and promoting TDL on their respective websites and at
dedicated events such as ETSI’s User Conference on Advanced Automated
Testing (UCAAT). A dedicated project has been created on the online
issue reporting portal for ETSI (“ETSI’s Bug Tracker”) where change
requests for TDL can be submitted and managed in an open and transparent
manner.
Deliverables
The deliverables for the STF comprise updates to the individual parts*
of ES 203 119, as well as TR 103 119, encompassing:
ES 203 119-1 V1.6.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Part 1:
Abstract Syntax and Associated Semantics
ES 203 119-2 V1.5.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Part 2:
Graphical Syntax
ES 203 119-3 V1.5.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Part 3:
Exchange Format
ES 203 119-4 V1.5.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Part 4:
Structured Test Objective Specification (Extension)
ES 203 119-6 V1.3.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Part 6:
Mapping to TTCN-3
ES 203 119-7 V1.3.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Part 7:
Extended Test Configurations
ES 203 119-8 V1.1.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Part 8:
Textual Syntax
TR 103 119 V1.3.1 Methods for Testing and
Specification (MTS); The Test Description Language (TDL); Reference
Implementation and User Guidelines
* Work items of the TDL standard series which are not affected by CRs
will not be updated.
Time plan
The work of the TTF is organised around three intermediate
milestones, due for approval in May 2021, September 2021, and January
2022, respectively. The final drafts of the deliverables are expected
to be published in May 2021.
Get in contact with the TTF at ttft013@groups.etsi.org.
Learn more about TDL and how to contribute at
https://tdl.etsi.org.
Join the discussions on the TDL mailing list at
TDL@LIST.ETSI.ORG.