STFbreadcrumb separatorSTFsbreadcrumb separatorSTF HomePagesbreadcrumb separatorSTF433

Specialist Task Force 433:
Extension of Conformance tests for TTCN-3 tools

Who we are:

Team Leader: Stanca-Kaposta, Bogdan, Testing Technologies IST GmbH, stanca@testingtech.com
Team Members: Kovacs, Andras, Broadbit Slovakia, andras.kovacs@broadbit.com
Nikolay Pakulin, ISPRAS, npak@ispras.ru

What we do:

The purpose of this work is to continue the implementation of a TTCN-3 tool conformance test specification for TTCN-3 tools, started by STF 409, i.e., we specify ICS, test purposes and TTCN-3 tests for those aspects of the TTCN-3 core language standard, which are considered to be the most critical by the TTCN-3 community.

For more details, see our Terms of Reference

Why we do it:

Over the last 10 years TTCN-3 has become a significantly important testing technology with very high deployment at various ETSI member companies as well as other organizations internationally. With its uptake by 3GPP, OMA and the AUTOSAR (a consortium of car makers and OEM suppliers), its role in standardization is further growing. 3GPP is using TTCN-3 as the test specification language e.g. for IMS call control testing from Rel. 8 onward and. TC TISPAN is using TTCN-3 for NGN supplementary service and interworking test specification. TC INT is using TTCN-3 for automating IMS core network interoperability testing. TC ITS is using TTCN-3 to specify all its test suites under the EC mandate M/453. Since 2004 ETSI organizes an annual, international user conference where it collects feedback from the wide TTCN-3 user community. The first ETSI TTCN-3 tools Plugtest has been organized in 2009.

Significant number of TTCN-3 compilers are available on the market (at least 7 commercial tools and 2 internal tools of industrial ETSI members) that also indicate the high interest and use of the language. The TTCN-3 standards which provide the foundation for this testing technology, are however quite complex and encompass multiple hundreds of pages. Part 1 of the TTCN-3 series, the TTCN-3 core language, alone is estimated to contain on the order of 5,000 requirements. Over the past 10 years the TTCN-3 community has repeatedly requested by for some kind of assurance that tools conform to TTCN-3 standards. A standardized testing language such as TTCN-3 should lead by example, i.e., tools that check conformance of systems to standards should also be tested for their compliance to standard.

Based on these requests, TC MTS developed a first conformance test suite in STF 409 which lead to the discovery of 19 issues or ambiguities in the TTCN-3 standard 4.2.1 when covering about 1/3 of the clauses in the main standard with some tests. TTCN-3 is however a living language and has moved on to a new version. The STF requested in these terms of reference is intended to update and extend earlier work on TTCN-3 conformance test suite to ensure that ETSI TTCN-3 test suites will also in the future compile on multiple TTCN-3 tools. 

Deliverables:

The STF will produce the following deliverables (revision according to CR Process), final drafts will be approved by correspondence during 1Q2012):

RTS/MTS-00132-1ed121 TTCN-3 Conformance Test Suite ;  Part 1 : Implementation Conformance Statement

RTS/MTS-00132-2ed121 TTCN-3 Conformance Test Suite ;  Part 2: Test Suite Structure & Test Purposes

RTS/MTS-00132-3ed121 TTCN-3 Conformance Test Suite ;  Part 3: Abstract Test Suite & IXIT

Time plan:

The STF will produce the deliverables according to the following time scale:

  • TB adoption of WI May 2011
  • Early Draft Nov 2011
  • Stable Draft Dec 2011
  • Draft for approval 24-25 Jan 2012 (MTS#55)
  • TB approval (AbC) Feb 2012
  • Publication April 2012

How to contact us:

On general inquiries, please contact the team leader Bogdan Stanca-Kaposta by e-mail (stanca@testingtech.com). Otherwise, please use the e-mail addresses stated above in the “What we do” section.

 

This information is based upon STF working assumptions.
The views expressed do not necessarily represent the position of ETSI in this context.

Last updated: 2011-11-07 16:44:35