STFbreadcrumb separatorSTFsbreadcrumb separatorSTF Homepagesbreadcrumb separatorT004

Specialist/Testing Task Force T004 (ISG CIM):
Testing framework for NGSI-LD

Who we are:

 

Team leader:
Team Members:

What we do

The ISG CIM group has defined an API for exchange of information contextualised in time, space and relation to other information using a property graph model with the intent that the associated protocol (called NGSI-LD) becomes the “glue” between all kinds of applications and databases associated with services for Smart Cities, Smart Agriculture, Smart Manufacturing, etc.

The main objective of this task force is to produce a conformance test suite for this NGSI-LD API specification and a testing environment to execute and validate the test cases.

For more details, see our Terms of Reference

Why we do it

To be successful, the NGSI-LD API specification needs to be well understood and well implemented. The community of users will not be solely highly professional engineers employed by big companies but will include many small teams and SMEs and even hobbyists. Therefore, it is essential that the developers have access to not only the standard but also a test specification and a testing environment to check that their work is (and remains) conformant to the ETSI NGSI-LD specification.

The developers will usually write integration tests to validate the behaviour of their NGSI-LD implementation, but it is important to assert compliance to the specification based on a test suite agreed by the group creating the API specification, i.e. ETSI ISG CIM. Therefore, it is very important to create a set of ETSI-approved test cases.

What’s more, the existence of such a test suite will likely help to increase the adoption of the NGSI-LD specification by giving developers a ready to use and complete set of sample requests.

Finally, it can be envisioned that this conformance test suite be a building block for a quality assessment framework.

How we do it

The Testing Task Force is composed of 4 companies: Ubiwhere, OASC, Sensinov and Easy Global Market (EGM), its leadership is assumed by EGM.

The ISG CIM is the steering committee monitoring the work.

Consultation will be made, during this task, with relevant experts from the groups listed below, with the intent to identify the advantages/disadvantages of various candidate Test Purposes Description Languages (TPDL):

-    ETSI Staff, especially from CTI
-    ETSI TTF for RESTful APIs
-    SmartM2M STF for Semantic Discovery work (where relevant)

Consultation with developer communities and W3C Groups (e.g. JSON-LD), if needed, will be made by ISG CIM via release of interim public documents, in consultation with the Testing Task Force and on the ISG CIM open area.

 

Deliverables

The Testing Task Force will produce 5 deliverables.

Deliverable 1 is composed of two documents: NGSI-LD Testing Framework Test Template, which consists in creating a Test Template applying ETSI best practices, and NGSI-LD Testing Framework Test Purposes Description Language, whose objective is to give the necessary elements to drive to the choice of a Test Purposes Description Language (TPDL).

Deliverable 2 is the NGSI-LD Test Suite Structure; it defines the organization or grouping of test cases based on the functionality to be tested and - more importantly - selects minimal subsets (“narrower scope”) of functionality to permit testing of the main features of an operating NGSI-LD system.

Deliverable 3 is the NGSI-LD Test Purposes Descriptions; it uses the agreed Test Template and TPDL and contains, in human readable format, the description of each Abstract Test Cases, so that for each Test Case, the conditions are clear. This deliverable achieves and documents a description of exactly what has to be tested and how.

Deliverable 4 is the NGSI-LD Test Suite; it uses the decisions of the previous deliverables and documents the implementation of the Test Purposes Descriptions into Executable Test Cases which are in a form which can be run in the Test Execution Environment.

Deliverable 5 is the NGSI-LD Testing Environment Validation; it requires running the Executable Test Cases in the chosen Test Execution Environment using one or more of the open-source NGSI-LD systems, with the goal to check that the complete test environment runs successfully and to allow ETSI to learn from the use of the chosen test description language and operating environment.

Time plan

Code

Task / Milestone

Target Date

From

To



T0

Planning, reporting and Coordination with ISG CIM

 

May 2020

Jan 2021

T1

NGSI-LD Testing Framework

May 2020

Jul 2020

T2

NGSI-LD Test Suite Structure

May 2020

Jul 2020

Milestone A

Progress Report approved by ISG CIM

D1-1, D1-2 and D2 Drafts V1.0.1 accepted by ISG CIM

 

Jul 2020

T3

NGSI-LD Test Purposes Descriptions

Aug 2020

Nov 2020

T4

NGSI-LD Test Suite

Oct 2020

Dec 2020

Milestone B

Progress Report approved by ISG CIM

D3 and D4 Draft V1.0.1 accepted by ISG CIM

 

Dec 2020

T5

NGSI-LD Testing Environment Validation

Oct 2020

Dec 2020

Milestone C

Final Report and D1, D2, D3, D4 and D5 Final Drafts approved by ISG CIM

 

Jan 2021

Milestone D

D1-1, D1-2, D2, D3, D4 and D5 published and TTF closed

 

Mar 2021

 

How to contact us

To contact us, please send an email to benoit.orihuela@eglobalmark.com

This information is based upon STF/TTF working assumptions.
The views expressed do not necessarily represent the position of ETSI in the context.