Protocol conformance and performance testing are two branches of testing designed to determine compliance and performance of protocol implementations to their standard.
Dr. CHE Xiaoping and Dr. MAAG Stephane from Laboratory UMR 5157 of French Centre national de la recherché scientifique (CNRS) focus on converging these two kinds of testing in a same formal approach. After several years of innovative research, they eventually created a formal approach to formally specify conformance and performance requirements.
They successfully applied their approach on Extensible Messaging and Presence Protocol (XMPP) and designed a distributed testing framework for XMPP services. Their work, entitled "Testing protocols in Internet of Things by a formal passive technique", is published in SCIENCE CHINA Information Sciences.2014, Vol 57(3).
Extensible Messaging and Presence Protocol (XMPP) has gained more attention as a communication protocol in Internet of Things (IoT), which is a standardized protocol by Internet Engineering Task Force (IETF) and well established in the Internet.
XMPP is available for commonly used programming languages and device platforms. Several studies have investigated the potentialities of applying XMPP in IoT. With the tendency that XMPP is more and more widely used in many aspects of IoT, the problem of formally testing this protocol in a wireless environment is coming out in the wash.
Some works have tried to test the XMPP protocol under different conditions. However, they either simply evaluate the protocol performance or only test several conformance issues. It is worthwhile to note that conformance and performance testing are often associated within the protocol testing process. They are mainly applied to validate or verify the scalability and reliability of the system.
Many benefits can be brought to the testing process if both inherit from the same approach. Besides, very few works have tried to formalize the performance requirements which are mandatory for accurately testing the performance of protocols.
The main objective of this work is then to propose a passive distributed testing approach, for testing both the conformance and the performance of XMPP under IoT environment, based on the formal testing technique. Although some crucial works have been done in similar testing area, they studied runtime verification of properties expressed either in linear-time temporal logic or in timed linear-time temporal logic.
Different from their works focusing on testing functional properties based on formal models, this work concentrates on formally testing functional and nonfunctional properties without formal models. Also note that, this work is absorbed in the performance testing, not in performance evaluation. While performance evaluation of network protocols focuses on the evaluation of its performance, performance testing approaches aim at testing performance requirements that are expected in the protocol standard.
In this work, formalism is defined to specify conformance and performance requirements of XMPP represented as formulas tested on real protocol traces. Horn clauses based syntax is used in the approach to express properties that are checked on extracted traces. And then, since several protocol requirements need to be tested on different wireless entities, a distributed framework is designed for testing the approach on runtime wireless network execution traces.
The approach has been implemented into a distributed framework which provides the possibility to test individual nodes of a complex network environment. The results from testing several properties on large traces have been obtained with success. The subtesters and global monitor in the approach can intuitively reflect the current conformance and performance requirements conditions.
Some researchers suggested that the authors can work on building a standardized performance testing benchmark system for XMPP protocol in future. In that case, the efficiency and processing capacity of the system when massive subtesters are performed through complex network situations would be the crucial point they need to handle.
See the article:
Xiaoping CHE, Stephane MAAG. Testing protocols in Internet of Things by a formal passive technique. SCIENCE CHINA Information Sciences, 2014, 57(3): 032101(13)
Science China Press Co., Ltd. (SCP) is a scientific journal publishing company of the Chinese Academy of Sciences (CAS). For 60 years, SCP takes its mission to present to the world the best achievements by Chinese scientists on various fields of natural sciences researches.
CHE Xiaoping | Eurek Alert!
A novel hybrid UAV that may change the way people operate drones
28.03.2017 | Science China Press
Timing a space laser with a NASA-style stopwatch
28.03.2017 | NASA/Goddard Space Flight Center
The Institute of Semiconductor Technology and the Institute of Physical and Theoretical Chemistry, both members of the Laboratory for Emerging Nanometrology (LENA), at Technische Universität Braunschweig are partners in a new European research project entitled ChipScope, which aims to develop a completely new and extremely small optical microscope capable of observing the interior of living cells in real time. A consortium of 7 partners from 5 countries will tackle this issue with very ambitious objectives during a four-year research program.
To demonstrate the usefulness of this new scientific tool, at the end of the project the developed chip-sized microscope will be used to observe in real-time...
Astronomers from Bonn and Tautenburg in Thuringia (Germany) used the 100-m radio telescope at Effelsberg to observe several galaxy clusters. At the edges of these large accumulations of dark matter, stellar systems (galaxies), hot gas, and charged particles, they found magnetic fields that are exceptionally ordered over distances of many million light years. This makes them the most extended magnetic fields in the universe known so far.
The results will be published on March 22 in the journal „Astronomy & Astrophysics“.
Galaxy clusters are the largest gravitationally bound structures in the universe. With a typical extent of about 10 million light years, i.e. 100 times the...
Researchers at the Goethe University Frankfurt, together with partners from the University of Tübingen in Germany and Queen Mary University as well as Francis Crick Institute from London (UK) have developed a novel technology to decipher the secret ubiquitin code.
Ubiquitin is a small protein that can be linked to other cellular proteins, thereby controlling and modulating their functions. The attachment occurs in many...
In the eternal search for next generation high-efficiency solar cells and LEDs, scientists at Los Alamos National Laboratory and their partners are creating...
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are less stable. Now researchers at the Technical University of Munich (TUM) have, for the first time ever, produced a composite material combining silicon nanosheets and a polymer that is both UV-resistant and easy to process. This brings the scientists a significant step closer to industrial applications like flexible displays and photosensors.
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are...
20.03.2017 | Event News
14.03.2017 | Event News
07.03.2017 | Event News
30.03.2017 | Health and Medicine
30.03.2017 | Health and Medicine
30.03.2017 | Medical Engineering