Product testing is an integral part of product development. To achieve this goal, testing group develops test suites which verify product usability. Our testing can be divided into six basic parts:
- conformance: product must be compliant to standards and it must cooperate with equipment of other vendors. We test that our products can be put into existing network infrastructure.
- functional: each product feature is examined and tested whether it operates according to its specification.
- performance: each our project is developed to achieve major performance enhancements compared to standard PC hardware. Performance tests are therefore very important part of our work.
- stress: device under test is exposed to abnormal circumstances that can, however, occur in daily use.
- benchmark: we also compare our products to similar (commercial) products.
- system: last, but not least, we test each release of our product packages to find any problems in installation process (including documentation) or package function as a whole.
We develop high speed network devices thus we cannot use software testing tools for speed of 10 Gbps to conduct performance tests. So we use hardware packet generators, analyzers and emulators, namely:
We develop automated test suite to achieve effectivity and better quality in testing process. Automated tests are essential for regression testing. What is more, developers can execute the test suite without assistance of testing group. The test suite is mainly implemented as Tcl framework that control hardware test devices. We also use C language, BASH and Perl.
Our work is summarized in test reports (CESNET technical reports, publicly available PDF documents or internal wiki pages in project management system). These reports contain information about test bed, testing process and results (presented as tables or plots). Each test is made in accordance with RFC recommendations or best practices. See examples of our test reports: FlowMon: Report of One-way Throughput Test or Packet Capture Benchmark on 1 GE. Developers and testers use bug tracker in project management system Trac.
If you would like to join testing group, feel free to contact Jan Vykopal.
