On the Credibility of Wireless Sensor Network Simulations: Evaluation of Intrusion Detection System
| Authors | |
|---|---|
| Year of publication | 2012 |
| Type | Article in Proceedings |
| Conference | SIMUTOOLS '12: Proceedings of the 5th International ICST Conference on Simulation Tools and Techniques |
| MU Faculty or unit | |
| Citation | |
| Field | Informatics |
| Keywords | Intrusion detection;Castalia;Cooja;comparison;evaluation;MiXiM;simulator;wireless sensor network;WSNet |
| Description | In the field of wireless sensor networks, not many schemes are tested on real hardware. System designers usually give preference to simulations since their preparation and execution require significantly less time and money than experiments on real hardware. In this paper, we present a practical research on four open-source simulators, i.e., Castalia, Cooja, MiXiM and WSNet. Recently, using a simple test case, we demonstrated that usage of different simulators results into different evaluation outcomes even though the simulators are set in the same way, and the same evaluation metric is used - a number of packets received by sensor nodes. We hypothesized possible sources of the differences, but we did not thoroughly examine them. In this paper, we rigorously examine the simulators and present our findings regarding the sources of the differences. Also, we evaluate their impact on the evaluation of a more complex system - the intrusion detection system. |
| Related projects: |