Experimentation made easy with the AMazING panel

ABSTRACT

Experimental testbeds for evaluating solutions in computer networks, are today required as a complement to simulation and emulation. As these testbeds become larger, and accessible to a broader universe of the research community, dedicated management tools become mandatory. These tools ease the complex management of the testbed specific resources, while providing an environment for researchers to define their experiments with large flexibility. While there are currently several management tools, the research community is still lacking tools that smooth the experimentation workflow. These were key aspects that we considered when developing the management infrastructure for our wireless testbed(AMazING). We developed a experimentation support framework supported by an attractive GUI, automation and scripting capabilities, as well as experiment versioning and integrated result gathering and analysis.

References

1. Planetlab architecture: An overview. http://www.planetlab.org/files/pdn/PDN-06-031/pdn-06-031.pdf, February 2006.
2. The NS-2 Manual. http://www.isi.edu/nsnam/ns/doc/, October 2011.
3. The OneLab Project. http://onelab.eu/, February 2012.
4. J. P. Barraca, D. Gomes, and R. L. Aguiar. AMazING -- Advanced Mobile wIreless playGrouNd. In International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities Proceeding, TRIDENTCOM '10, pages 219--230, 2010.
5. B. Blywis, M. Guenes, F. Juraschek, and J. H. Schiller. Trends, advances, and challenges in testbed-based wireless mesh network research. Mobile Networks and Applications, 15(3):315--329, 2010.
6. R. Chertov, S. Fahmy, and N. B. Shroff. Fidelity of network simulation and emulation: A case study of tcp-targeted denial of service attacks. ACM Trans. Model. Comput. Simul., 19:4:1--4:29, January 2009.
7. P. De, A. Raniwala, S. Sharma, and T. Chiueh. Design considerations for a multihop wireless network testbed. IEEE Communications Magazine, 43(10):102--109, October 2005.
8. P. De, A. Raniwala, S. Sharma, and T. Chiueh. Mint: a miniaturized network testbed for mobile wireless research. In 24th Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings IEEE, volume 4 of INFOCOM '05, pages 2731--2742, march 2005.
9. J. Heidemann, N. Bulusu, J. Elson, C. Intanagonwiwat, K. chan Lan, Y. Xu, W. Ye, D. Estrin, and R. Govindan. Effects of detail in wireless network simulation. In Proceedings of the SCS Multiconference on Distributed Simulation, pages 3--11, Phoenix, Arizona, USA, January 2001. USC/Information Sciences Institute, Society for Computer Simulation.
10. M. Hibler, L. Stoller, J. Lepreau, R. Ricci, and C. Barb. Fast, scalable disk imaging with frisbee. In Proc. of the 2003 USENIX Annual Technical Conf., pages 283--296, San Antonio, TX, June 2003. USENIX Association.
11. J. White, G. Jourjon, T. Rakotoarivelo, and M. Ott. Measurement architectures for network experiments with disconnected mobile nodes. volume 46 of TRIDENTCOM '10, pages 350--365. Springer-Verlag, May 2010.
12. G. Jourjon, T. Rakotoarivelo, and M. Ott. A portal to support rigorous experimental methodology in networking research. In T. Korakis, H. Li, P. Tran-Gia, and H.-S. Park, editors, Proceedings Testbeds and Research Infrastructures for the Development of Networks and Communities, TRIDENTCOM '11, volume 90, pages 223--238. Springer Berlin Heidelberg, 2011.
13. M. Lacage, M. Ferrari, M. Hansen, T. Turletti, and W. Dabbous. Nepi: using independent simulators, emulators, and testbeds for easy experimentation. SIGOPS Oper. Syst. Rev., 43(4):60--65, Jan. 2010.
14. E. Nourbakhsh, R. Burchfield, S. Venkatesan, N. Mittal, and R. Prakash. Enhancing assert: making an accurate testbed friendly. In Proceedings of the 6th ACM International Workshop on Wireless network testbeds, experimental evaluation and characterization, WiNTECH '11, pages 3--10, New York, NY, USA, 2011. ACM.
15. M. Portoles-Comeras, M. Requena-Esteso, J. Mangues-Bafalluy, and M. Cardenete-Suriol. Extreme: combining the ease of management of multi-user experimental facilities and the flexibility of proof of concept testbeds. In International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities Proceedings, TRIDENTCOM '06, pages 266--276, 2006.
16. T. Rakotoarivelo, M. Ott, G. Jourjon, and I. Seskar. Omf: a control and management framework for networking testbeds. SIGOPS Oper. Syst. Rev., 43(4):54--59, Jan. 2010.
17. D. Raychaudhuri, M. Ott, and I. Secker. Orbit radio grid tested for evaluation of next-generation wireless network protocols. In Proceedings of the First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities, TRIDENTCOM '05, pages 308--309, Washington, DC, USA, 2005. IEEE Computer Society.
18. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar. An integrated experimental environment for distributed systems and networks. In Proc. of the Fifth Symposium on Operating Systems Design and Implementation, volume 36, pages 255--270, Boston, MA, Dec. 2002. USENIX Association.

Index Terms

• Information systems

  • Information systems applications

• Networks

  • Network services

    • Network management

• Software and its engineering

  • Software notations and tools

    • Software configuration management and version control systems