Research and development (R&D) of new tools for performance analysis faces many challenges from immaturity and lack of documentation of supporting tools and infrastructure, incompatibility of tools, lack of access to realistic case studies and performance parameters for them, validation of results, time required versus benefit of results, subsequent maintenance, and many, many others. Yet tool development is an essential part of practical R&D. The panelists relay experiences in developing tools, discuss what needs improvement, opportunities in developing R&D tools, and offer advice for researchers. After introductory remarks from each panelist, there will be a discussion session with the audience.

Modeling Tools, Performance Evaluation Tools, Software Performance
doi.org/10.1145/3185768.3186410
9th ACM/SPEC International Conference on Performance Engineering, ICPE 2018
Department of Systems and Computer Engineering

Cortellessa, V. (Vittorio), Smith, C.U. (Connie U.), Gómez, A. (Abel), Lladó, C. (Catalina), Kounev, S. (Samuel), & Woodside, C.M. (2018). Challenges in automating performance tool support. In ICPE 2018 - Companion of the 2018 ACM/SPEC International Conference on Performance Engineering (pp. 175–176). doi:10.1145/3185768.3186410