Paolo Tonella

http://usi.to/3qw

Publications

Key publications (6)

Biagiola M., Feldt R., Tonella P. (2025) Adaptive random testing with Q-grams : the illusion comes true
Humbatova N., Jahangirova G., Tonella P. (2021) DeepCrime: mutation testing of deep learning systems based on real faults
Stocco A., Weiss M., Calzana M., Tonella P. (2020) Misbehaviour prediction for autonomous driving systems
Humbatova N., Jahangirova G., Bavota G., Riccio V., Stocco A., Tonella P. (2020) Taxonomy of real faults in deep learning systems
Riccio V., Tonella P. (2020) Model-based exploration of the frontier of behaviours for deep learning system testing
Panichella A., Kifetew F. M., Tonella P. (2018) Automated Test Case Generation as a Many-Objective Optimisation Probl

Journal Article (40)

Pagano F., Ceccato M., Merlo A., Tonella P. (2026) Multi-agent deep reinforcement learning for penetration testing of IoT devices through their mobile companion app, Journal of Systems and Software, 239
Polverino P., Di Lauro F., Biagiola M., Tonella P., Carzaniga A. (2025) Parallelization in System-Level Testing: Novel Approaches to Manage Test Suite Dependencies, IEEE Transactions on Software Engineering, 51 (7)
Valle P., Riccio V., Arrieta A., Tonella P., Arratibel M. (2025) An industrial experience report on applying search-based boundary input generation to cyber-physical systems, Empirical Software Engineering, 30 (4)
MazraehKhatiri S., Mohammadi Amin F., Panichella S., Tonella P. (2025) When uncertainty leads to unsafety: Empirical insights into the role of uncertainty in unmanned aerial vehicle safety, Empirical Software Engineering, 30 (6)
Biagiola M., Feldt R., Tonella P. (2025) Adaptive random testing with Q-grams : the illusion comes true, Proceedings of the ACM on Software Engineering, 2 (FSE)
Olianas D., Leotta M., Ricca F., Biagiola M., Tonella P. (2025) STILE : a tool for optimizing E2E web test scripts parallelization, Journal of Systems and Software, 222
Humbatova N., Kim J., Jahangirova G., Yoo S., Tonella P. (2025) An empirical study of fault localisation techniques for deep neural networks, Empirical Software Engineering, 30 (5)
Pasini S., Kim J., Aiello T., Cabrera Lozoya R., Sabetta A., Tonella P. (2025) Evaluating and improving the robustness of security attack detectors generated by LLMs, Empirical Software Engineering, 31 (2)
Tehrani M. J., Kim J., Foulefack R. Z. L., Marchetto A., Tonella P. (2025) A taxonomy of system-level attacks on deep learning models in autonomous vehicles, ACM Transactions on Software Engineering and Methodology
Ayerdi J., Terragni V., Jahangirova G., Arrieta A., Tonella P. (2024) GenMorph: Automatically Generating Metamorphic Relations via Genetic Programming, IEEE Transactions on Software Engineering, 50 (7)
Biagiola M., Tonella P. (2024) Boundary State Generation for Testing and Improvement of Autonomous Driving Systems, IEEE Transactions on Software Engineering, 50 (8)
Giamattei L., Biagiola M., Pietrantuono R., Russo S., Tonella P. (2024) Reinforcement learning for online testing of autonomous driving systems : a replication and extension study, Empirical Software Engineering, 30 (1)
Zohdinasab T., Riccio V., Tonella P. (2024) Focused test generation for autonomous driving systems, ACM Transactions on Software Engineering and Methodology, 33 (6)
Biagiola M., Tonella P. (2024) Testing of Deep Reinforcement Learning agents with surrogate models, ACM Transactions on Software Engineering and Methodology, 33 (3)
Biagiola M., Stocco A., Riccio V., Tonella P. (2024) Two is better than one : digital siblings to improve autonomous driving testing, Empirical Software Engineering, 29 (4)
Romdhana A., Merlo A., Ceccato M., Tonella P. (2023) Assessing the security of inter-app communications in android through reinforcement learning, Computers & Security, 131
Weiss M., Tonella P. (2023) Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networks - RCR Report, ACM Transactions on Software Engineering and Methodology, 33 (1)
Weiss M., Tonella P. (2023) Uncertainty quantification for deep neural networks: An empirical comparison and usage guidelines, Software Testing, Verification and Reliability, 33 (6)
Stocco A., Pulfer B., Tonella P. (2023) Mind the Gap! A Study on the Transferability of Virtual Versus Physical-World Testing of Autonomous Driving Systems, IEEE Transactions on Software Engineering, 49 (4)
Weiss M., Tonella P. (2023) Adopting Two Supervisors for Efficient Use of Large-Scale Remote Deep Neural Networks, ACM Transactions on Software Engineering and Methodology, 33 (1)
Zohdinasab T., Riccio V., Gambi A., Tonella P. (2023) Efficient and Effective Feature Space Exploration for Testing Deep Learning Systems, ACM Transactions on Software Engineering and Methodology, 32 (2)
Bertolino A., De Angelis G., Miranda B., Tonella P. (2023) In vivo test and rollback of Java applications as they are, Software Testing, Verification and Reliability, 33 (7)
Stocco A., Pulfer B., Tonella P. (2023) Model vs system level testing of autonomous driving systems : a replication and extension study, Empirical Software Engineering, 28 (3)
Weiss M., Gómez A. G., Tonella P. (2023) Generating and detecting true ambiguity : a forgotten danger in DNN supervision testing, Empirical Software Engineering, 28 (6)
Stocco A., Tonella P. (2022) Confidence-driven weighted retraining for predicting safety-critical failures in autonomous driving systems, Journal of software: evolution and process, 34 (10)
Stocco A., Tonella P. (2022) Confidence-driven weighted retraining for predicting safety-critical failures in autonomous driving systems, Journal of software: evolution and process, 34 (10)
Stocco A., Tonella P. (2022) Confidence-driven weighted retraining for predicting safety-critical failures in autonomous driving systems, Journal of software: evolution and process, 34 (10)
Romdhana A., Merlo A., Ceccato M., Tonella P. (2022) Deep Reinforcement Learning for Black-box Testing of Android Apps, ACM Transactions on Software Engineering and Methodology, 31 (4)
Biagiola M., Tonella P. (2022) Testing the Plasticity of Reinforcement Learning-based Systems, ACM Transactions on Software Engineering and Methodology, 31 (4)
Jahangirova G., Clark D., Harman M., Tonella P. (2021) An Empirical Validation of Oracle Improvement, IEEE Transactions on Software Engineering, 47 (8)
Bertolino A., Braione P., Angelis G. D., Gazzola L., Kifetew F., Mariani L., Orrù M., Pezzè M., Pietrantuono R., Russo S., Tonella P. (2021) A Survey of Field-based Testing Techniques, ACM Computing Surveys, 54 (5)
Leotta M., Ricca F., Tonella P. (2021) Sidereal: Statistical adaptive generation of robust locators for web testing, Software Testing, Verification and Reliability, 31 (3)
Menéndez H. D., Jahangirova G., Sarro F., Tonella P., Clark D. (2021) Diversifying Focused Testing for Unit Testing, ACM Transactions on Software Engineering and Methodology, 30 (4)
Riccio V., Jahangirova G., Stocco A., Humbatova N., Weiss M., Tonella P. (2020) Testing machine learning based systems. A systematic mapping, Empirical Software Engineering, 25 (6)
Viglianisi E., Ceccato M., Tonella P. (2020) A federated society of bots for smart contract testing, Journal of Systems and Software, 168
Viticchié A., Regano L., Basile C., Torchiano M., Ceccato M., Tonella P. (2019) Empirical assessment of the effort needed to attack programs protected with client/server code splitting, Empirical Software Engineering, 25 (1)
Panichella A., Kifetew F. M., Tonella P. (2018) Automated Test Case Generation as a Many-Objective Optimisation Probl, IEEE Trans. Software Eng., 44 (2)
Leotta M., Stocco A., Ricca F., Tonella P. (2018) Pesto: Automated migration of DOM-based Web tests towards the visu, Softw. Test., Verif. Reliab., 28 (4)
Ceccato M., Tonella P., Basile C., Falcarin P., Torchiano M., Coppens B., De Sutter B. (2018) Understanding the behaviour of hackers while performing attack tasks in a professional setting and in a public challenge, Empirical Software Engineering, 24 (1)
Panichella A., Kifetew F. M., Tonella P. (2018) A large scale empirical comparison of state-of-the-art search-based test case generators, Information and Software Technology, 104

Book chapter (2)

Di Francescomarino C., Tonella P. (2021) The BPMN Visual Query Language and Process Querying Framework. Process Querying Methods. Springer International Publishing
Panichella A., Kifetew F. M., Tonella P. (2018) Incremental Control Dependency Frontier Exploration for Many-Criteria Test Case Generation. Lecture Notes in Computer Science. Springer International Publishing

Article in conference proceedings (43)

Baresi L., Xian Hu D. Y., Stocco A., Tonella P. (2025) Efficient Domain Augmentation for Autonomous Driving Testing Using Diffusion Models. Proc. of the 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE). 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE). Ottawa, ON, Canada. 2025
Thomas D. G., Biagiola M., Humbatova N., Wardat M., Jahangirova G., Rajan H., Tonella P. (2025) muPRL: A Mutation Testing Pipeline for Deep Reinforcement Learning Based on Real Faults. Proc. of the 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE). 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE). Ottawa, ON, Canada. 2025
Biagiola M., Ghislotti G., Tonella P. (2025) Improving the Readability of Automatically Generated Tests Using Large Language Models. Proc. of the 2025 IEEE Conference on Software Testing, Verification and Validation (ICST). 2025 IEEE Conference on Software Testing, Verification and Validation (ICST). Napoli, Italy. 2025
Pagano F., Ceccato M., Merlo A., Tonella P. (2025) MITHRAS : a dynamic analysis framework for the mobile-IoT ecosystem. ACM International Conference on the Foundations of Software Engineering (FSE Companion). FSE Companion '25: 33rd ACM International Conference on the Foundations of Software Engineering. Clarion Hotel Trondheim Trondheim Norway. June 23-27, 2025
Tehrani M. J., Kim J., Tonella P. (2025) PCLA : a framework for testing autonomous agents in the CARLA simulator. ACM International Conference on the Foundations of Software Engineering (FSE Companion). FSE Companion '25: 33rd ACM International Conference on the Foundations of Software Engineering. Clarion Hotel Trondheim Trondheim Norway. June 23-27, 2025
Khatiri S., Barrientos F. E. V., Wulf M., Tonella P., Panichella S. (2025) Bridging Research and Practice in Simulation-based Testing of Industrial Robot Navigation Systems. Proc. of the 40th IEEE/ACM International Conference on Automated Software Engineering (ASE). 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE). Seoul, Korea, Republic of. 2025
Grewal R., Tonella P., Stocco A. (2024) Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification. Proc. of the 2024 IEEE Conference on Software Testing, Verification and Validation (ICST). 2024 IEEE Conference on Software Testing, Verification and Validation (ICST). Toronto, ON, Canada. 2024
Humbatova N., Jahangirova G., Tonella P. (2024) Spectral Analysis of the Relation between Deep Learning Faults and Neural Activation Values. Proc. of the 2024 IEEE Conference on Software Testing, Verification and Validation (ICST). 2024 IEEE Conference on Software Testing, Verification and Validation (ICST). Toronto, ON, Canada. 2024
Doreste A., Biagiola M., Tonella P. (2024) Adversarial Testing with Reinforcement Learning: A Case Study on Autonomous Driving. Proc. of the 2024 IEEE Conference on Software Testing, Verification and Validation (ICST). 2024 IEEE Conference on Software Testing, Verification and Validation (ICST). Toronto, ON, Canada. 2024
Pasqua M., Ceccato M., Tonella P. (2024) Hypertesting of programs : theoretical foundation and automated test generation. IEEE/ACM 46th International Conference on Software Engineering (ICSE). ICSE '24: IEEE/ACM 46th International Conference on Software Engineering. Lisbon Portugal. April 14-24, 2024
MazraehKhatiri S., Panichella S., Tonella P. (2024) Simulation-based testing of unmanned aerial vehicles with AERIALIST. IEEE/ACM International Conference on Software Engineering: Companion Proceedings (ICSE Companion). ICSE-Companion '24: 2024 IEEE/ACM 46th International Conference on Software Engineering: Companion Proceedings. Lisbon Portugal. April 14-20, 2024
Riccio V., Tonella P. (2023) When and Why Test Generators for Deep Learning Produce Invalid Inputs: an Empirical Study
Zohdinasab T., Riccio V., Tonella P. (2023) An Empirical Study on Low- and High-Level Explanations of Deep Learning Misbehaviours. Proc. of the 2023 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). 2023 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). New Orleans, LA, USA. 2023
Kim J., Humbatova N., Jahangirova G., Tonella P., Yoo S. (2023) Repairing DNN Architecture: Are We There Yet?. Proc. of the 2023 IEEE Conference on Software Testing, Verification and Validation (ICST). 2023 IEEE Conference on Software Testing, Verification and Validation (ICST). Dublin, Ireland. 2023
Khatiri S., Panichella S., Tonella P. (2023) Simulation-based Test Case Generation for Unmanned Aerial Vehicles in the Neighborhood of Real Flights. Proc. of the 2023 IEEE Conference on Software Testing, Verification and Validation (ICST). 2023 IEEE Conference on Software Testing, Verification and Validation (ICST). Dublin, Ireland. 2023
Zohdinasab T., Riccio V., Tonella P. (2023) DeepAtash: Focused Test Generation for Deep Learning Systems. Proc. of ISSTA '23: 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis. ISSTA '23: 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis. Seattle WA USA. 2023
Stocco A., Nunes P. J., D'Amorim M., Tonella P. (2022) ThirdEye: Attention Maps for Safe Autonomous Driving Systems. ASE '22: 37th IEEE/ACM International Conference on Automated Software Engineering. Rochester MI USA
Romdhana A., Ceccato M., Merlo A., Tonella P. (2022) IFRIT: Focused Testing through Deep Reinforcement Learning. Proc. of the 2022 IEEE Conference on Software Testing, Verification and Validation (ICST). 2022 IEEE Conference on Software Testing, Verification and Validation (ICST). Valencia, Spain. 2022
Weiss M., Tonella P. (2022) Simple techniques work surprisingly well for neural network test prioritization and active learning (replicability study). Proc. of ISSTA '22: 31st ACM SIGSOFT International Symposium on Software Testing and Analysis. ISSTA '22: 31st ACM SIGSOFT International Symposium on Software Testing and Analysis. Virtual South Korea. 2022
Zohdinasab T., Riccio V., Gambi A., Tonella P. (2021) DeepHyperion: exploring the feature space of deep learning-based systems through illumination search. ISSTA '21: 30th ACM SIGSOFT International Symposium on Software Testing and Analysis. Virtual Denmark
Ayerdi J., Terragni V., Arrieta A., Tonella P., Sagardui G., Arratibel M. (2021) Generating metamorphic relations for cyber-physical systems with genetic programming: an industrial case study. ESEC/FSE '21: 29th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Athens Greece
Humbatova N., Jahangirova G., Tonella P. (2021) DeepCrime: mutation testing of deep learning systems based on real faults. ISSTA '21: 30th ACM SIGSOFT International Symposium on Software Testing and Analysis. Virtual Denmark
Weiss M., Chakraborty R., Tonella P. (2021) A Review and Refinement of Surprise Adequacy. Proc. of the 2021 IEEE/ACM Third International Workshop on Deep Learning for Testing and Testing for Deep Learning (DeepTest). 2021 IEEE/ACM Third International Workshop on Deep Learning for Testing and Testing for Deep Learning (DeepTest). Madrid, Spain. 2021
Weiss M., Tonella P. (2021) Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoring. Proc. of the 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). Porto de Galinhas, Brazil. 2021
Jahangirova G., Stocco A., Tonella P. (2021) Quality Metrics and Oracles for Autonomous Vehicles Testing. Proc. of the 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). Porto de Galinhas, Brazil. 2021
Romdhana A., Ceccato M., Georgiu G. C., Merlo A., Tonella P. (2021) COSMO: Code Coverage Made Easier for Android. Proc. of the 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). Porto de Galinhas, Brazil. 2021
Weiss M., Tonella P. (2021) Uncertainty-Wizard: Fast and User-Friendly Neural Network Uncertainty Quantification. Proc. of the 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). Porto de Galinhas, Brazil. 2021
Olianas D., Leotta M., Ricca F., Biagiola M., Tonella P. (2021) STILE: a Tool for Parallel Execution of E2E Web Test Scripts. Proc. of the 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). Porto de Galinhas, Brazil. 2021
Riccio V., Humbatova N., Jahangirova G., Tonella P. (2021) DeepMetis: Augmenting a Deep Learning Test Set to Increase its Mutation Score. Proc. of the 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE). 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE). Melbourne, Australia. 2021
Terragni V., Jahangirova G., Tonella P., Pezzè M. (2020) Evolutionary improvement of assertion oracles. ESEC/FSE '20: 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Virtual Event USA
Stocco A., Weiss M., Calzana M., Tonella P. (2020) Misbehaviour prediction for autonomous driving systems. Proc. of ICSE '20: 42nd International Conference on Software Engineering. ICSE '20: 42nd International Conference on Software Engineering. Seoul South Korea. 2020
Humbatova N., Jahangirova G., Bavota G., Riccio V., Stocco A., Tonella P. (2020) Taxonomy of real faults in deep learning systems. Proc. of ICSE '20: 42nd International Conference on Software Engineering. ICSE '20: 42nd International Conference on Software Engineering. Seoul South Korea. 2020
Jahangirova G., Tonella P. (2020) An Empirical Evaluation of Mutation Operators for Deep Learning Systems. Proc. of the 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). Porto, Portugal. 2020
Biagiola M., Stocco A., Ricca F., Tonella P. (2020) Dependency-Aware Web Test Generation. Proc. of the 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). Porto, Portugal. 2020
Leotta M., Biagiola M., Ricca F., Ceccato M., Tonella P. (2020) A Family of Experiments to Assess the Impact of Page Object Pattern in Web Test Suite Development. Proc. of the 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). Porto, Portugal. 2020
Ceccato M., Corradini D., Gazzola L., Kifetew F. M., Mariani L., Orru M., Tonella P. (2020) A Framework for In-Vivo Testing of Mobile Applications. Proc. of the 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). Porto, Portugal. 2020
Bertolino A., De Angelis G., Miranda B., Tonella P. (2020) Run Java Applications and Test Them In-Vivo Meantime. Proc. of the 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). Porto, Portugal. 2020
Stocco A., Tonella P. (2020) Towards Anomaly Detectors that Learn Continuously. Proc. of the 2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW). 2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW). Coimbra, Portugal. 2020
Riccio V., Tonella P. (2020) Model-based exploration of the frontier of behaviours for deep learning system testing. Proc. of ESEC/FSE '20: 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ESEC/FSE '20: 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Virtual Event USA. 2020
Ceccato M., Gazzola L., Kifetew F. M., Mariani L., Orrù M., Tonella P. (2019) Toward In-Vivo Testing of Mobile Applications. Proc. of the 2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW). 2019 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW). Berlin, Germany. 2019
Biagiola M., Stocco A., Ricca F., Tonella P. (2019) Diversity-based web test generation. Proc. of ESEC/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ESEC/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Tallinn Estonia. 2019
Biagiola M., Stocco A., Mesbah A., Ricca F., Tonella P. (2019) Web test dependency detection. Proc. of ESEC/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ESEC/FSE '19: 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. Tallinn Estonia. 2019
Jahangirova G., Clark D., Harman M., Tonella P. (2018) OASIs: oracle assessment and improvement tool. Proc. of ISSTA '18: International Symposium on Software Testing and Analysis. ISSTA '18: International Symposium on Software Testing and Analysis. Amsterdam Netherlands. 2018