Publications

Journal Publications

Ana B. Sánchez, José A. Parejo, Sergio Segura, Amador Durán, Mike Papadakis
Mutation Testing in Practice: Insights from Open-Source Software Developers
IEEE Transactions on Software Engineering. 2024.

Jon Ayerdi, Pablo Valle, Sergio Segura; Aitor Arrieta, Goiuria Sagardui, and Maite Arratibel
Performance-Driven Metamorphic Testing of Cyber-Physical Systems
IEEE Transactions on Reliability. 2022.

Ana Belén Sánchez, Pedro Delgado-Pérez, Inmaculada Medina-Bulo, and Sergio Segura
Mutation Testing in the Wild: Findings from GitHub
Empirical Software Engineering. 2022.

Javier Troya, Sergio Segura, Lola Burgueño, and Manuel Wimmer
Model Transformation Testing and Debugging: A Survey
ACM Computing Surveys. 2022. In press.

Juan C. Alonso, Alberto Martin-Lopez, Sergio Segura, José María García, and Antonio Ruiz-Cortes
ARTE: Automated Generation of Realistic Test Inputs for Web APIs
IEEE Transactions on Software Engineering. 2022. In press.

Alberto Martin-Lopez, Sergio Segura, Carlos Müller, and Antonio Ruiz-Cortes
Specification and Automated Analysis of Inter-Parameter Dependencies in Web APIs
IEEE Transactions on Service Computing. 2022. In press.

Ana B. Sánchez, Pedro Delgado-Pérez, Inmaculada Medina-Bulo, and Sergio Segura
TANDEM: A Taxonomy and a Dataset of Real-World Performance Bugs
IEEE Access. 2020.

Pedro Delgado-Pérez, Ana B. Sánchez, Sergio Segura, and Inmaculada Medina-Bulo
Performance Mutation Testing
Software Testing, Verification and Reliability. 2020.

Robert M. Hierons, Miqing Li, XiaHui Liu, José A. Parejo, Sergio Segura, and Xin Yao
Many-Objective Test Suite Generation for Software Product Lines
ACM Transactions on Software Engineering and Methodology. 2020.

Sergio Segura, Zhi Quan Zhou, Dave Towey, Tsong Yueh Chen
Metamorphic Testing: Testing the Untestable
IEEE Software. 2019.

Javier Troya, Sergio Segura, José A. Parejo, Antonio Ruiz-Cortés
Spectrum-Based Fault Localization in Model Transformations
ACM Transactions on Software Engineering and Methodology. 2018.

Ana B.Sánchez, Pedro Delgado-Pérez, Sergio Segura, Inmaculada Medina-Bulo
Performance mutation testing: hypothesis and open questions
Information and Software Technology. 2018.

Aitor Arrieta, Sergio Segura, Urtzi Markiegi, Goiuria Sagardui, Leire Etxeberria
Spectrum-Based Fault Localization in Software Product Lines
Information and Software Technology. 2018.

Sergio Segura, Javier Troya, Amador Durán and Antonio Ruiz-Cortés
Performance Metamorphic Testing: A Proof of Concept
Information and Software Technology. 2018.

Sergio Segura, José A. Parejo, Javier Troya and Antonio Ruiz-Cortés
Metamorphic Testing of RESTful APIs
IEEE Transactions on Software Engineering. 2017. (In press)

Javier Troya, Sergio Segura and Antonio Ruiz-Cortés
Automated Inference of Likely Metamorphic Relations for Model Transformations
Journal of Systems and Software. 2017.

Pedro Delgado-Pérez, Sergio Segura, Inmaculada Medina-Bulo
Assessment of C++ Object-Oriented Mutation Operators: A Selective Mutation Approach
Software Testing, Verification and Reliability. 2017.

Aurora Ramirez, José A. Parejo, José R. Romero, Sergio Segura, and Antonio Ruiz-Cortés
Evolutionary composition of QoS-aware web services: a many-objective perspective
Expert Systems with Applications. 2016.

José A. Parejo, Ana. B. Sánchez, Sergio Segura, Antonio Ruiz-Cortés, Roberto E. Lopez-Herrejon and Alexander Egyed
Multi-Objective Test Case Prioritization in Highly Configurable Systems: A Case Study
Journal of Systems and Software. 2016.

Sergio Segura, Gordon Fraser, Ana B. Sánchez and Antonio Ruiz-Cortés
A Survey on Metamorphic Testing
IEEE Transactions on Software Engineering. 2016. Online Appendix: Subject programs

Robert M. Hierons, Miqing Li, XiaoHui Liu, Sergio Segura, and Wei Zheng
SIP: Optimal Product Selection from Feature Models using Many-Objective Evolutionary Optimisation
ACM Transactions on Software Engineering and Methodology. 2016.

Amador Durán, David Benavides, Sergio Segura, Pablo Trinidad and Antonio Ruiz-Cortés
FLAME: a Formal Framework for the Automated Analysis of Software Product Lines Validated by Automated Specification Testing
Software and System Modeling. 2015.

Ana B. Sánchez, Sergio Segura, J.A. Parejo and Antonio Ruiz-Cortés
Variability Testing in the Wild: The Drupal Case Study
Software and System Modeling. 2015.

Sergio Segura, Amador Durán, Ana B. Sánchez, Daniel Le Berre, Emmanuel Lonca and Antonio Ruiz-Cortés
Automated Metamorphic Testing of Variability Analysis Tools
Software Testing, Verification and Reliability. 2015.

R.E. Lopez-Herrejon, L. Linsbauer, J.A. Galindo, J.A. Parejo, D. Benavides, S. Segura and A. Egyed
An assessment of search-based techniques for reverse engineering feature models
Journal of Systems and Software. 2015.

Sergio Segura, José A. Parejo, Robert M. Hierons, David Benavides and Antonio Ruiz Cortés
Automated Generation of Hard Feature Models using Evolutionary Algorithms
Expert Systems with Applications. 2014. (Evaluation material)

José A. Parejo, Sergio Segura, Pablo Fernández and Antonio Ruiz Cortés
QoS-aware Web Services Composition using GRASP with Path Relinking
Expert Systems with Applications. 2014.

Sergio Segura, Robert M. Hierons, David Benavides and Antonio Ruiz Cortés
Mutation Testing on an Object-Oriented Framework: An Experience Report
Information and Software Technology Special Issue on Mutation Testing. 2011.

Sergio Segura, David Benavides and Antonio Ruiz Cortés
Functional Testing of Feature Model Analysis Tools: A Test Suite
IET Software. Volume 5 (1), pages 70-82. 2011.

Sergio Segura, Robert M. Hierons, David Benavides and Antonio Ruiz Cortés
Automated Metamorphic Testing on the Analyses of Feature Models
Information and Software Technology. Volume 53 (3), pages 245-258. 2011.

David Benavides, Sergio Segura and Antonio Ruiz Cortés
Automated Analysis of Feature Models 20 Years Later: A Literature Review
Information Systems. Elsevier. 35(6). September 2010.

Refereed Conferences and Workshops

Saman Barakat, Ana B. Sanchez, and Sergio Segura
IDLGen: Automated Code Generation for Inter-parameter Dependencies in Web APIs
21st International Conference on Service-Oriented Computing. Rome, Italy. 2023.

Anne-Laure Wozniak, Ngoc Q. K. Duong, Ian Benderitter, Sarah Leroy, Sergio Segura, and Raúl Mazo
Robustness Testing of an Industrial Road Object Detection System
5th IEEE International Conference on Artificial Intelligence Testing. Athens, Greece. 2023. BEST APPLICATION PAPER AWARD

Juan Carlos Alonso, Sergio Segura, and Antonio Ruiz-Cortés
AGORA: Automated Generation of Test Oracles for REST APIs
ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA). 2023. DISTINGUISHED ARTIFACT AWARD

Alberto Martin-Lopez, Sergio Segura, and Antonio Ruiz-Cortés
Online Testing of RESTful APIs: Promises and Challenges
ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2022), Singapore. 2022. DISTINGUISHED PAPER AWARD

Sergio Segura, Juan C. Alonso, Alberto Martin-Lopez, Amador Durán, Javier Troya, Antonio Ruiz-Cortés
Automated Generation of Metamorphic Relations for Query-Based Systems
7th International Workshop on Metamorphic Testing (ICSE MET'22), Pittsburgh, PA, USA. 2022.

Anne-Laure Wozniak, Sergio Segura, Raúl Mazo, and Sarah Leroy
Robustness Testing of a Machine Learning-based Road Object Detection System: An Industrial Case
International Workshop on Software Engineering for Responsible AI (ICSE SE4RAI'22), Pittsburgh, PA, USA. 2022.

Alberto Martin-Lopez, Andrea Arcuri, Sergio Segura, and Antonio Ruiz-Cortés
Black-Box and White-Box Test Case Generation for RESTful APIs: Enemies or Allies?
32nd International Symposium on Software Reliability Engineering (ISSRE'21). Wuhan, China. 2021.

Alberto Martin-Lopez, Sergio Segura, Antonio Ruiz-Cortés
RESTest: Automated Black-Box Testing of RESTful Web APIs
30th ACM SIGSOFT Int. Symposium on Software Testing and Analysis (ISSTA'21). Tool Demo. Aarhus, Denmark. 2021.

A. Giuliano Mirabella, Alberto Martín-López, Sergio Segura, Luis Valencia-Cabrera, and Antonio Ruiz-Cortés
Deep Learning-Based Prediction of Test Input Validity for RESTful APIs
International Workshop on Testing for Deep Learning and Deep Learning for Testing (DeepTest 2021). Madrid, Spain (Virtual). 2021.

Alberto Martin-Lopez, Sergio Segura, and Antonio Ruiz-Cortés
RESTest: Black-Box Constraint-Based Testing of RESTful Web APIs
18th Int. Conference on Service-Oriented Computing (ICSOC’20). Dubai, UAE. 2020.

Jon Ayerdi, Sergio Segura, Aitor Arrieta, Goiuria Sagardui, and Maite Arratibel
QoS-aware Metamorphic Testing: An Elevation Case Study
31st International Symposium on Software Reliability Engineering (ISSRE 2020). Coimbra, Portugal (Virtual). 2020.

Alberto Martin-Lopez, Sergio Segura, and Antonio Ruiz-Cortés
A Catalogue of Inter-Parameter Dependencies in RESTful Web APIs
17th Int. Conference on Service-Oriented Computing (ICSOC’19). Toulouse, France. 2019.

Alberto Martin-Lopez, Sergio Segura, and Antonio Ruiz-Cortés
Test Coverage Criteria for RESTfulWeb APIs
10th Int. Workshop on Automating Test Case Design, Selection and Evaluation (A-Test'19). Tallinn, Estonia. 2019.

Sergio Segura, Amador Durán, Javier Troya and Antonio Ruiz-Cortés
Metamorphic Relation Patterns for Query-Based Systems
4th International Workshop on Metamophic Testing. Montreal, Canada. 2019.

Pedro Delgado-Pérez and Sergio Segura
Study of Trivial Compiler Equivalence on C++ Object-Oriented Mutation Operators
ACM/SIGAPP Symposium On Applied Computing. Cyprus. 2019.

Sergio Segura
Metamorphic Testing: Challenges Ahead (Keynote)
Third International Workshop on Metamorphic Testing. Gothenburg. May 2018. Slides

Sergio Segura, Javier Troya, Amador Durán and Antonio Ruiz-Cortés
Performance Metamorphic Testing: Motivation and Challenges
International Conference on Software Engineering (New Ideas and Emerging Results Track), Argentina. 2017. (Acceptance rate: 16%)

Sergio Segura, Amador Durán, Javier Troya and Antonio Ruiz Cortés
A Template-Based Approach to Describing Metamorphic Relations
2nd International Workshop on Metamorphic Testing (co-located with ICSE'17), Argentina. 2017.

Pedro Delgado-Pérez, Inmaculada Medina-Bulo, Sergio Segura, Antonio García-Domínguez and Juan José Domínguez-Jiménez
GiGAn: Evolutionary Mutation Testing for C++ Object-Oriented Systems
Software Verification and Testing (SVT 2017), Marrakech. 2017.

Ana B. Sánchez and Sergio Segura
SmarTest: A Test Case Prioritization Tool for Drupal
International Systems and Software Product Line Conference, Sept, 2017.

Javier Troya, Sergio Segura and Antonio Ruiz-Cortés.
Towards the Automation of Metamorphic Testing in Model Transformations
Jornadas de Ingeniería del Software y Bases de Datos (JISBD 2016). Salamanca, Spain. 2016.

Ana Belén Sánchez, Sergio Segura and Antonio Ruiz-Cortés
SmarTest: Accelerating the Detection of Faults in Drupal
DrupalCampSpain. Jerez de la Frontera, Spain. 2015.

Sergio Segura, Ana Belén Sánchez and Antonio Ruiz-Cortés
Automated Variability Analysis and Testing of an E-Commerce Site. An Experience Report
29th IEEE/ACM International Conference on Automated Software Engineering (ASE 2014). Västerås, Sweden. 2014.
LA HILANDERA FEATURE MODEL (SXFM format)

Ana Belén Sánchez, Sergio Segura and Antonio Ruiz-Cortés
A Comparison of Test Case Prioritization Criteria for Software Product Lines
7th IEEE International Conference on Software Testing, Verification and Validation (ICST 2014). Cleveland, Ohio, USA. 2014.

Ana Belén Sánchez, Sergio Segura and Antonio Ruiz-Cortés
The Drupal Framework: A Case Study to Evaluate Variability Testing Techniques
8th International Workshop on Variability Modelling of Software-intensive Systems (VaMoS 2014). Nice, France. 2014.
DRUPAL FEATURE MODEL (SXFM, FaMa Format)

Roberto E. Lopez-Herrejon, José A. Galindo, David Benavides, Sergio Segura and Alexander Egyed
Reverse Engineering Feature Models with Evolutionary Algorithms: An Exploratory Study
4th Symposium on Search Based Software Engineering. Trento, Italy. 2012.

Roberto E. Lopez-Herrejon, José A. Galindo, David Benavides, Sergio Segura and Alexander Egyed
Automated testing on the analysis of variability-intensive artifacts: An exploratory study with SAT Solvers
4th Symposium on Search Based Software Engineering. Trento, Italy. 2012.

Sergio Segura, Jose A. Galindo, David Benavides, Jose A. Parejo and Antonio Ruiz-Cortés
BeTTy: Un Framework de Pruebas para el Análisis Automático de Modelos de Características
XVII Jornadas de Ingeniería del Software y Bases de Datos. Almería, Spain. 2012.

Sergio Segura, Jose A. Galindo, David Benavides, Jose A. Parejo and Antonio Ruiz-Cortés
BeTTy: Benchmarking and Testing on the Automated Analysis of Feature Models
Sixth International Workshop on Variability Modelling of Software-intensive Systems (VaMoS'12). Leipzig, Germnay. 2012.

Jose A. Galindo, David Benavides and Sergio Segura
Debian Packages Repositories as Software Product Line Models. Towards Automated Analysis
First International Workshop on Automated Configuration and Tailoring of Applications (ACOTA). Antwerp, Belgium. 2010.

Sergio Segura, Robert M. Hierons, David Benavides and Antonio Ruiz-Cortés
Automated Test Data Generation on the Analyses of Feature Models: A Metamorphic Testing Approach
Third International Conference on Software Testing, Verification and Validation. Paris, France. April 6-9, 2010. IEEE press. (evaluation material).
BEST PRESENTATION AWARD (SLIDES)

Sergio Segura and Antonio Ruiz-Cortés
Benchmarking on the Automated Analyses of Feature Models: A Preliminary Roadmap
Third International Workshop on Variability Modelling of Software-intensive Systems (VAMOS'09). Seville, Spain. 2009.

Sergio Segura
Automated Analysis of Feature Models using Atomic Sets
First Workshop on Analyses of Software Product Lines (ASPL'08), SPLC'08. Limerick, Ireland.

Pablo Trinidad, Antonio Ruiz-Cortés, David Benavides and Sergio Segura
Three-Dimensional Feature Diagrams Visualization
2nd International Workshop on Visualisation in SPL Engineering (ViSPLE'08), SPLC'08. Limerick, Ireland.

Sergio Segura, David Benavides and Antonio Ruiz-Cortés
Functional Testing of Feature Model Analysis Tools. A First Step
5th Software Product Lines Testing Workshop (SPLiT 2008), SPLC'08. Limerick, Ireland.

P. Trinidad, A. Ruiz-Cortés, D. Benavides, S. Segura and A. Jimenez
FAMA Framework
12th International Software Product Line Conference (SPLC 2008), Limerick, Ireland.

Fabricia Roos-Frantz and Sergio Segura
Automated Analysis of Orthogonal Variability Models. A First Step
First Workshop on Analyses of Software Product Lines (ASPL'08), SPLC'08. Limerick, Ireland.

Sergio Segura, David Benavides, Antonio Ruiz-Cortés and Pablo Trinidad
A Taxonomy of Variability in Web Service Flows
Service Oriented Architectures and Product Lines (SOAPL - 07). SPLC'07. Kyoto, Japan. 2007.

Sergio Segura, David Benavides, Antonio Ruiz-Cortés and Pablo Trinidad
Open Source Tools for Software Product Line Development
Open Source and Product Lines 2007, OSSPL07 Asia. SPLC'07. Kyoto. Japan. 2007.

S. Segura, D. Benavides, A.Ruiz-Cortés and Pablo Trinidad
Toward Automated Refactoring of Feature Models using Graph Transformations
VII Jornadas sobre Programación y Lenguajes, PROLE’2007. Zaragoza, Spain. 2007.

Sergio Segura, David Benavides, Antonio Ruiz-Cortés and María José Escalona
From Requirements to Web System Design. An Automated Approach using Graph Transformations
Desarrollo de Software Dirigido por Modelos. 4ª Edición (DSDM 2007). Zaragoza, Spain. 2007.

P. Trinidad, D. Benavides, S. Segura, A. Ruiz-Cortés
FAMA: hacia el análisis automático de modelos de características (English)
XII Jornadas de Ingeniería del Software y Bases de Datos (JISBD'07). Zaragoza, Spain. 2007.

D. Benavides, S. Segura, P. Trinidad and A.Ruiz-Cortés
FAMA: Tooling a Framework for the Automated Analysis of Feature Models
First International Workshop on Variability Modelling of Software-intensive Systems (VAMOS). Limerick, Ireland. 2007.

Pablo Trinidad , David Benavides, Antonio Ruiz-Cortes, Sergio Segura y Miguel Toro
Explanations for Agile Feature Models
1st International Workshop on Agile Product Line Engineering (SPLC'06). Baltimore, Maryland, USA. 2006.

David Benavides, Sergio Segura, Pablo Trinidad y Antonio Ruiz-Cortés
A first step towards a framework for the automated analysis of feature models
Managing Variability for Software Product Lines: Working with Variability Mechanisms (SPLC'06). Baltimore, Maryland, USA. 2006.

D. Benavides, P. Trinidad, A. Ruiz-Cortés y S. Segura
A Survey on the automated analyses of feature models
Jornadas de Ingeniería del Software y Bases de Datos (JISBD'06). Sitges, Barcelona (Spain). 2006.

Book chapters

Ana B. Sánchez, Sergio Segura, Antonio Ruiz-Cortés
Evaluating Testing Techniques in Highly-Configurable Systems: The Drupal Dataset
Research and Evidence in Software Engineering: From Empirical Studies to Open Source Artifacts. CRC Press, Taylor & Francis. 2020.

Alberto Martin-Lopez, Sergio Segura, Antonio Ruiz-Cortés
Inter-Parameter Dependencies in Real-World Web APIs: The IDEA Dataset
Research and Evidence in Software Engineering: From Empirical Studies to Open Source Artifacts. CRC Press, Taylor & Francis. 2020.

Sergio Segura, David Benavides, Antonio Ruiz-Cortés and Pablo Trinidad
Automated Merging of Feature Models using Graph Transformations
Post-proceedings Summer School on Generative and Transformational Techniques in Software Engineering (GTTSE'07). Springer Verlag. Braga, Portugal. 2008.

D. Benavides, S. Segura, P. Trinidad y A. Ruiz-Cortés
Using Java CSP Solvers in the Automated Analyses of Feature Models
Post-proceedings Summer School on Generative and Transformational Techniques in Software Engineering (GTTSE'05). Springer Verlag. Braga, Portugal. 2006.

Tutorials

Sergio Segura and Zhi Quan Zhou
Metamorphic Testing 20 Years Later: A Hands-on Introduction
International Conference on Software Engineering, May, 2018.

Javier Troya, Juha-Pekka Tolvanen, Sergio Segura
Domain-Specific Languages and Model Transformations for Software Product Lines
International Systems and Software Product Line Conference, Sept, 2017.

Technical reports

Sergio Segura, Gordon Fraser, Ana B. Sánchez and Antonio Ruiz-Cortés
Metamorphic Testing: A Literature Review v1.3
ISA Research Group. (ISA-16-TR-02). February 2016. Seville, Spain.

Sergio Segura, Amador Durán, Ana B. Sánchez, Daniel Le Berre, Emmanuel Lonca and Antonio Ruiz-Cortés
Automated Metamorphic Testing on the Analysis of Software Variability
ISA Research Group. (ISA-13-TR-03). December 2013. Seville, Spain.

Sergio Segura, David Benavides and Antonio Ruiz-Cortés
FaMa Test Suite v1.2
ISA Research Group. (ISA-10-TR-01). 2010. Seville, Spain.

David Benavides, Sergio Segura and Antonio Ruiz-Cortés
Automated Analysis of Feature Models: A Detailed Literature Review v1.0
ISA Research Group. (ISA-09-TR-04). 2009. Seville, Spain.

Sergio Segura, David Benavides and Antonio Ruiz-Cortés
FaMa Test Suite v1.1
ISA Research Group. (ISA-09-TR-03). 2009. Seville, Spain. (evaluation material)

Copyright Notice : This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.