Traceability in the Wild: Automatically Augmenting Incomplete Trace Links
Fulltext URI
Document type
Files
Additional Information
Date
relationships.isAuthorOf
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This paper was published at the 40th International Conference on Software Engineering (ICSE) in May 2018. The authors propose a novel approach to establish trace links among software development artifacts. In particular, it allows to automatically link commits made in a projects’ version control systems (such as git) to respective issues in the projects’ issue tracker (e. g. Atlassian Jira). Besides augmenting an existing code base with additional trace links, the approach enables active recommendation of issues to the developer while performing a new commit to the version control system. This simplifies the overall development workflow. The proposed method is based on state-of-the-art machine learning techniques and serves as a basic building block in establishing project wide traceability. It’s feasibility, completeness, and usefulness was successfully evaluated through six empirical studies as well as one human study. The work was honored with an ACM SIGSOFT Distinguished Paper Award.
Description
Keywords
Citation
URI
Endorsement
Review
Supplemented By
Referenced By
Number of citations to item: 75
- Ankit Agrawal, Seyedehzahra Khoshmanesh, Michael Vierhauser, Mona Rahimi, Jane Cleland-Huang, Robyn Lutz (2019): Leveraging Artifact Trees to Evolve and Reuse Safety Cases, In: 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE), doi:10.1109/icse.2019.00124
- Christoph Mayr-Dorn, Michael Vierhauser, Felix Keplinger, Stefan Bichler, Alexander Egyed (2020): TimeTracer, In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Companion Proceedings, doi:10.1145/3377812.3382141
- Jan-Philipp Steghöfer, Nan Niu, Jin L.C. Guo, Anas Mahmoud (2019): SST'19 - Software and Systems Traceability, In: ACM SIGSOFT Software Engineering Notes 3(44), doi:10.1145/3356773.3356806
- Jan Keim, Sophie Corallo, Dominik Fuchß, Tobias Hey, Tobias Telge, Anne Koziolek (2024): Recovering Trace Links Between Software Documentation And Code, In: Proceedings of the IEEE/ACM 46th International Conference on Software Engineering, doi:10.1145/3597503.3639130
- Ashley T. van Can, Fabiano Dalpiaz (2024): Requirements Information in Backlog Items: Content Analysis, In: Lecture Notes in Computer Science, doi:10.1007/978-3-031-57327-9_19
- Michael Rath, David Lo, Patrick Mäder (2018): Analyzing requirements and traceability information to improve bug localization, In: Proceedings of the 15th International Conference on Mining Software Repositories, doi:10.1145/3196398.3196415
- Yalin Liu, Jinfeng Lin, Qingkai Zeng, Meng Jiang, Jane Cleland-Huang (2020): Towards Semantically Guided Traceability, In: 2020 IEEE 28th International Requirements Engineering Conference (RE), doi:10.1109/re48521.2020.00043
- Ayberk Yaşa, Cemhan Kaan Özaltan, Görkem Ayten, Fatih Kaplama, Ömercan Devran, Baykal Mehmet Uçar, Eray Tüzün (2025): Evaluating ReLink for Traceability Link Recovery in Practice, In: 2025 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), doi:10.1109/saner64311.2025.00016
- Yijing Lyu, Heetae Cho, Pilsu Jung, Seonah Lee (2023): A Systematic Literature Review of Issue-Based Requirement Traceability, In: IEEE Access, doi:10.1109/access.2023.3242294
- Jin L. C. Guo, Jan-Philipp Steghöfer, Andreas Vogelsang, Jane Cleland-Huang (2025): Natural Language Processing for Requirements Traceability, In: Handbook on Natural Language Processing for Requirements Engineering, doi:10.1007/978-3-031-73143-3_4
- Edouard Romari Batot, Sebastien Gérard, Jordi Cabot (2022): A Survey-driven Feature Model for Software Traceability Approaches, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-99429-7_2
- Rebekka Wohlrab, Eric Knauss, Jan-Philipp Steghöfer, Salome Maro, Anthony Anjorin, Patrizio Pelliccione (2018): Collaborative traceability management: a multiple case study from the perspectives of organization, process, and culture, In: Requirements Engineering 1(25), doi:10.1007/s00766-018-0306-1
- Hideaki Hata, Christoph Treude, Raula Gaikovina Kula, Takashi Ishio (2019): 9.6 Million Links in Source Code Comments: Purpose, Evolution, and Decay, In: 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE), doi:10.1109/icse.2019.00123
- Giang Nguyen-Truong, Hong Jin Kang, David Lo, Abhishek Sharma, Andrew E. Santosa, Asankhaya Sharma, Ming Yi Ang (2022): HERMES: Using Commit-Issue Linking to Detect Vulnerability-Fixing Commits, In: 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), doi:10.1109/saner53432.2022.00018
- Ally S. Nyamawe, Hui Liu, Nan Niu, Qasim Umer, Zhendong Niu (2020): Feature requests-based recommendation of software refactorings, In: Empirical Software Engineering 5(25), doi:10.1007/s10664-020-09871-2
- Zakarea Alshara, Hamzeh Eyal Salman, Anas Shatnawi, Abdelhak-Djamel Seriai (2023): ML-Augmented Automation for Recovering Links Between Pull-Requests and Issues on GitHub, In: IEEE Access, doi:10.1109/access.2023.3236392
- Wouter van Oosten, Randell Rasiman, Fabiano Dalpiaz, Toine Hurkmans (2023): On the effectiveness of automated tracing from model changes to project issues, In: Information and Software Technology, doi:10.1016/j.infsof.2023.107226
- Jiakun Liu, Xin Xia, David Lo, Haoxiang Zhang, Ying Zou, Ahmed E. Hassan, Shanping Li (2022): Broken External Links on Stack Overflow, In: IEEE Transactions on Software Engineering 9(48), doi:10.1109/tse.2021.3086494
- Colin Werner, Ze Shi Li, Derek Lowlind, Omar Elazhary, Neil Ernst, Daniela Damian (2022): Continuously Managing NFRs: Opportunities and Challenges in Practice, In: IEEE Transactions on Software Engineering 7(48), doi:10.1109/tse.2021.3066330
- Paul Hübner, Barbara Paech (2019): Increasing Precision of Automatically Generated Trace Links, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-15538-4_5
- Weifeng Sun, Zhenting Guo, Meng Yan, Zhongxin Liu, Yan Lei, Hongyu Zhang (2024): Method-Level Test-to-Code Traceability Link Construction by Semantic Correlation Learning, In: IEEE Transactions on Software Engineering 10(50), doi:10.1109/tse.2024.3449917
- Profir-Petru Pârţachi, David R. White, Earl T. Barr (2023): Aide-mémoire: Improving a Project’s Collective Memory via Pull Request–Issue Links, In: ACM Transactions on Software Engineering and Methodology 2(32), doi:10.1145/3542937
- Marcus Seiler, Paul Hubner, Barbara Paech (2019): Comparing Traceability through Information Retrieval, Commits, Interaction Logs, and Tags, In: 2019 IEEE/ACM 10th International Symposium on Software and Systems Traceability (SST), doi:10.1109/sst.2019.00015
- Chong Wang, Xin Peng, Mingwei Liu, Zhenchang Xing, Xuefang Bai, Bing Xie, Tuo Wang (2019): A learning-based approach for automatic construction of domain glossary from source code and documentation, In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, doi:10.1145/3338906.3338963
- Zakarea Alshara, Anas Shatnawi, Hamzeh Eyal-Salman, Abdelhak-Djamel Seriai, Maad Shatnawi (2023): PI-Link: A Ground-Truth Dataset of Links Between Pull-Requests and Issues in GitHub, In: IEEE Access, doi:10.1109/access.2022.3232982
- Alexander Nicholson, Deeksha M. Arya, Jin L.C. Guo (2020): Traceability Network Analysis: A Case Study of Links in Issue Tracking Systems, In: 2020 IEEE Seventh International Workshop on Artificial Intelligence for Requirements Engineering (AIRE), doi:10.1109/aire51212.2020.00013
- Yalin Liu, Jinfeng Lin, Jane Cleland-Huang (2020): Traceability Support for Multi-Lingual Software Projects, In: Proceedings of the 17th International Conference on Mining Software Repositories, doi:10.1145/3379597.3387440
- Michael Rath, Jacob Rendall, Jin L. C. Guo, Jane Cleland-Huang, Patrick Mäder (2018): Traceability in the wild, In: Proceedings of the 40th International Conference on Software Engineering, doi:10.1145/3180155.3180207
- Randell Rasiman, Fabiano Dalpiaz, Sergio España (2022): How Effective Is Automated Trace Link Recovery in Model-Driven Development?, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-98464-9_4
- Jane Cleland-Huang, Michael Vierhauser (2018): Discovering, Analyzing, and Managing Safety Stories in Agile Projects, In: 2018 IEEE 26th International Requirements Engineering Conference (RE), doi:10.1109/re.2018.00034
- Wenjie Li, Yanyan Jiang, Chang Xu, Yepang Liu, Xiaoxing Ma, Jian Lu (2019): Characterizing and Detecting Inefficient Image Displaying Issues in Android Apps, In: 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER), doi:10.1109/saner.2019.8668030
- Ally S. Nyamawe, Khadidja Bakhti, Sulis Sandiwarno (2021): Identifying rename refactoring opportunities based on feature requests, In: International Journal of Computers and Applications 8(44), doi:10.1080/1206212x.2021.1922151
- Tao Xiao, Sebastian Baltes, Hideaki Hata, Christoph Treude, Raula Gaikovina Kula, Takashi Ishio, Kenichi Matsumoto (2023): 18 million links in commit messages: purpose, evolution, and decay, In: Empirical Software Engineering 4(28), doi:10.1007/s10664-023-10325-8
- Dong Wang, Tao Xiao, Patanamon Thongtanunam, Raula Gaikovina Kula, Kenichi Matsumoto (2021): Understanding shared links and their intentions to meet information needs in modern code review:, In: Empirical Software Engineering 5(26), doi:10.1007/s10664-021-09997-x
- Monoshiz Mahbub Khan, Zhe Yu (2024): Approaching code search for python as a translation retrieval problem with dual encoders, In: Empirical Software Engineering 1(30), doi:10.1007/s10664-024-10580-3
- Alberto D. Rodriguez, Katherine R. Dearstyne, Jane Cleland-Huang (2023): Prompts Matter: Insights and Strategies for Prompt Engineering in Automated Software Traceability, In: 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW), doi:10.1109/rew57809.2023.00087
- Juan Manuel Florez, Jonathan Perry, Shiyi Wei, Andrian Marcus (2022): Retrieving data constraint implementations using fine-grained code patterns, In: Proceedings of the 44th International Conference on Software Engineering, doi:10.1145/3510003.3510167
- Rrezarta Krasniqi, Jane Cleland-Huang (2020): Enhancing Source Code Refactoring Detection with Explanations from Commit Messages, In: 2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER), doi:10.1109/saner48275.2020.9054816
- Ashley T. van Can, Fabiano Dalpiaz (2025): Locating requirements in backlog items: Content analysis and experiments with large language models, In: Information and Software Technology, doi:10.1016/j.infsof.2024.107644
- James Martin, Jin L. C. Guo (2022): Deep API learning revisited, In: Proceedings of the 30th IEEE/ACM International Conference on Program Comprehension, doi:10.1145/3524610.3527872
- Toshiki Hirao, Shane McIntosh, Akinori Ihara, Kenichi Matsumoto (2019): The review linkage graph for code review analytics: a recovery approach and empirical study, In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, doi:10.1145/3338906.3338949
- Sabine Molenaar, Tjerk Spijkman, Fabiano Dalpiaz, Sjaak Brinkkemper (2020): Explicit Alignment of Requirements and Architecture in Agile Development, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-44429-7_13
- Kevin Moran, David N. Palacio, Carlos Bernal-Cárdenas, Daniel McCrystal, Denys Poshyvanyk, Chris Shenefiel, Jeff Johnson (2020): Improving the effectiveness of traceability link recovery using hierarchical bayesian networks, In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering, doi:10.1145/3377811.3380418
- Joanna C. S. Santos, Ali Shokri, Mehdi Mirakhorli (2020): Towards Automated Evidence Generation for Rapid and Continuous Software Certification, In: 2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW), doi:10.1109/issrew51248.2020.00087
- Zhiyuan Zou, Bangchao Wang, Hongyan Wan, Huan Jin, Xiaoxiao Li, Yukun Cao (2024): HANTracer: Leveraging Heterogeneous Graph Attention Network for Large-Scale Requirements-Code Traceability Link Recovery, In: 2024 31st Asia-Pacific Software Engineering Conference (APSEC), doi:10.1109/apsec65559.2024.00032
- Jiakun Liu, Haoxiang Zhang, Xin Xia, David Lo, Ying Zou, Ahmed E. Hassan, Shanping Li (2021): An exploratory study on the repeatedly shared external links on Stack Overflow, In: Empirical Software Engineering 1(27), doi:10.1007/s10664-021-10028-y
- Carlos Gavidia-Calderon, Federica Sarro, Mark Harman, Earl T. Barr (2021): The Assessor's Dilemma: Improving Bug Repair via Empirical Game Theory, In: IEEE Transactions on Software Engineering 10(47), doi:10.1109/tse.2019.2944608
- Zhiyuan Zou, Bangchao Wang, Xinrong Hu, Yang Deng, Hongyan Wan, Huan Jin (2024): Enhancing requirements-to-code traceability with GA-XWCoDe: Integrating XGBoost, Node2Vec, and genetic algorithms for improving model performance and stability, In: Journal of King Saud University - Computer and Information Sciences 8(36), doi:10.1016/j.jksuci.2024.102197
- Davide Falessi, Justin Roll, Jin L.C. Guo, Jane Cleland-Huang (2020): Leveraging Historical Associations between Requirements and Source Code to Identify Impacted Classes, In: IEEE Transactions on Software Engineering 4(46), doi:10.1109/tse.2018.2861735
- Menghan Li, Li Yang, Qing Xia, Mingzhe Fang, Geng Liang, Chun Zuo (2022): STPChain: a Crowdsourced Software Engineering Method for Software Traceability and Fine-grained Privacy Based on Blockchain, In: 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC), doi:10.1109/compsac54236.2022.00135
- Bangchao Wang, Xinyu He, Hongyan Wan, Xiaoxiao Li, Jiaxu Zhu, Yukun Cao (2024): FRELinker: A Novel Issue-Commit Link Recovery Model Based on Feature Refinement and Expansion with Multi-Classifier Fusion, In: 2024 31st Asia-Pacific Software Engineering Conference (APSEC), doi:10.1109/apsec65559.2024.00031
- Bangchao Wang, Zihan Wang, Hongyan Wan, Xingfu Li, Yang Deng (2023): An Empirical Study on Data Balancing in Machine Learning Based Software Traceability Methods, In: 2023 International Joint Conference on Neural Networks (IJCNN), doi:10.1109/ijcnn54540.2023.10191386
- Dominik Fuchß, Tobias Hey, Jan Keim, Haoyu Liu, Niklas Ewald, Tobias Thirolf, Anne Koziolek (2025): LiSSA: Toward Generic Traceability Link Recovery Through Retrieval-Augmented Generation, In: 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE), doi:10.1109/icse55347.2025.00186
- Katherine R. Dearstyne, Alberto D. Rodriguez, Jane Cleland-Huang (2024): Supporting Software Maintenance with Dynamically Generated Document Hierarchies, In: 2024 IEEE International Conference on Software Maintenance and Evolution (ICSME), doi:10.1109/icsme58944.2024.00046
- Wen-Jie Li, Jun Ma, Yan-Yan Jiang, Chang Xu, Xiao-Xing Ma (2024): Understanding and Detecting Inefficient Image Displaying Issues in Android Apps, In: Journal of Computer Science and Technology 2(39), doi:10.1007/s11390-022-1670-3
- Yang Deng, Bangchao Wang, Qiang Zhu, Junping Liu, Jiewen Kuang, Xingfu Li (2024): MTLink: Adaptive multi-task learning based pre-trained language model for traceability link recovery between issues and commits, In: Journal of King Saud University - Computer and Information Sciences 2(36), doi:10.1016/j.jksuci.2024.101958
- Saikat Dutta, Owolabi Legunsen, Zixin Huang, Sasa Misailovic (2018): Testing probabilistic programming systems, In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, doi:10.1145/3236024.3236057
- Tjerk Spijkman, Sabine Molenaar, Fabiano Dalpiaz, Sjaak Brinkkemper (2021): Alignment and granularity of requirements and architecture in agile development: A functional perspective, In: Information and Software Technology, doi:10.1016/j.infsof.2021.106535
- Michael Rath, Mihaela Todorova Tomova, Patrick Mader (2020): SpojitR: Intelligently Link Development Artifacts, In: 2020 IEEE 27th International Conference on Software Analysis, Evolution and Reengineering (SANER), doi:10.1109/saner48275.2020.9054839
- Yanming Yang, Xin Xia, David Lo, Tingting Bi, John Grundy, Xiaohu Yang (2022): Predictive Models in Software Engineering: Challenges and Opportunities, In: ACM Transactions on Software Engineering and Methodology 3(31), doi:10.1145/3503509
- Bangchao Wang, Shouya Hu, Luyao Ye, Hongyan Wan, Zhiyuan Zou, Xiaoxiao Li, Jiaxu Zhu (2024): Advancements in Bug Traceability: A Systematic Mapping Study, In: 2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC), doi:10.1109/smc54092.2024.10831060
- Paul Hübner, Barbara Paech (2020): Interaction-based creation and maintenance of continuously usable trace links between requirements and source code, In: Empirical Software Engineering 5(25), doi:10.1007/s10664-020-09831-w
- Rrezarta Krasniqi (2000): Exploring the Software Quality Maze: Detecting Scattered and Tangled Crosscutting Quality Concerns in Source Code in Support of Maintenance Tasks, doi:10.12794/metadc2332577
- Bangchao Wang, Zhiyuan Zou, Xuanxuan Liang, Huan Jin, Peng Liang (2025): HGNNLink: recovering requirements-code traceability links with text and dependency-aware heterogeneous graph neural networks, In: Automated Software Engineering 2(32), doi:10.1007/s10515-025-00528-2
- Jinfeng Lin, Yalin Liu, Jane Cleland-Huang (2021): Information retrieval versus deep learning approaches for generating traceability links in bilingual projects, In: Empirical Software Engineering 1(27), doi:10.1007/s10664-021-10050-0
- Mihaela Tomova, Martin Hofmann, Constantin Hütterer, Patrick Mäder (2023): Assessing the utility of text-to-SQL approaches for satisfying software developer information needs, In: Empirical Software Engineering 1(29), doi:10.1007/s10664-023-10374-z
- Cleidson R. B. de Souza, Emilie Ma, Jesse Wong, Dongwook Yoon, Ivan Beschastnikh (2024): Revealing Software Development Work Patterns with PR-Issue Graph Topologies, In: Proceedings of the ACM on Software Engineering FSE(1), doi:10.1145/3660813
- Rrezarta Krasniqi, Hyunsook Do (2023): A Hierarchical Topical Modeling Approach for Recommending Repair of Quality Bugs, In: 2023 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), doi:10.1109/saner56733.2023.00014
- Ali Majidzadeh, Mehrdad Ashtiani, Morteza Zakeri-Nasrabadi (2024): Multi-type requirements traceability prediction by code data augmentation and fine-tuning MS-CodeBERT, In: Computer Standards & Interfaces, doi:10.1016/j.csi.2024.103850
- Nelly Bencomo, Jin L.C. Guo, Rachel Harrison, Hans-Martin Heyn, Tim Menzies (2022): The Secret to Better AI and Better Software (Is Requirements Engineering), In: IEEE Software 1(39), doi:10.1109/ms.2021.3118099
- Aaron Schlutter, Andreas Vogelsang (2020): Trace Link Recovery using Semantic Relation Graphs and Spreading Activation, In: 2020 IEEE 28th International Requirements Engineering Conference (RE), doi:10.1109/re48521.2020.00015
- Liming Dong, He Zhang, Wei Liu, Zhiluo Weng, Hongyu Kuang (2022): Semi-supervised pre-processing for learning-based traceability framework on real-world software projects, In: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, doi:10.1145/3540250.3549151
- Alexander Nicholson, Guo Jin L.C. (2021): Issue Link Label Recovery and Prediction for Open Source Software, In: 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW), doi:10.1109/rew53955.2021.00024
- Bangchao Wang, Xingfu Li, Hongyan Wan, Yang Deng (2023): A Systematic Mapping Study of Machine Learning Techniques Applied to Software Traceability, In: 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC), doi:10.1109/smc53992.2023.10394446
- Jinfeng Lin, Yalin Liu, Jane Cleland-Huang (2020): Supporting Program Comprehension through Fast Query response in Large-Scale Systems, In: Proceedings of the 28th International Conference on Program Comprehension, doi:10.1145/3387904.3389260
