Kurz erklärt: Measuring Data Changes in Data Engineering and their Impact on Explainability and Algorithm Fairness
Fulltext URI
Document type
Additional Information
relationships.isAuthorOf
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Data engineering is an integral part of any data science and ML process. It consists of several subtasks that are performed to improve data quality and to transform data into a target format suitable for analysis. The quality and correctness of the data engineering steps is therefore important to ensure the quality of the overall process. In machine learning processes requirements such as fairness and explainability are essential. The answers to these must also be provided by the data engineering subtasks. In this article, we will show how these can be achieved by logging, monitoring and controlling the data changes in order to evaluate their correctness. However, since data preprocessing algorithms are part of any machine learning pipeline, they must obviously also guarantee that they do not produce data biases. In this article we will briefly introduce three classes of methods for measuring data changes in data engineering and present which research questions still remain unanswered in this area.
Description
Keywords
Citation
URI
Collections
Endorsement
Review
Supplemented By
Referenced By
Number of citations to item: 1
- Márton Kovács, Monica K. Gonzalez, Andreas Archenti (2025): Time-Series Data Curation: Design, Implementation, and Performance Evaluation of a General-Purpose Toolbox, In: IEEE Access, doi:10.1109/access.2025.3628941
