Item type:Journal Article,

Kurz erklärt: Measuring Data Changes in Data Engineering and their Impact on Explainability and Algorithm Fairness

Loading...
Thumbnail Image

Fulltext URI

Document type

Text/Journal Article

Additional Information

Date

relationships.isAuthorOf

Klettke, Meike
Lutsch, Adrian
Störl, Uta

Journal Title

Journal ISSN

Volume Title

Publisher

Springer

Abstract

Data engineering is an integral part of any data science and ML process. It consists of several subtasks that are performed to improve data quality and to transform data into a target format suitable for analysis. The quality and correctness of the data engineering steps is therefore important to ensure the quality of the overall process. In machine learning processes requirements such as fairness and explainability are essential. The answers to these must also be provided by the data engineering subtasks. In this article, we will show how these can be achieved by logging, monitoring and controlling the data changes in order to evaluate their correctness. However, since data preprocessing algorithms are part of any machine learning pipeline, they must obviously also guarantee that they do not produce data biases. In this article we will briefly introduce three classes of methods for measuring data changes in data engineering and present which research questions still remain unanswered in this area.

Description

Klettke, Meike; Lutsch, Adrian; Störl, Uta (2021): Kurz erklärt: Measuring Data Changes in Data Engineering and their Impact on Explainability and Algorithm Fairness. Datenbank-Spektrum: Vol. 21, No. 3. DOI: 10.1007/s13222-021-00392-w. Springer. PISSN: 1610-1995. pp. 245-249

Keywords

Data bias, Data engineering pipelines, Degree of data changes, Explainability, Reliability

Citation

URI

Endorsement

Review

Supplemented By

Referenced By


Number of citations to item: 1

  • Márton Kovács, Monica K. Gonzalez, Andreas Archenti (2025): Time-Series Data Curation: Design, Implementation, and Performance Evaluation of a General-Purpose Toolbox, In: IEEE Access, doi:10.1109/access.2025.3628941
Please note: Providing information about citations is only possible thanks to to the open metadata APIs provided by crossref.org and opencitations.net. These lists may be incomplete due to unavailable citation data.source: opencitations.net, crossref.org