Publicação
UMAP-SMOTENC: an efficient and consistent alternative for fully synthetic data generation
| dc.contributor.advisor | Bação, Fernando José Ferreira Lucas | |
| dc.contributor.author | Almeida, Gonçalo de | |
| dc.date.accessioned | 2023-02-10T11:25:31Z | |
| dc.date.available | 2024-01-24T01:31:41Z | |
| dc.date.issued | 2023-01-24 | |
| dc.description | Dissertation presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics, specialization in Business Analytics | pt_PT |
| dc.description.abstract | The intensification of governmental legislation and the social awareness around data privacy protection severely constrains organizations' data utilization capabilities. As a result, the interest in data anonymization techniques, that ideally should preserve the patterns present on the original data but mitigate the risks of privacy leakage, has also been on the rise. While conventional methods have shown to compromise privacy, recently proposed deep learning generative approaches are computationally expensive and unreliable when used in tabular datasets, hindering the democratization and usability of data. In this paper, we explore this trade-off between privacy and the quality of the anonymized data, establishing a new equilibrium obtained using a synthetic oversampling technique, SMOTE-NC, on a non-linear compressed version of the input space, achieved with the use of UMAP. The introduced approach was developed to provide an efficient and consistent solution that can be used without significant efforts on hyperparameter tuning or resourcing to massive computing infrastructures. To evaluate the robustness of the proposed solution, an experiment was conducted comparing several metrics and models across eight datasets with diverse characteristics. The results achieved suggest that the presented method can efficiently synthesize privacy-aware data while conserving the relevant patterns of the real dataset, particularly those required for machine learning-based classification tasks. | pt_PT |
| dc.identifier.tid | 203220196 | pt_PT |
| dc.identifier.uri | http://hdl.handle.net/10362/148985 | |
| dc.language.iso | eng | pt_PT |
| dc.subject | Anonymization Techniques | pt_PT |
| dc.subject | Machine Learning | pt_PT |
| dc.subject | SMOTE | pt_PT |
| dc.subject | Synthetic Data Generation | pt_PT |
| dc.subject | UMAP | pt_PT |
| dc.title | UMAP-SMOTENC: an efficient and consistent alternative for fully synthetic data generation | pt_PT |
| dc.type | master thesis | |
| dspace.entity.type | Publication | |
| rcaap.embargofct | "(…) ter a possibilidade de elaborar e publicar um artigo numa revista científica com base na dissertação de mestrado." | pt_PT |
| rcaap.rights | embargoedAccess | pt_PT |
| rcaap.type | masterThesis | pt_PT |
| thesis.degree.name | Mestrado em Ciência de Dados e Métodos Analíticos Avançados, especialização em Métodos Analíticos para a Gestão | pt_PT |