Publicação
Data Profiling in Cloud Migration: Data Quality Measures while Migrating Data from a Data Warehouse to the Google Cloud Platform
| dc.contributor.advisor | Pinheiro, Flávio Luís Portas | |
| dc.contributor.advisor | Figueira, Pedro Santos | |
| dc.contributor.author | Cabral, Andreia Filipa Gonçalves | |
| dc.date.accessioned | 2021-05-13T16:44:16Z | |
| dc.date.available | 2021-05-13T16:44:16Z | |
| dc.date.issued | 2021-05-06 | |
| dc.description | Internship Report presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics | pt_PT |
| dc.description.abstract | In today times, corporations have gained a vast interest in data. More and more, companies realized that the key to improving their efficiency and effectiveness and understanding their customers’ needs and preferences better was reachable by mining data. However, as the amount of data grow, so must the companies necessities for storage capacity and ensuring data quality for more accurate insights. As such, new data storage methods must be considered, evolving from old ones, still keeping data integrity. Migrating a company’s data from an old method like a Data Warehouse to a new one, Google Cloud Platform is an elaborate task. Even more so when data quality needs to be assured and sensible data, like Personal Identifiable Information, needs to be anonymized in a Cloud computing environment. To ensure these points, profiling data, before or after it migrated, has a significant value by design a profile for the data available in each data source (e.g., Databases, files, and others) based on statistics, metadata information, and pattern rules. Thus, ensuring data quality is within reasonable standards through statistics metrics, and all Personal Identifiable Information is identified and anonymized accordingly. This work will reflect the required process of how profiling Data Warehouse data can improve data quality to better migrate to the Cloud. | pt_PT |
| dc.identifier.tid | 202726967 | pt_PT |
| dc.identifier.uri | http://hdl.handle.net/10362/117609 | |
| dc.language.iso | eng | pt_PT |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | pt_PT |
| dc.subject | Data Quality | pt_PT |
| dc.subject | Data Profile | pt_PT |
| dc.subject | Database | pt_PT |
| dc.subject | Data Warehouse | pt_PT |
| dc.subject | Cloud | pt_PT |
| dc.subject | Data Migration | pt_PT |
| dc.subject | Pandas Profiling | pt_PT |
| dc.subject | Personal Identifiable Information | pt_PT |
| dc.title | Data Profiling in Cloud Migration: Data Quality Measures while Migrating Data from a Data Warehouse to the Google Cloud Platform | pt_PT |
| dc.type | master thesis | |
| dspace.entity.type | Publication | |
| rcaap.rights | openAccess | pt_PT |
| rcaap.type | masterThesis | pt_PT |
| thesis.degree.name | Mestrado em Métodos Analíticos Avançados | pt_PT |
Ficheiros
Principais
1 - 1 de 1