A carregar...
Publicação
Dashboards para controlo de qualidade de dados: Comparação entre dados de títulos do BCE e do BDP
| Nome: | Descrição: | Tamanho: | Formato: | |
|---|---|---|---|---|
| 2.58 MB | Adobe PDF |
Autores
Orientador(es)
Resumo(s)
Século XXI, era da tecnologia e da inovação, através das quais profissões são substituídas e tarefas são otimizadas. Existem diversas atividades cuja maneira de executar ou cujos mecanismos eram apropriados em tempos anteriores, mas que se tornaram obsoletos e que foram ou estão a ser alvo de reestruturações. Nos dias de hoje torna-se natural passar do analítico para o digital, e dentro do digital a evolução parece não ter fim.
Estando enquadrado na área de microdados, associada irmãmente a Big Data, a informação a analisar é de grande dimensão, em quantidade e detalhe, requerendo, portanto, ferramentas e processos ágeis e otimizados para a recolha, processamento, análise e visualização dos dados. Através destes processos é possível efetuar e garantir o controlo de qualidade, mas também, sumarizar a “história” que a informação nos conta, partilhando e disseminando o conhecimento.
Durante a realização do estágio, foi-me proposto a criação de uma ferramenta de Business Intelligence para facilitar a comparação de dados entre o Banco de Portugal e o Banco Central Europeu, relativos às emissões de títulos de dívida e ações cotadas de entidades residentes em Portugal.
Antes da implementação da ferramenta, os dados comparados eram restritos aos de maior importância e existiam dois principais focos de problemas: 1) não era possível ter uma visão geral das diferenças globais e 2) a forma de verificar diferenças específicas era morosa e trabalhosa. A criação de um dashboard que permite a visualização dos dados como um todo, com filtragens e mecanismos que permitem identificar diferenças, permite um maior controlo da qualidade dos dados, de forma interativa e facilitada.
The 21st century is the age of technology and innovation, through which professions are being replaced and tasks optimized. There are a number of activities whose way of doing things or whose mechanisms were appropriate in earlier times, but which have become obsolete and are being or have been restructured. Nowadays it's natural to move from analytics to digital, and within digital the evolution seems to be never-ending. Being part of the microdata area, associated with Big Data, the information to be analyzed is large in quantity and detail and therefore requires agile and optimized tools and processes for collecting, processing, analyzing and visualizing data. Through these processes it is possible to carry out and guarantee quality control, but also to summarize the "story" that the information tells us, sharing and disseminating knowledge. During my internship, I was asked to create a Business Intelligence tool to facilitate the comparison of data between the Bank of Portugal and the European Central Bank, relating to the issuance of debt securities and listed shares of entities resident in Portugal. Before the tool was implemented, the data compared was restricted to the most important. There were two main problem areas: it wasn't possible to get an overview of global differences and it was time-consuming and labor-intensive to check for specific differences. The creation of a dashboard that allows data to be visualized as a whole, with filtering and mechanisms that allow differences to be identified, allows for greater control of data quality, in an interactive and easy way.
The 21st century is the age of technology and innovation, through which professions are being replaced and tasks optimized. There are a number of activities whose way of doing things or whose mechanisms were appropriate in earlier times, but which have become obsolete and are being or have been restructured. Nowadays it's natural to move from analytics to digital, and within digital the evolution seems to be never-ending. Being part of the microdata area, associated with Big Data, the information to be analyzed is large in quantity and detail and therefore requires agile and optimized tools and processes for collecting, processing, analyzing and visualizing data. Through these processes it is possible to carry out and guarantee quality control, but also to summarize the "story" that the information tells us, sharing and disseminating knowledge. During my internship, I was asked to create a Business Intelligence tool to facilitate the comparison of data between the Bank of Portugal and the European Central Bank, relating to the issuance of debt securities and listed shares of entities resident in Portugal. Before the tool was implemented, the data compared was restricted to the most important. There were two main problem areas: it wasn't possible to get an overview of global differences and it was time-consuming and labor-intensive to check for specific differences. The creation of a dashboard that allows data to be visualized as a whole, with filtering and mechanisms that allow differences to be identified, allows for greater control of data quality, in an interactive and easy way.
Descrição
Internship Report presented as the partial requirement for obtaining a Master's degree in Data Science and Advanced Analytics, specialization in Data Science
Palavras-chave
Business Intelligence Dashboard Visualização de Dados Microdados Controlo de Qualidade Data Visualisation Microdata Quality Control SDG 8 - Decent work and economic growth SDG 9 - Industry, innovation and infrastructure SDG 8 - Trabalho decente e crescimento economico SDG 9 - Inovação infraestrutura