INCM & Nova Sbe PBL project - retirement law query system: using top ranking to improve user experience in a semantic search system

Abstract

This study measures how Portuguese BERT performs as a semantic search system for the Portuguese Retirement Law by comparing the proposed solution answers with a test set. The study also envision edhowa feedback method (Top-Ranking)would be implemented in the developed system. This solution aimed to reorder the questions returned by the mode l based on semantic similarity. The semantic search solution showed positive results, but the Top-Ranking method failed to be implemented as the metric for semantic similarity delivered inconsistent results, thus failing to provide a solid structure for such system. The client showed very positive feedback regarding the developed tool, especially when comparing it with the current implemented solution. This project showed that Portuguese BERT is a tool with a lot of potential for semantic search on various other domains.