A carregar...
Publicação
Evaluating No-Code AI Knowledge Assistants: Vector Database-Driven Chatbots for Digital Transformation in Enterprises
| Nome: | Descrição: | Tamanho: | Formato: | |
|---|---|---|---|---|
| 925.44 KB | Adobe PDF |
Autores
Orientador(es)
Resumo(s)
This thesis examines whether no-code platforms can support the development of effective knowledge assistants for enterprise environments by designing and evaluating a Retrieval-Augmented Generation (RAG) system. The study addresses the problem of information fragmentation, where employees struggle to find reliable guidance across dispersed documents. The prototype integrates workflow orchestration, cloud document monitoring, vector database storage, and language models to automate document ingestion, semantic retrieval while excluding archived content, and response generation with safeguards against unrelated queries. The system was evaluated using 24 UK government policy documents and 21 structured queries covering factual recall, synthesis, negative testing, and document lifecycle scenarios, achieving an average accuracy score of 4.67 out of 5.0 and a relevance score of 5.0 out of 5.0 via LLM-as-judge evaluation. The design includes continuous synchronization between cloud storage and the vector database, metadata-driven document management, a two-stage retrieval process combining vector search with semantic prioritization, and structured error logging, all implemented through visual workflows without custom code. The results indicate that such systems can be implemented using no-code tools under controlled conditions, although limitations remain regarding optical character recognition for scanned documents, role-based access control, and validation in multi-user settings. The study suggests that design choices related to orchestration, metadata structure, and document lifecycle management play an important role in system performance alongside the underlying language models, and it provides a reproducible approach for developing enterprise knowledge systems using visual development tools.
Descrição
Dissertation presented as the partial requirement for obtaining a Master's degree in Information Management, specialization in Digital Transformation
Palavras-chave
No-Code Artificial Intelligence Digital Transformation Retrieval-Augmented Generation Vector Database Knowledge Management