Towards an evolutionary-based approach for natural language processing

Manzoni, Luca; Jakobovic, Domagoj; Mariot, Luca; Picek, Stjepan; Castelli, Mauro

http://hdl.handle.net/10362/105724

Utilize este identificador para referenciar este registo.

Nome:	Descrição:	Tamanho:	Formato:
Towards_evolutionary_based_approach_natural_language_processing.pdf		1.45 MB	Adobe PDF	Ver/Abrir

Contacte-nos

Autores

Resumo(s)

Tasks related to Natural Language Processing (NLP) have recently been the focus of a large research endeavor by the machine learning community. The increased interest in this area is mainly due to the success of deep learning methods. Genetic Programming (GP), however, was not under the spotlight with respect to NLP tasks. Here, we propose a first proof-of-concept that combines GP with the well established NLP tool word2vec for the next word prediction task. The main idea is that, once words have been moved into a vector space, traditional GP operators can successfully work on vectors, thus producing meaningful words as the output. To assess the suitability of this approach, we perform an experimental evaluation on a set of existing newspaper headlines. Individuals resulting from this (pre-)training phase can be employed as the initial population in other NLP tasks, like sentence generation, which will be the focus of future investigations, possibly employing adversarial co-evolutionary approaches.

Descrição

Manzoni, L., Jakobovic, D., Mariot, L., Picek, S., & Castelli, M. (2020). Towards an evolutionary-based approach for natural language processing. In GECCO 2020: Proceedings of the 2020 Genetic and Evolutionary Computation Conference (pp. 985-993). (GECCO 2020 - Proceedings of the 2020 Genetic and Evolutionary Computation Conference). Association for Computing Machinery. https://doi.org/10.1145/3377930.3390248