Generating a European Portuguese BERT Based Model Using Content from Arquivo.pt Archive

Thumbnail Image

Files

Generating_a_Portuguese_European_BERT_based_model_using_content_from_Arquivo_pt_archive_preprint.pdf (909.81 KB)

Date

2022-11-21

Authors

Journal Title

Journal ISSN

Volume Title

Publisher

Springer International Publishing

Abstract

Building a language model from free available internet information takes several steps and challenges. This new model aims to be a BERT-based language model for Portuguese-European, with no specific context. The corpus was built using a web page archive infrastructure provided by Arquivo.pt and restricted to .pt domains. This paper will describe the overall process of building the corpus and training a BERT model.

Description

Keywords

BERT, Portuguese European, Arquivo.pt

Citation

Miquelina, N., Quaresma, P., Nogueira, V.B. (2022). Generating a European Portuguese BERT Based Model Using Content from Arquivo.pt Archive. In: Yin, H., Camacho, D., Tino, P. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2022. IDEAL 2022. Lecture Notes in Computer Science, vol 13756. Springer, Cham. https://doi.org/10.1007/978-3-031-21753-1_28

URI

http://hdl.handle.net/10174/34684

Collections

INF - Publicações - Capítulos de Livros
driver

Endorsement

Review

Supplemented By

Referenced By