Generating a European Portuguese BERT Based Model Using Content from Arquivo.pt Archive

dc.contributor.authorMiquelina, Nuno
dc.contributor.authorQuaresma, Paulo
dc.contributor.authorNogueira, Vitor
dc.contributor.editorYin, Hujun
dc.contributor.editorCamacho, David
dc.contributor.editorTino, Peter
dc.date.accessioned2023-02-24T12:10:28Z
dc.date.available2023-02-24T12:10:28Z
dc.date.issued2022-11-21
dc.description.abstractBuilding a language model from free available internet information takes several steps and challenges. This new model aims to be a BERT-based language model for Portuguese-European, with no specific context. The corpus was built using a web page archive infrastructure provided by Arquivo.pt and restricted to .pt domains. This paper will describe the overall process of building the corpus and training a BERT model.por
dc.identifier.authoremailNuno José Miquelina <d37384@alunos.uevora.pt>
dc.identifier.authoremailpq@uevora.pt
dc.identifier.authoremailvbn@uevora.pt
dc.identifier.citationMiquelina, N., Quaresma, P., Nogueira, V.B. (2022). Generating a European Portuguese BERT Based Model Using Content from Arquivo.pt Archive. In: Yin, H., Camacho, D., Tino, P. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2022. IDEAL 2022. Lecture Notes in Computer Science, vol 13756. Springer, Cham. https://doi.org/10.1007/978-3-031-21753-1_28por
dc.identifier.doihttps://doi.org/10.1007/978-3-031-21753-1_28por
dc.identifier.scientificarea498por
dc.identifier.urihttp://hdl.handle.net/10174/34684
dc.language.isoporpor
dc.publisherSpringer International Publishingpor
dc.rightsopenAccesspor
dc.subjectBERTpor
dc.subjectPortuguese Europeanpor
dc.subjectArquivo.ptpor
dc.titleGenerating a European Portuguese BERT Based Model Using Content from Arquivo.pt Archivepor
dc.typebookPartpor

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Generating_a_Portuguese_European_BERT_based_model_using_content_from_Arquivo_pt_archive_preprint.pdf
Size:
909.81 KB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
3.89 KB
Format:
Item-specific license agreed upon to submission
Description: