English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Tools annual

Global: Zendy Free Plan

Global: Zendy Tools monthly

Global: Zendy Plus monthly

Language representation learning is a vital field in Natural Language Processing (NLP) that aims to capture the intricate semantics and contextual information of text. With the advent of deep learning and neural network architectures, representation learning has revolutionized the NLP landscape. However, the majority of research in this field has concentrated on resource-rich languages, putting Low-Resource Languages (LRL) at a disadvantage due to their limited linguistic resources and the absence of pre-trained models. This paper addresses the significance of language representation learning in a low-resource language, Greek, and its impact on various downstream tasks that heavily rely on semantically and contextually enriched language representations. Accurate classification requires an understanding of nuanced linguistic cues and contextual dependencies. Effective representations bridge the gap between raw text data and classification models, encoding semantic meaning, syntactic structures, and contextual information. By leveraging various representation learning techniques using Transformer-based Language Models (LM), such as domain-adaption and contrastive learning, we aim to enhance the performance of text classification in this LRL setting. We explore the challenges and opportunities in developing effective representations and propose a multi-stage LM pre-training and meta-learning approach to improve performance in classification downstream tasks. The proposed approach was evaluated on Greek expert-annotated texts from social media posts, news articles, press text clippings and internet articles such as blog posts and opinion pieces. The results show significant improvements in the classification effectiveness of each task in terms of micro-averaged F1-score in sentiment, irony, hate speech, emotion and three custom classification tasks.

From Pre-training to Meta-Learning: A journey in Low-Resource-Language Representation Learning