Volume 1 Issue 1
1. Natural Language Processing in the Age of Foundation Models: From BERT to GPT-5
Natural Language Processing (NLP) has transformed from systems relying on handcrafted linguistic knowledge and co-occurrences, to statistical approaches with feature-based pattern matching, and recently into a paradigm shift based on foundations models—large scale pre-trained architectures learning representations over large amounts of data in an unsupervised way expected to capture general properties of the language across task and domain.