Main Challenges for Word Embeddings: Part II

Main Challenges for Word Embeddings: Part II

The use of word embeddings has become the standard approach for dealing with text input in AI models. While an extensive research has been carried out during these years to analyze all theoretical underpinnings of algorithms such as word2vec, fastText and BERT, it is...
Main Challenges for Word Embeddings: Part I

Main Challenges for Word Embeddings: Part I

In recent years, word embeddings have become the de facto input layer for virtually all AI-based NLP tasks. While they have undoubtedly allowed text-based AI to advance significantly, not much effort has gone towards examining the limitations of using them in...