Figure 2 - uploaded by Timo Immanuel Denk
Content may be subject to copyright.
Word2vec CBOW model with only one word in the context. Figure source: Rong (2014)

Word2vec CBOW model with only one word in the context. Figure source: Rong (2014)

Source publication
Thesis
Full-text available
Chargrid is a recently proposed approach to understanding documents with 2-dimensional structure. It represents a document with a grid, thereby preserving its spatial structure for the processing model. Text is embedded in the grid with one-hot encoding on character level. With Wordgrid we extend Chargrid by employing a grid on word level. For emb...

Context in source publication

Context 1
... mathematical formulations from above can be interpreted as a neural network, see Figure 2. The input is a one-hot encoded version of the context word, the hidden layer is its vector representation v wc and the output layer yields the probabilities for all vocabulary words. ...