python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - word2vec

How to get vocabulary size of word2vec?

I have a pretrained word2vec model in pyspark and I would like to know how big is its vocabulary (and perhaps get a list of words in the vocabulary). Is this possible? I would guess it has to be store...
test-img

Luca Clissa

machine-learning

pyspark

nlp

word2vec

apache-spark-ml

Votes: 0

Answers: 1

Latest Answer

Not quite sure why you doubt the result of .getVectors().count(), which gives the desired result indeed, as shown in the documentation link you have provided yourself. Here is the example posted there...
test-img

desertnaut

gensim w2k - additional file

I trained w2v on rather big (> 200 million sentences) corpus, and got, in addition to file w2v_model.model, files: w2v_model.model.trainables.syn1neg.npy and w2v.model_model.wv.vectors.npy. Model f...
test-img

Yury Gubman

gensim

word2vec

Votes: 0

Answers: 1

Latest Answer

If a .save() is creating any files with the word trainables in it, you're using a older version fo Gensim. Any new training should definitely prefer using a current version. As of now (January 2022), ...
test-img

gojomo

Find translations of a given word in the corpus e.g. by machine learning, word2vec, text mining

I am using this thread to get some ideas and find some possibilities. I have about 1000 sermons and their translations into another language. The lengths of the sermons are different. These are religi...
test-img

para

machine-learning

text-mining

word2vec

language-translation

machine-translation

Votes: 0

Answers: 2

Latest Answer

To get the translation for a specific word in a sentence, you can use what’s called word alignment. To get the quality of the translation, you can use what’s called quality estimation. machinetranslat...
test-img

Adam Bittlingmayer

Save torch running model using Pycharm

Currently, I have trained a word2vec model using https://towardsdatascience.com/implementing-word2vec-in-pytorch-skip-gram-model-e6bae040d2fb. I am already training the data and I have to save the run...
test-img

raunak rathi

python-3.x

pytorch

pycharm

word2vec

Votes: 0

Answers: 0

Posts

Questions

Blogs

Jobs