python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - torchtext

NLP: How to look at sentence encoding in torchtext?

TEXT = data.Field(tokenize = 'spacy', tokenizer_language = 'en_core_web_sm', include_lengths = True) LABEL = data.LabelField(dtype = torch.float) train_data, test...
test-img

Piggy Wenzhou

torchtext

Votes: 0

Answers: 1

Latest Answer

One way you can accomplish this is using the __getitem__ functionality. Check the docs here. You pass in a string/token as a parameter (e.g. vocab['cat']) and it will give you the index of the token i...
test-img

KGM

Unable to create a custom torchtext BucketIterator

I'm trying to create a POS tagger with LSTM and I'm facing some difficulties with preparing the data. I've successfully followed a guide that used the following code to prepare the data itertors: TEXT...
test-img

EyalG

nlp

dataset

pos-tagger

pytorch-dataloader

torchtext

Votes: 0

Answers: 1

Latest Answer

Took me a while but I found a solution. To create a torchtext dataset with input data as lists, use SequenceTaggingDataset (from torchtext.legacy.datasets.SequenceTaggingDataset) but you need to do a ...
test-img

EyalG

Save and load vocab and weight for torchtext to do inference

I have followed this example to build a text classifier using torchtext. After finishing training, I've saved vocab and weights, but when I've loaded them again to make an inference with validation da...
test-img

Angelus

text

pytorch

lstm

torchtext

Votes: 0

Answers: 1

Latest Answer

A few thoughts: First, I'd suggest checking your model with a validation data set directly. Rather than saving everything and loading it again, simply use the model you've created and run it on a vali...
test-img

KGM

Posts

Questions

Blogs

Jobs