python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - bert-language-model

bert_vocab.bert_vocab_from_dataset taking too long

I'm following this tutorial (https://colab.research.google.com/github/tensorflow/text/blob/master/docs/guide/subwords_tokenizer.ipynb#scrollTo=kh98DvoDz7Jn) to generate a vocabulary from a custom data...
test-img

Kurt

tensorflow

tokenize

bert-language-model

Votes: 0

Answers: 1

Latest Answer

I ran into the same issue. This is how I resolved it: First I checked the number of elements in the dataset: examples, metadata = tfds.load('my_dataset', as_supervised=True, with_info=True) print(meta...
test-img

rebo

Image Captioning model predicts repeated word when using BERT as word embedding layer

I'm currently using this page's code to build image captioning model. The only different is I'm using BERT model's output as word embedding at Decoder part, therefore I have to change some of the orig...
test-img

Gorg

deep-learning

bert-language-model

Votes: 0

Answers: 0

Span-Aste with allennlp - testing against new unseen and unlabeled data

I am trying to use this colab of this github page to extract the triplet [term, opinion, value] from a sentence from my custom dataset. Here is an overview of the system architecture: While I can use...
test-img

KeyPi

deep-learning

sentiment-analysis

bert-language-model

reproducible-research

allennlp

Votes: 0

Answers: 1

Latest Answer

KeyPi, this is a supervised learning model, it needs labelled data for your text corpus in the form sentence(ex: I charge it at night and skip taking the cord with me because of the good battery life ...
test-img

pavani reddy

ValueError: The state dictionary of the model you are trying to load is corrupted. Are you sure it was properly saved?

Goal: Amend this Notebook to work with albert-base-v2 model Kernel: conda_pytorch_p36. Section 1.2 instantiates a model from files in ./MRPC/ dir. However, I think it is for a BERT model, not Albert. ...
test-img

DanielBell99

python

huggingface-transformers

bert-language-model

onnx

huggingface-tokenizers

Votes: 0

Answers: 1

Latest Answer

Exactly what I was looking for, textattack/albert-base-v2-MRPC How to use from the šŸ¤—/transformers library from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoT...
test-img

DanielBell99

Posts

Questions

Blogs

Jobs