python (12.9k questions)

javascript (9.2k questions)

reactjs (4.7k questions)

java (4.2k questions)

java (4.2k questions)

c# (3.5k questions)

c# (3.5k questions)

html (3.3k questions)

Questions - loss

How to apply a function to network output before passing it to the loss?

I'm trying to implement a network in tensorflow and I need to apply a function f to the network output and use the returned value as the prediction to be used in the loss. Is there a simple way to mak...
test-img

Wattera

tensorflow

deep-learning

loss

Votes: 0

Answers: 1

Latest Answer

you should study how to write custom training loops in tensorflow: https://www.tensorflow.org/guide/keras/writing_a_training_loop_from_scratch A simplified and short version could look similar to the ...
test-img

Sascha Kirch

How to collect a loss from all GPU's when using DistributedDataParallel

I implemented parallelized training, but I don't know how to collect losses from each video card and summarize the output loss in a general way. I think it is necessary to explain that the task is mor...
test-img

ShAD

python

deep-learning

pytorch

loss

Votes: 0

Answers: 0

Should we actively use the weight argument in loss functions

Most of the current machine learning libraries have loss functions that comes with a weight argument, which allows us to tackle unbalanced datasets. However should this feature be actively made use of...
test-img

tangolin

pytorch

artificial-intelligence

loss

imbalanced-data

Votes: 0

Answers: 1

Latest Answer

You can use the weighted version of loss functions if you are certain the real world data your model will need to generalize for is similarly imbalanced. If not, you are introducing man-made bias into...
test-img

Kroshtan

Posts

Questions

Blogs

Jobs