Questions tagged [loss]

Question 1

I am trying to fine-tune a transformer/encoder based pose estimation model available here at: https://huggingface.co/docs/transformers/en/model_doc/vitpose When passing "labels" attribute to ...

Question 2

My dataset consists of 5625 Arabic examples and 5625 synsets, and my model is CNN followed by a sigmoid classification layer. I constructed this 5625 synsets to 5625 classes, and my predicted output ...

Question 3

If I would do loss = loss/10 before calculating the gradient would that change the amount of change applied to the model parameters during back propagation? Or is ...

Question 4

The below function is applied as a filtering procedure for a set of clients that are represented by accuracy values. where accuracy is used to measure the model’s performance. So, my question is: If ...

Question 5

Hi Community and thanks in advance for the help. I am working on transfer learning - specifically GoogLeNet model with the Food101 Dataset. Code is below. I think everything is in order from data ...

Question 6

In my Machine Learning intro course I made several scatter plots of predictions for the california housing data set. Here is the most complete of them (created by a pipe using a sklearn StandardScaler ...

Question 7

...

Question 8

if we have a loss like this plot, is it kind of underfitting or goodfitting? Error results: Training Process:

Question 9

Reading the InstructGPT paper(which seems to be what ChatGPT was built off of), I found this equation for the reward function. However, I'm struggling to understand how this equation is used to ...

Question 10

I am trying to understand Perplexity within Natural Language Processing as a metric more fully. And I am doing so by creating manual examples to understand all the component parts. Is the following ...

Question 11

I have a problem. I have trained a model. And as you can see, there is a zigzag in the loss. In addition, the validation loss is increasing. What does this mean if you only look at the training curve? ...

Question 12

As the title I asked. For example: a model that predicts the probability of a stock price rising/falling. Let's say this is a triple-classification problem. If it predicts "RISING", while ...

Question 13

I've created an LSTM model to predict 1 output value from 8 features. My loss constantly decreases and my val loss also decreases from the start, however it begins to increase after so many epochs. ...

Question 14

I'm reading this paper and I don't understand why the squared L2-norm is also multiplied by 0.5 in the loss. They want a loss that measures the distance between two feature maps. Why don't they use ...

Question 15

I am working on the classification problem where by I am having a hinge loss function + other loss terms to optimize for which the input is the output from tanh layer at the end. But I can't reveal ...

Stack Exchange Network

Questions tagged [loss]

Loss while fine tuning a transformer based pose estimation model not reducing

What loss function can I use?

Does reducing the loss change the amount of change during backpropagation?

How do I use loss instead of accuracy in the formula?

Transfer Learning - GoogLeNet - Training Times || Loss not converging || Pytorch

What does a correlation between predictions of training data and predictions of validation data tell me?

I can't understand why the validation and training loss almost constant and not converging?

flat validation loss (underfitting or goodfitting)

How Does the Reward Model in ChatGPT Calculate Losses?

Calculationg perplexity (in natural language processing) manually

What does that mean if the loss looks like this?

Is there a way I can double the punishment when model mis-classing to a specific class?

Val loss initially decreases, then increases

Why is there a 0.5 in this loss?

training loss decreases but training accuracy is also decreasing with epochs

Hot Network Questions