Questions tagged [sigmoid-curve]

A sigmoid function is a mathematical function having a characteristic "S"-shaped curve or sigmoid curve. Often, sigmoid function refers to a special case of the logistic function. It is closely related to the logistic regression.

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

How does Keras Evaluate handle Multilabel Sigmoid Problems

As I am working on tuning a model multilabel densely connected model, I am realizing that I don't understand how the model is being evaluated. My current model has 20 potential labels and ends with a ...
0
votes
1answer
56 views

Logistic growth curve with R nls

I would like to fit a model 'logistic-growth' or 'sigmoid growth' per exercise 'Try It #3' over on this online textbook (almost halfway down the page): \begin{array}{|c|c|c|c|} \hline \text{Year}&...
1
vote
0answers
57 views

R fit a logistic regression of the form $y=\frac{c}{1+ae^{-bx}}$ [duplicate]

I'm working through some textbook exercises on fitting models to data, including exponential, logarithmic and now logistic regression. About a 3rd of the way down this page is the section on logistic ...
3
votes
1answer
16 views

Binary classification of each column in an image

I have a problem where I wish to classify each column in an image of a feature being present (1) or absent (0) in each column. The output of the model should be a vector of size of the width of an ...
0
votes
0answers
17 views

What is the extension(or generalisation) of the sigmoid function to non-binary classification? [duplicate]

I understand that one of the main points of using the sigmoid function on responses in binary classification is that we can interpret value outputted as the probability that an instance belongs to 1 ...
1
vote
0answers
16 views

Sigmoid confidence curves in logistic regression

I have a logistic regression model that predicts the probability of an outcome based on one input variable. I am able to plot the curve just fine and show my group how the probability is predicted to ...
0
votes
0answers
16 views

Measuring how much each data point contributes to the output of a sigmoid function

I am not sure I am asking this on the right place, if not, please redirect me :) So I am dealing with the following problem. I have a set of data points (local shapely values), and I sum them up and ...
0
votes
0answers
17 views

Dependency of the activation function in gradient descent calculations

I am working on linear classification script that uses gradient descent to do a binary classification of an object based on two features. I'm working with just a neuron. The output of the neuron uses ...
0
votes
1answer
36 views

Rounding output of sigmoid for binary linear classifier

I am working on a linear classifier with expected output to be 1 for class A belonging and 0 for class B belonging. The output, in some occasions is nearly 0 (...
1
vote
0answers
30 views

How to model a sigmoid function? [closed]

I have a variable where Y ~ sigmoid(X). Y ranges between 0 and 1. Y, however, is not a probability, so I don't know if I can just get a logistic regression. What I do want is, for a change in X, ...
0
votes
0answers
17 views

How is an 'ogival function' defined?

Reading on a paper on factor analysis and measurement invariance I find the description of some functions as 'ogival' functions. In Google I find it referenced mostly in papers from the '70s and '80s....
0
votes
0answers
22 views

Backpropagation With Sigmoid Output Function Question

I am deriving a Weight update for a simple toy network with a Sigmoid Output Layer. I need some help double checking my math to make sure I did it correctly. I am using Cross-Entropy Loss as my Loss ...
0
votes
0answers
15 views

Strange situation with softmax activation vs sigmoid activation in the last layer of a binary classification problem?

I am building a neural network as a binary classifier with one output neuron at the last output layer. I deliberately balancing out my train label so that the number label corresponding to the binary ...
0
votes
0answers
22 views

Conceptual explanation of taking derivative of sigmoid function in neural network

In a neural network, we have a bunch of inputs and corresponding weights + a bias which are represented by a multivariable equation. Now we squash this whole equation with a sigmoid function. How ...
0
votes
0answers
168 views

Why is learning slower for a sigmoid activation function in a neural network?

Andrew Ng in one of his deep learning course videos says that the sigmoid function acts as a slow learner in a neural network. My intuition is that the sigmoid as an activation function contributes ...
1
vote
1answer
85 views

Statistical comparison of numerous nonlinear model parameters

I have 84 data sets (n=3) corresponding to 28 conditions (sample composition and temperature) and have fit my data set to the following nonlinear model using MATLAB nonlinear curve fitting: $$y = \...
1
vote
0answers
38 views

the loss suddenly was stuck to a very large value after having several epoch

When I changed the final activation layer in the same model from softmax to sigmoid in order to multilabel classification, the loss would suddenly get stuck at a very big value after several epoch. I ...
2
votes
1answer
443 views

Neural Network: Matlab uses different activation functions for different layers - why?

I have trained on matlab an Artificial Neural Network with one input layer, one hidden layer and one output layer (my output is values between zero and one, which I turn into 0 or 1 according to a ...
1
vote
1answer
613 views

Normalizing continuous features using sigmoid function

Can you use the sigmoid function to normalize continuous features that have no theoretical maximum value but tend to cluster around [-1, 1]? Although using the sigmoid function would be a non-linear ...
1
vote
0answers
85 views

Can binary cross entropy loss be used for non-binary data? [duplicate]

I am following this keras tutorial to construct a convolutional MNIST autoencoder. The decoder has a sigmoid activation function and the entire autoencoder is trained with binary_crossentropy loss. ...
0
votes
1answer
355 views

Sigmoid function calculation range

I know that for big datasets we should try to consider calculations effort and try to minimize execution speed if it does not harm quality. In many models, like regression, neural network, probably ...
0
votes
0answers
43 views

How cost function of Logistic Regression is derived? [duplicate]

How the cost function of logistic regression given below is derived ? Here Sigmoid function is used for logistic regression. After heavy search on internet i have come up here to put on my question , ...
0
votes
0answers
84 views

Understanding interpolation results in a sigmoid regression

I have a doubt about the results I got from an interpolation even though it was performed by a statistical software (SigmaPlot). I have the variable X that is the time expressed in hours and the ...
0
votes
0answers
73 views

Calculate LC50 from a non-sigmoid dose response curve

Is it possible to calculate LC50 (concentration that is lethal for 50% of the test organisms), when my dataset does not have a sigmoid dose response curve? For my experiment, I had 6 treatments ...
2
votes
1answer
54 views

Can we use perceptron training algorithm to train a single neuron with sigmoid activation?

The perceptron training algorithm is summarized as: Apply the inputs and calculate the output $ y $ Compare with the desired output yd and calculate error $e = y-y_d$ Update the weights based on the ...
0
votes
0answers
12 views

How is the output bias decided when using sigmoids to approximate functions

In this link : http://neuralnetworksanddeeplearning.com/chap4.html It has been said that, to approximate functions, the output bias has to be (−m+1/)h. Here is a snapshot of that part: I do ...
0
votes
2answers
147 views

How to normalize the output of a neural network [duplicate]

We have a VGG16 network trained from scratch with a Sigmoid output function. We have 6 classes and the usual output looks like this: ...
0
votes
2answers
520 views

With Sigmoid activation and Softmax normalization with cross entropy, are we fitting distributions?

Let's consider I have a multi layer neural network that is doing multi class classification. So each input sample belongs to one on N classes. Now, lets say the last layer has Sigmoid activation ...
0
votes
1answer
199 views
0
votes
1answer
221 views

Glorot/ Xavier Init: for sigmoid and tanh?

My question is about Xavier Glorot Init. The assumptions that they make are that they approximate the activation function linearly, that this function has f'(0) = 1 and that we set the bias to 0, as ...
4
votes
1answer
403 views

Is there something like softmax but for top k values?

I have a dataset with binary labels of which exactly k outputs are 1, on which I want to train a neural network. If k=1, softmax can do the job of representing the output distribution. I am interested ...
3
votes
2answers
84 views

What is the interpretation of the “C” parameter in the five parameters logistic curve?

I'm using the following equation for the 5-parameters logistic curve: $$ y = A + \frac{D-A}{\Bigl(1+\exp\bigl(B(C-x)\bigr)\Bigr)^S} $$ What is the interpretation of the $C$ parameter? I found some ...
1
vote
1answer
210 views

Generate odds ratios across deciles / quantiles of an indpendent variable

With reference to the following figure from Bellomo et al., 2011: How exactly are the odds ratios across the deciles 'referenced against the 4th decile' calculated? My initial impression is that a ...
3
votes
0answers
106 views

How to aggregate calibration curves which were created in cross validation?

When looking into Scikit's CalibratedClassifierCV I noticed that the object needs to keep multiple calibrated classifiers in memory to average the results in real time. I understand that these ...
0
votes
3answers
166 views

Can the vanishing gradient problem be solved by multiplying the input of tanh with a coefficient?

To my understanding, the vanishing gradient problem occurs when training neural networks when the gradient of each activation function is less than 1 such that when corrections are back-propagated ...
9
votes
3answers
2k views

Logistic function with a slope but no asymptotes?

The logistic function has an output range 0 to 1, and asymptotic slope is zero on both sides. What is an alternative to a logistic function that doesn't flatten out completely at its ends? Whose ...
0
votes
0answers
256 views

How can I even out the output of the sigmoid function?

I'm applying a sigmoid function to an array of values but the output is very concentrated near 1 (i.e. 25th percentile is 0.999). I think this is because the input array takes on values that are quite ...
2
votes
1answer
136 views

Is there a Gaussian Process Kernel that limits functions to sigmoids?

I am modeling a large number of Dose-response curves. I have strong reason to believe that the generating function will be sigmoidal against the concentration of the assay (Michaelis-Menten kinetics). ...
1
vote
1answer
371 views

Counting the number of neural network parameters [duplicate]

I am slightly confused by counting the number of NN parameters. Let's assume there is a NN with 4-dim vector as an input, then comes 5-dim hidden layers, and another one 6-dim hidden layer. There is a ...
0
votes
1answer
650 views

How to convert IRT theta score to a percentage score

I am trying to implement an adaptive test using 3PL IRT model. We need to screen the candidates and label their expertise as ...
2
votes
2answers
3k views

When is logit function preferred over sigmoid?

I found out that logit and sigmoid functions are inverse of one another, and are used in binary classification, but is there a preference of one over another in any circumstances, or can they be used ...
1
vote
0answers
43 views

Does mixture of sigmoids make sense given the theories about mixture of bernoullis?

Mixture of bernoullis is the combination of bernoulli distributions, which can be illustrated by the sampling process of K bags of D coins, here is a quick tutorial about it https://cedar.buffalo.edu/~...
3
votes
2answers
3k views

Softmax weights initialization

I am a new to deep learning and neural networks, and I need to know if there is a good weights initialization method to use if the activation function is Softmax like Tanh, ReLU and Sigmoid. Related ...
0
votes
1answer
578 views

Compare two sigmoid shape curves

I have x and y-values for two sigmoid curves (probit). x-values are the same for both curves,...
3
votes
1answer
1k views

Does it make sense to use `logit` or `softplus` loss for binary classification problem?

With $z$ is the logit, $p \in \{1, 0\}$ is the class. Usually binary classification problem use sigmoid and cross-entropy to compute loss: $$\mathcal{L_1} = - \sum{p \log \sigma(z) + (1-p) \log (1-\...
4
votes
0answers
274 views

Has Arcsinh ever been considered as a neural network activation function?

The function $y = arcsinh(x)=ln(x+\sqrt{x^2+1})$ has some nice features that I could imagine being useful as an activation function in a neural network. It has sigmoid behaviour around zero, but far ...
2
votes
2answers
628 views

Question about Sigmoid Function in Logistic Regression

This is with reference with Andrew Ng's video on Logistic Regression, I just want to confirm a small doubt I have. I get the basic idea of Logistic Regression that $z=\theta^Tx$ Where $\theta$= ...
2
votes
0answers
121 views

How does Bayes' rule on two exponentials suggest a sigmoid?

In Platt's 1999 paper on turning support vector machine output into a probabilistic score, he says Bayes rule on two exponentials suggests using a parametric form of a sigmoid where he cites this ...
6
votes
1answer
4k views

Finding the slope at different points in a sigmoid curve

This is my data. x <- c(0.5,3.0,22.2,46.0,77.3,97.0,98.9,100.0) plot(x, pch = 19) I want to fit a curve through these points and then calculate the slope at ...
6
votes
3answers
2k views

Why do we use the natural exponential in logistic regression?

I would like to intuitively understand the benefit of using the natural exponential in the sigmoid function used in logistic regression. Why should it have to be $e^x$ instead of, for example $2^x$?