Questions tagged [sigmoid-curve]

A sigmoid function is a mathematical function having a characteristic "S"-shaped curve or sigmoid curve. Often, sigmoid function refers to a special case of the logistic function. It is closely related to the logistic regression.

Filter by
Sorted by
Tagged with
0 votes
2 answers
25 views

Is this simple, univariate logistic regression valid?

I am working on a research project. We have roughly 300 study participants that have been categorised into 4 groups. Some of these participants had a recurrence of a disease, and the rest did not. I'm ...
1 vote
1 answer
28 views

Why does SKLearn's Logistic Regression model have the same coefficients as my own model for 1 class but have different coefficients for other classes

I am currently implementing logistic regression from scratch and I'm comparing my model with SKLearn's logistic regression. Since this is just an exercise, I decided to use toy data, specifically ...
  • 11
0 votes
0 answers
19 views

Mean of $t$ in the logistic regression model

The question comes from a sentence of page 208 of Christopher M. Bishop's "Pattern Recognition and Machine Learning". The sentence is excerpted as follows: My questions are mainly two: Why ...
  • 67
0 votes
1 answer
25 views

Define plateau of sigmoid function

I have a sigmoid function ...
  • 1
0 votes
0 answers
21 views

Multiclass (OVR) Logistical Regression on "Surrounded" Classes

I'm trying to understand/visualize how multiclass logistic regression works but most of the examples I've seen concern 3 classes with all of them on the outside. How does logistic regression work when ...
5 votes
1 answer
609 views

Where does the Logistic Distribution get its name?

Having read around on the topic I understand its application as a close approximation of the normal distribution with a nicer mathematical form, but where does its name come from? Is it associated ...
  • 155
1 vote
1 answer
24 views

Reference for Logistic and Sigmoid Kernels

I've been close reading a paper and was mystified when the author mentioned two kernels: The logistic kernel $\frac{1}{e^x + 2 + e^{-x}}$ and the sigmoid kernel $\frac{2}{\pi}\frac{1}{e^x + e^{-x}}$. ...
  • 59
0 votes
0 answers
6 views

Logistic Regression Binary Classification with prediction(with time as variable)

Can we use logistic regression with time as variable for sigmoid function(binary classification prediction)? I have data of this kind: https://i.stack.imgur.com/5GILr.png I want to predict at certain ...
0 votes
0 answers
44 views

confusion about logistic regression and its weights [duplicate]

I have studied Logistic regression and I am still confused about certain things: does logistic regression use linear regression to predict a continuous output, but since linear regression can output ...
0 votes
2 answers
74 views

How does the TI-84 calculate the best fit for a logistic model?

Back in High School I remember the TI-84 calculator allowing the user to enter a few data points and then select from a list of options to find an equation that best fit the data points. One of these ...
1 vote
1 answer
44 views

Impact of change in independent variable on probability in logistic regression

Take the following logistic regression: $$\log(o) = \beta_0 + \beta_1 x + \epsilon$$ We know that increasing $x$ by 1 increases the log-odds of the event by $\beta_1$, and multiply the odds of the ...
3 votes
1 answer
144 views

Why do fixed effects in a logistic regression model differ depending on the presence of a random intercept?

If I have two linear regression models, one with a random intercept and one without (but otherwise identical), the fixed effects in the two models are identical. My understanding is that this stems ...
  • 3,575
0 votes
0 answers
15 views

Multinomial logistic regression decision border - unsure how to understand a scientific paper

I am reading a paper (https://ieeexplore.ieee.org/document/8442470) where the authors used multinomial logistic regression to fill the transition matrix of their markov chain and got nice results. ...
1 vote
1 answer
397 views

How do I find probabilities in logistic regression?

let's assume we have continuous independent variable and obviously binary dependent one. How can we calculate probabilities which is displayed on y-axis? With scale like in the image below, it's clear ...
2 votes
2 answers
676 views

What is a sigmoid function and what does it give as output?

I know the equation of the sigmoid function and use it in logistic regression, SVM, etc. $$ S(x) = \frac{1}{1 + e^{-x}} $$ In the case of the sigmoid function, What is the exact input and output of ...
  • 657
1 vote
1 answer
164 views

Binary classification neural network - equivalent implementations with sigmoid and softmax

in order to solidify my understanding, I am doing some simple calculations with pen and paper for some very simple NN for binary classification (input vector with two entries, 1 hidden layer and just ...
0 votes
0 answers
22 views

Are log-odds a better explanatory variable than a percentage in logistic regression?

I am doing logistic regression with group percentages as a predictor and I'm wondering whether it is better to transform them into log-odds first. My logic is that if I were trying to predict ...
0 votes
1 answer
55 views

Sigmoid equivalent to Softmax exercise 2 [duplicate]

This question is not the same as this one I asked previously. In the previous question I asked to prove that the sigmoid and softmax are equivalent. I found a solution here, but I think it's not ...
0 votes
1 answer
116 views

Sigmoid equivalent to Softmax exercise

I am currently studying the Sutton and Barto Intro To RL Book, and I'm trying to do exercise 2.9 (at the bottom of the following picture): So the exercise wants me to show that the softmax is ...
1 vote
0 answers
26 views

Determine the optimal threshold for sigmoid layer in neural network for binary classification [duplicate]

I have a neural network that gives out a continuous value as output and I need to classify it as class 0 or 1. I am currently using a sigmoid on this continuous output value but after sigmoid the ...
  • 11
1 vote
1 answer
47 views

Using logistic regression to classify data set (asking about the steps)

I have a training data set of predictors being classified into 2 classes. For now, I have already created a logistic regression model, that is, having solved the coefficients $\beta_0, \beta_1,\cdots$....
  • 8,155
4 votes
3 answers
554 views

How does logistic growth rate coincide with the slope of the line in the exponential phase of the growth?

For a logistic function $$f(x) = \frac{L}{1 + e^{-k(x - x_0)}},$$ people call $k$ the logistic growth rate. Now, I have encountered this statement: In the log scale the logistic growth rate coincides ...
  • 43
1 vote
0 answers
17 views

What is the best practice for logistic regression data perspective?

I'm running into an interesting problem (for me at least) right now where I'm worried that my data setup is negatively influencing the accuracy of my model. Lets use historical chess matches as our ...
1 vote
1 answer
70 views

Can I use a logistic regression as a calibration curve?

Lets use basketball as our example. The use case: There is a model that predicts the probability that the favored team will win. The probability range then is necessarily constrained between 0.5 and ...
1 vote
1 answer
34 views

Logistic regression : incoherent coefficient values from z tests?

I am working on a customer purchase problem. I have 150 campaigns sent by email, that I denote C0, C1 ... ...
8 votes
4 answers
4k views

Is Wikipedia's page on the sigmoid function incorrect?

Is Wikipedia's page on the sigmoid function incorrect? It states that: A common example of a sigmoid function is the logistic function From my knowledge of machine learning, I thought that "the ...
10 votes
1 answer
143 views

Is there any difference between a Logistic Regression for inference and for prediction?

When studying Linear Regression, I remember that Multicollinearity is something that impacts inference and not prediction, at least not always. Also, I noted that the assumptions tends to be neglected ...
  • 727
1 vote
0 answers
44 views

Re-parameterization to resolve non-identifiability in this squiggly model (linear combination of logistic functions)?

So my desire here is to be able to capture a variety of temporal dynamics governing the change in value of some feature of interest. I want the model to be able to represent, for example, bounded: ...
0 votes
0 answers
41 views

Implementing logistic regression model in prediction model - use outcome or probability?

My question deals with the principles or way of thinking about implementing a logistic regression model in a larger scale forward prediction. Let's say I have a trained logistic model which can ...
  • 201
1 vote
2 answers
325 views

For prediction problems, why cant we simply use softmax as activation for hidden layers and no activation function for output layer

I am a beginner who is learning how to use neural networks for prediction problems, and almost all tutorials I have found use relu for hidden layer and sigmoid function for output later. My question ...
0 votes
0 answers
139 views

Likelihood values from Sigmoid [duplicate]

Repost of Mathemetics StackExchange question. There are multiple doubts of mine associated around this theme: In MLE, we try to find the PDF parameters ($\theta$) which maximise the likelihood of the ...
  • 143
2 votes
2 answers
220 views

Why $1/(1+e^{-x}) = e^x/(1+e^x)$

I am currently learning the sigmoid/logistic function and have completely forgotten how the maths behind this equivalence works: $$ \dfrac{1}{1+ e^{-x}} = \dfrac{e^{x}}{1+e^{x}} $$ By this I mean how ...
13 votes
2 answers
2k views

sklearn logistic regression converging to unexpected coefficient for a simple case

The case is as follows: Suppose that import numpy as np X = np.array([1, 1, 1]) y = np.array([1, 0, 1]) Then I perform a logistic regression with no intercept to ...
  • 393
3 votes
1 answer
596 views

What value of predictions minimizes the binary cross entropy loss function? Is it 0.5?

I saw some examples of Autoencoders (on images) which use sigmoid as output layer and ...
  • 195
7 votes
2 answers
746 views

Do you do linear regression in logistic regression?

I just studied single & multiple linear regression 2 days ago now I'm reading about logistics regression and I want to implement it from scratch, I just want to know If my understanding about ...
1 vote
1 answer
68 views

Binary logistic regression coefficients

Consider the following MWE example. A dataset with only one feature (categorical feature with 4 different categories ['cat', 'dog', 'hamster', 'frog']) + target (overall 10% positive class). After ohe ...
  • 121
0 votes
0 answers
94 views

Calculate future revenue based on a log growth formula similar to exponential growth formula?

The exponential (not continuous) growth formula from high school is: $$A(t)=A^{kt}$$ Where $A$ is the initial amount, $t$ is the number of time periods and $k$ is the shape or growth rate. Looking ...
  • 1,258
0 votes
1 answer
54 views

When I normalize my X, it changes the curve

I am going between Excel and R for this understand the fitted lines of this experiment. I have X and I have Y. When plotted it give me a curve that looks slightly sigmoidal, but I realize the X goes ...
0 votes
2 answers
1k views

Sigmoid vs Softmax Accuracy Difference

I have trained a neural network on DNA sequences data and my training set has exactly the same number of data in both classes. When I select a softmax function at the end, my accuracy remains at 47% ...
  • 1
0 votes
0 answers
294 views

Fitting a sigmoid model to my data and comparing parameters for different factors

I acquired data from 20 subjects for 4 different conditions (2 factors) with 14 different intensity levels, created using a log-space distribution. I would like to model the response for each ...
  • 1
0 votes
1 answer
2k views

Logistic growth curve with R nls

I would like to fit a model 'logistic-growth' or 'sigmoid growth' per exercise 'Try It #3' over on this online textbook (almost halfway down the page): \begin{array}{|c|c|c|c|} \hline \text{Year}&...
  • 1,258
1 vote
0 answers
93 views

R fit a logistic regression of the form $y=\frac{c}{1+ae^{-bx}}$ [duplicate]

I'm working through some textbook exercises on fitting models to data, including exponential, logarithmic and now logistic regression. About a 3rd of the way down this page is the section on logistic ...
  • 1,258
3 votes
1 answer
41 views

Binary classification of each column in an image

I have a problem where I wish to classify each column in an image of a feature being present (1) or absent (0) in each column. The output of the model should be a vector of size of the width of an ...
  • 33
0 votes
0 answers
87 views

What is the extension(or generalisation) of the sigmoid function to non-binary classification? [duplicate]

I understand that one of the main points of using the sigmoid function on responses in binary classification is that we can interpret value outputted as the probability that an instance belongs to 1 ...
1 vote
0 answers
144 views

Sigmoid confidence curves in logistic regression

I have a logistic regression model that predicts the probability of an outcome based on one input variable. I am able to plot the curve just fine and show my group how the probability is predicted to ...
  • 35.7k
1 vote
1 answer
667 views

Rounding output of sigmoid for binary linear classifier

I am working on a linear classifier with expected output to be 1 for class A belonging and 0 for class B belonging. The output, in some occasions is nearly 0 (...
's user avatar
1 vote
0 answers
111 views

How to model a sigmoid function? [closed]

I have a variable where Y ~ sigmoid(X). Y ranges between 0 and 1. Y, however, is not a probability, so I don't know if I can just get a logistic regression. What I do want is, for a change in X, ...
  • 2,543
0 votes
0 answers
38 views

How is an 'ogival function' defined?

Reading on a paper on factor analysis and measurement invariance I find the description of some functions as 'ogival' functions. In Google I find it referenced mostly in papers from the '70s and '80s....
  • 1,040
0 votes
0 answers
30 views

Conceptual explanation of taking derivative of sigmoid function in neural network

In a neural network, we have a bunch of inputs and corresponding weights + a bias which are represented by a multivariable equation. Now we squash this whole equation with a sigmoid function. How ...
0 votes
0 answers
637 views

Why is learning slower for a sigmoid activation function in a neural network?

Andrew Ng in one of his deep learning course videos says that the sigmoid function acts as a slow learner in a neural network. My intuition is that the sigmoid as an activation function contributes ...