I make a certain measurement and I would like to arrive at a single descriptive number that would give me an idea of both the average value of the measurement, as well as the deviation from the mean. In fact, the deviation (general extent - how far do the values go?) interests me more than the mean, but I am aware that interpreting the standard deviation value without the mean will lead me astray. I am considering adding mean and standard deviation together (mean + stdiv = new measure) - how horridly wrong will that be from the statistical point of view?

As requested, here are the details: my goal is to measure the extent of saturation in the hidden layer outputs of a neural network. Hidden layer consists of hidden units, where every unit receives weighted real-valued inputs and produces a real-valued output within a certain range (typically [0,1]). An individual output is produced for every pattern in a dataset.

In other words, I have a data set (outputs of the hidden units for all patterns in the data set, recorded n times, where n is the number of algorithm iterations), and I would like to see how the average activation value (hidden unit output) changes from iteration to iteration, as well as how much it fluctuates.

  • 4
    $\begingroup$ Probably a bad idea, but such questions cannot be answered in the abstract! You need to tell us your real situation, and your goal! $\endgroup$ – kjetil b halvorsen Jun 19 '14 at 14:53
  • 1
    $\begingroup$ Are you interested in something like an upper confidence bound? $\endgroup$ – jona Jun 19 '14 at 15:08
  • $\begingroup$ @kjetil b halvorse, thanks - I have added some details! $\endgroup$ – anna-earwen Jun 19 '14 at 15:17

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.