Suppose I have a die and I throw it a large number of times (a billion times) and have proven that it lands on each side an equal number of times so it is proven to be fair.
Next suppose I started a second round of throwing of the same die and it lands on 1 through 5 say a 10,000 times each and the count for 6 is 100.
Suppose someone ask you to bet on the next billion throws.
Would you bet on 6?
If the die rolls are independent, then you'd no sooner bet on $6$ now than you would've on the first throw - the probability is $1/6$ now just like it is on every throw.
The scenario you've described seems to be related to the common probabilistic fallacy known as the law of averages, an example of which is the belief that events that are "due" to happen are somehow more likely.
There certainly could be a dependence structure in a time series that makes events that have occurred less frequently than expected somehow more likely in the future (an extreme example of this is a Self Avoiding Random Walk), but when the rolls of the die are independent, this reasoning doesn't make sense.
Note that the law of large numbers implies that the observed relative frequencies of each outcome converge to the true probabilities as the sample size goes to $\infty$, so it does "even out" in the long run. But, this does not imply that the subsequent throws have an increased probability of being '6's - if exactly $1/6$ of the throws for the rest of eternity were $6$s, then the limit implied by the law of large numbers still applies. In your example, only $100$ of the first $50100$ throws were $6$s, but
$$ \lim_{n \rightarrow \infty} \frac{100 + n/6}{50100 + n} = 1/6; $$
so, you can see that although $6$s are wildly underrepresented early on in the sequence, no $6$s need to be 'made up' for things to even out in the long run.
Betting on six is not justified for three different reasons.
1) Macro correctly identified the fallacy in the offset argument -- betting that since six is under-represented, then six must OFFSET (be over-represented) to achieve the proper balance per the law of averages. Macro showed that OFFSET is not necessary and that DILUTION -- given enough tries-- will accomplish the same thing.
2) Chernick correctly identified the weakness in assuming the underlying probabilities are unchanged. Chernick noted that this is a "crazy scenario". To see how crazy this, calculate the chance of getting 100 6s (or fewer) in the next 50,100 throws of a fair die. Using Excel:
If you had observed only 5,400 sixs, this (or fewer) would be EXPECTED if you rolled 8.72 x 10^306 sets of 50,100 die. [If the probability of an outcome is p, then that outcome is expected in n = 1/p trials.] 8.72x 10^306 is an INCREDIBLY large number of trials. Way more than billions or trillions.
Since getting 100 or fewer 6s in 50,100 tries is so unlikely, we can/should reject the null hypothesis that the underlying probability of a 6 is 1 in six, conclude that the new probability of a 6 is 100 in 50,100 and bet on anything but six [if you believe "the future is best represented by the recent past"].
3) My choice would be to not bet -- to walk away -- given the magnitude of the change and the lack of any evidence that the most recent relative-frequencies are constant.
LOG and GAMMALN functions.) BTW, your calculation is not quite appropriate: you need to find the chance of a run of 100 of something somewhere in the sequence.
$\endgroup$
This is a very crazy scenario. Why would the probability of heads change so much? If it did and you believe the future is best represented by the recent past then if it is fair to assume that the rolls are independent then betting on 6 would be foolish.
