Return to Question

I’m a bit of a stats-noob, so I am not sure I will manage to formulate this question properly, but let me do my best.

I‘m trying to develop an intuition for sample sizes and when they are sufficient to get to a reasonable degree of representativeness of a larger population.

I know that when doing surveys or polls, a sample size of mere hundreds or thousands is often sufficient, even for very large populations. (This is at least what calculators such as this one are telling me.)

So now what happens if we extend this notion to Monte Carlo simulations of a multi-parameter model? Every simulation can be thought of as representing a sample of the larger population of all possible simulations (the solution space).

The solution space of a multi-dimensional problem can be very large, but the survey/poll scenario tells me that this doesn’t mean that the sample size will need to be large.

This seems to suggest that any application of the Monte Carlo method can be concluded within several hundred/thousand of simulations as well. But I feel this cannot be true, as it would seem to defeat the purpose of the plethora of “more efficient alternatives” to Monte Carlo (such as Markov Chain Monte Carlo).

What am I missing? What is the difference between surveying a large population of people on their election vote (for example) and “surveying” a large population of parameter permutations on their performance (when plugged into a certain model)?

Why does a surprisingly small number of surveys suffice to get a decent idea of the likely outcome of an election, while a small number of Monte Carlo simulations does not suffice (I think) to get a decent idea of the likely (top) performance of a model?

My apologies for needing too many words, but it’s the best I can do I am afraid. I hope you catch my drift regardless and can steer me in the right direction. Thanks a lot!

I’m a bit of a stats-noob, so I am not sure I will manage to formulate this question properly, but let me do my best.

I‘m trying to develop an intuition for sample sizes and when they are sufficient to get to a reasonable degree of representativeness of a larger population.

I know that when doing surveys or polls, a sample size of mere hundreds or thousands is often sufficient, even for very large populations. (This is at least what calculators such as this one are telling me.)

So now what happens if we extend this notion to Monte Carlo simulations of a multi-parameter model? Every simulation can be thought of as representing a sample of the larger population of all possible simulations (the solution space).

The solution space of a multi-dimensional problem can be very large, but the survey/poll scenario tells me that this doesn’t mean that the sample size will need to be large.

This seems to suggest that any application of the Monte Carlo method can be concluded within several hundred/thousand of simulations as well. But I feel this cannot be true, as it would appear to defeat the purpose of the plethora of “more efficient alternatives” to Monte Carlo (such as Markov Chain Monte Carlo).

What am I missing? What is the difference between surveying a large population of people on their election vote (for example) and “surveying” a large population of parameter permutations on their performance (when plugged into a certain model)?

Why does a surprisingly small number of surveys suffice to get a decent idea of the likely outcome of an election, while a small number of Monte Carlo simulations does not suffice (I think) to get a decent idea of the likely (top) performance of a model?

My apologies for needing too many words, but it’s the best I can do I am afraid. I hope you catch my drift regardless and can steer me in the right direction. Thanks a lot!

I’m a bit of a stats-noob, so I am not sure I will manage to formulate this question properly, but let me try.

I‘m trying to develop an intuition for sample sizes and when they are sufficient to get to a reasonable degree of representativeness of a larger population.

I know that when doing surveys or polls, a sample size of mere hundreds or thousands is often sufficient, even for very large populations. (This is at least what calculators such as this one are telling me.)

So now what happens if we extend this notion to Monte Carlo simulations of a multi-parameter model? Every simulation can be thought of as representing a sample of the larger population of all possible simulations (the solution space).

The solution space of a multi-dimensional problem can be very large, but the survey/poll scenario tells me that this doesn’t mean that the sample size will need to be large.

This seems to suggest that any Monte Carlo simulation can be concluded within several hundred/thousand of simulations as well. But I feel this cannot be true, as it would seem to defeat the purpose of the plethora of “more efficient alternatives” to Monte Carlo (such as Markov Chain Monte Carlo).

What am I missing? What is the difference between surveying a large population of people on their election vote (for example) and “surveying” a large population of parameter permutations on their performance (when plugged into a certain model)?

Why does a surprisingly small number of surveys suffice to get a decent idea of the likely outcome of an election, while a small number of Monte Carlo simulations does not suffice (I think) to get a decent idea of the likely (top) performance of a model?

My apologies for needing too many words, but it’s the best I can do I am afraid. I hope you catch my drift regardless and can steer me in the right direction. Thanks a lot!

I’m a bit of a stats-noob, so I am not sure I will manage to formulate this question properly, but let me do my best.

I‘m trying to develop an intuition for sample sizes and when they are sufficient to get to a reasonable degree of representativeness of a larger population.

I know that when doing surveys or polls, a sample size of mere hundreds or thousands is often sufficient, even for very large populations. (This is at least what calculators such as this one are telling me.)

So now what happens if we extend this notion to Monte Carlo simulations of a multi-parameter model? Every simulation can be thought of as representing a sample of the larger population of all possible simulations (the solution space).

The solution space of a multi-dimensional problem can be very large, but the survey/poll scenario tells me that this doesn’t mean that the sample size will need to be large.

This seems to suggest that any application of the Monte Carlo method can be concluded within several hundred/thousand of simulations as well. But I feel this cannot be true, as it would seem to defeat the purpose of the plethora of “more efficient alternatives” to Monte Carlo (such as Markov Chain Monte Carlo).

What am I missing? What is the difference between surveying a large population of people on their election vote (for example) and “surveying” a large population of parameter permutations on their performance (when plugged into a certain model)?

Why does a surprisingly small number of surveys suffice to get a decent idea of the likely outcome of an election, while a small number of Monte Carlo simulations does not suffice (I think) to get a decent idea of the likely (top) performance of a model?

My apologies for needing too many words, but it’s the best I can do I am afraid. I hope you catch my drift regardless and can steer me in the right direction. Thanks a lot!

I’m a bit of a stats-noob, so I am not sure I will manage to formulate this question properly, but let me try.

I‘m trying to develop an intuition for sample sizes and when they are sufficient to get to a reasonable degree of representativeness of a larger population.

I know that when doing surveys or polls, a sample size of mere hundreds or thousands is often sufficient, even for very large populations. (This is at least what calculators such as this one are telling me.)

So now what happens if we extend this notion to Monte Carlo simulations of a multi-parameter model? Every simulation can be thought of as representing a sample of the larger population of all possible simulations (the solution space).

The solution space of a multi-dimensional problem can be very large, but the survey/poll scenario tells me that this doesn’t mean that the sample size will need to be large.

This would suggest that any Monte Carlo simulation can be solved within several hundred/thousand of simulations. But I feel this cannot be true, as it would seem to defeat the purpose of the plethora of “more efficient alternatives” to Monte Carlo (such as Markov Chain Monte Carlo).

What am I missing? What is the difference between surveying a large population of people on their election vote (for example) and “surveying” a large population of parameter permutations on their performance (when plugged into a certain model)?

Why does a surprisingly small number of surveys suffice to get a decent idea of the likely outcome of an election, while a small number of Monte Carlo simulations does not suffice (I think) to get a decent idea of the likely (top) performance of a model?

My apologies for needing too many words, but it’s the best I can do I am afraid. I hope you catch my drift regardless and can steer me in the right direction. Thanks a lot!

I’m a bit of a stats-noob, so I am not sure I will manage to formulate this question properly, but let me try.

I‘m trying to develop an intuition for sample sizes and when they are sufficient to get to a reasonable degree of representativeness of a larger population.

I know that when doing surveys or polls, a sample size of mere hundreds or thousands is often sufficient, even for very large populations. (This is at least what calculators such as this one are telling me.)

So now what happens if we extend this notion to Monte Carlo simulations of a multi-parameter model? Every simulation can be thought of as representing a sample of the larger population of all possible simulations (the solution space).

The solution space of a multi-dimensional problem can be very large, but the survey/poll scenario tells me that this doesn’t mean that the sample size will need to be large.

This seems to suggest that any Monte Carlo simulation can be concluded within several hundred/thousand of simulations as well. But I feel this cannot be true, as it would seem to defeat the purpose of the plethora of “more efficient alternatives” to Monte Carlo (such as Markov Chain Monte Carlo).

What am I missing? What is the difference between surveying a large population of people on their election vote (for example) and “surveying” a large population of parameter permutations on their performance (when plugged into a certain model)?

Why does a surprisingly small number of surveys suffice to get a decent idea of the likely outcome of an election, while a small number of Monte Carlo simulations does not suffice (I think) to get a decent idea of the likely (top) performance of a model?

My apologies for needing too many words, but it’s the best I can do I am afraid. I hope you catch my drift regardless and can steer me in the right direction. Thanks a lot!