Trouble relating the Central Limit Theorem to confidence intervals

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty margin-bottom:0;







up vote
1
down vote

favorite












I'm having trouble understanding how the Central Limit Theorem (CLT) implies that we can create confidence intervals as we do. For example, Slide 5 from these lecture notes essentially lays out the following logic for how the CLT can be used to construct a confidence interval:




We have a point estimate $barX$ for the population mean $mu$, but we want to design a “net” to have a reasonable chance of capturing $mu$.



  1. From the CLT we know that we can think of $barX$ as a sample from $N(mu, sigma^2/n)$


  2. Therefore, 96% of samples from the population should have $barX$s within 2 SEs ($2sigma/sqrtn$) of $mu$.


  3. Therefore, for 96% of samples from the population, $mu$ must be within 2 SEs of $barX$.




I'm good with points 1 and 2 shown above, but I don't understand how those two points (or anything else that the CLT says) can be used to come up with point 3. In other words, how does point 3 follow from points 1 and 2? It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).










share|cite|improve this question





























    up vote
    1
    down vote

    favorite












    I'm having trouble understanding how the Central Limit Theorem (CLT) implies that we can create confidence intervals as we do. For example, Slide 5 from these lecture notes essentially lays out the following logic for how the CLT can be used to construct a confidence interval:




    We have a point estimate $barX$ for the population mean $mu$, but we want to design a “net” to have a reasonable chance of capturing $mu$.



    1. From the CLT we know that we can think of $barX$ as a sample from $N(mu, sigma^2/n)$


    2. Therefore, 96% of samples from the population should have $barX$s within 2 SEs ($2sigma/sqrtn$) of $mu$.


    3. Therefore, for 96% of samples from the population, $mu$ must be within 2 SEs of $barX$.




    I'm good with points 1 and 2 shown above, but I don't understand how those two points (or anything else that the CLT says) can be used to come up with point 3. In other words, how does point 3 follow from points 1 and 2? It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).










    share|cite|improve this question

























      up vote
      1
      down vote

      favorite









      up vote
      1
      down vote

      favorite











      I'm having trouble understanding how the Central Limit Theorem (CLT) implies that we can create confidence intervals as we do. For example, Slide 5 from these lecture notes essentially lays out the following logic for how the CLT can be used to construct a confidence interval:




      We have a point estimate $barX$ for the population mean $mu$, but we want to design a “net” to have a reasonable chance of capturing $mu$.



      1. From the CLT we know that we can think of $barX$ as a sample from $N(mu, sigma^2/n)$


      2. Therefore, 96% of samples from the population should have $barX$s within 2 SEs ($2sigma/sqrtn$) of $mu$.


      3. Therefore, for 96% of samples from the population, $mu$ must be within 2 SEs of $barX$.




      I'm good with points 1 and 2 shown above, but I don't understand how those two points (or anything else that the CLT says) can be used to come up with point 3. In other words, how does point 3 follow from points 1 and 2? It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).










      share|cite|improve this question















      I'm having trouble understanding how the Central Limit Theorem (CLT) implies that we can create confidence intervals as we do. For example, Slide 5 from these lecture notes essentially lays out the following logic for how the CLT can be used to construct a confidence interval:




      We have a point estimate $barX$ for the population mean $mu$, but we want to design a “net” to have a reasonable chance of capturing $mu$.



      1. From the CLT we know that we can think of $barX$ as a sample from $N(mu, sigma^2/n)$


      2. Therefore, 96% of samples from the population should have $barX$s within 2 SEs ($2sigma/sqrtn$) of $mu$.


      3. Therefore, for 96% of samples from the population, $mu$ must be within 2 SEs of $barX$.




      I'm good with points 1 and 2 shown above, but I don't understand how those two points (or anything else that the CLT says) can be used to come up with point 3. In other words, how does point 3 follow from points 1 and 2? It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).







      confidence-interval central-limit-theorem






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited 1 hour ago









      Ben

      15.6k12183




      15.6k12183










      asked 3 hours ago









      Chris

      1363




      1363




















          2 Answers
          2






          active

          oldest

          votes

















          up vote
          1
          down vote













          Probability interval using a pivotal quantity: Confidence intervals are formed from an underlying probability interval for a pivotal quantity. In the present case, if $sigma$ is treated as known, and if $n$ is large enough to justify the required distributional approximation, then you have the pivotal quantity:



          $$fracbarX - musigma / sqrtn oversettextApproxsim textN(0,1).$$



          This result comes from application of the central limit theorem (CLT), assuming that the underlying distribution meets the requirements of the theorem (e.g., finite variance) and a sufficiently large value of $n$. Using this pivotal quantity you can obtain the following probability interval:



          $$mathbbP Bigg( - z_alpha/2 leqslant fracbarX - musigma / sqrtn leqslant z_alpha/2 Bigg) approx 1- alpha.$$



          (Note that the value $z_alpha/2$ is the critical value of the standard normal distribution having an upper-tail probability of $alpha/2$.$^dagger$) Re-arranging the inequalities inside the probability statement you obtain the equivalent probability statement:



          $$mathbbP Bigg( barX - fracz_alpha/2sqrtn cdot sigma leqslant mu leqslant barX + fracz_alpha/2sqrtn cdot sigma Bigg) approx 1- alpha.$$



          This shows that there is a fixed probability that the unknown mean parameter $mu$ will fall within the stated bounds. Note here that the sample mean $barX$ is the random quantity in the expression, so the statement expressed the probability that a fixed parameter value $mu$ falls within the random bounds of the interval.




          The confidence interval: From here, we form the confidence interval by substituting the observed sample mean, yielding the $1-alpha$ level confidence interval:



          $$textCI_mu(1-alpha) = Bigg[ barx pm fracz_alpha/2sqrtn cdot sigma Bigg].$$



          We refer to this as a "confidence interval" (as opposed to a probability interval) since we have now substituted the random bounds with observed bounds. Note that the mean parameter is treated as fixed, so the interval either does or does not contain the parameter; no non-trivial probability statement is applicable here.



          Note that this particular confidence interval assumes that $sigma$ is known. It is generally the case that this parameter is not known, and so we commonly derive a slightly different confidence interval which substitutes the variance parameter with the sample variance. This interval has a similar derivation, using a pivotal quantity that has a Student's T distribution.




          Some further comments on your notes: The notes you have linked to seem to me to be pretty good on the whole. However, it is unfortunately the case that explanations of confidence intervals in statistics courses often skip over the actual derivation of the interval, and there is often a lot of rough hand-waving, in terms of explanation. The logic presented in the linked notes is typical of the kind of vague explanation that is often given in introductory courses, where lecturers tend to prefer to minimise mathematics.



          Personally, I am not a fan of these kinds of vague explanations, especially since it is not terribly difficult to show the mathematical derivation of the interval. Some lecturers in this field regard the mathematical derivation as being too complicated to assist introductory students, and so they omit it, but I personally think it is more confusing to students to try to muddle out the logic behind the interval without a clear presentation of its derivation.



          You can see from the above mathematics that the confidence interval is formed by analogy to an actual probability interval, which can be formed by re-arranging a simple probability statement for the pivotal quantity in the analysis. Once you understand the derivation of the probability interval, understanding the analogy to the confidence interval is quite simple.




          $^dagger$ The critical point is defined mathematically as the (implicit) solution to:



          $$fracalpha2 = frac1sqrt2 pi int limits_z_alpha/2^infty exp (-tfrac12 r^2) dr.$$






          share|cite|improve this answer





























            up vote
            1
            down vote













            3 is simply stating 2 in different words. For each case that $barX$ is within $2sigma$ of $mu$, $mu$ is within $2sigma$ of $barX$. Distance is a symmetric relation; the distance between $barX$ and $mu$ is the same as the distance between $mu$ and $barX$.




            It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).




            Yes, and the slide that you link to specifically says:




            Note that we are being very careful about the language here - the 96%
            here only applies to random samples in the abstract. Once we have
            actually taken a sample $barX$ will either be within 2 SEs or outside of 2 SEs




            The slide never says that for a particular $barX$, there is a 96% probability that $mu$ will be within $2sigma$. It says that out of the entire population of $barX$, for 96% of them $mu$ will be within $2sigma$. Simply because $S$ is in population $P$, percentage $p$ of them have attribute $a$, does not mean $S$ has probability $p$ of having attribute $a$. $frac1 52$ of the cards from a deck are Ace of Spades, but once you choose a card, that card is either the Ace of Spades or not. It doesn't make sense to point to a face-up card and say "That card has probability $frac1 52$ of being an Ace of Spades".



            The process of creating confidence intervals of width $2sigma$ has probability .96 of generating a confidence interval that contains the true mean. A particular confidence interval does not have probability .96 of containing the true mean, any more than a particular card has probability $frac1 52$ of being an Ace of Spades.






            share|cite|improve this answer




















              Your Answer




              StackExchange.ifUsing("editor", function ()
              return StackExchange.using("mathjaxEditing", function ()
              StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
              StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
              );
              );
              , "mathjax-editing");

              StackExchange.ready(function()
              var channelOptions =
              tags: "".split(" "),
              id: "65"
              ;
              initTagRenderer("".split(" "), "".split(" "), channelOptions);

              StackExchange.using("externalEditor", function()
              // Have to fire editor after snippets, if snippets enabled
              if (StackExchange.settings.snippets.snippetsEnabled)
              StackExchange.using("snippets", function()
              createEditor();
              );

              else
              createEditor();

              );

              function createEditor()
              StackExchange.prepareEditor(
              heartbeatType: 'answer',
              convertImagesToLinks: false,
              noModals: false,
              showLowRepImageUploadWarning: true,
              reputationToPostImages: null,
              bindNavPrevention: true,
              postfix: "",
              onDemand: true,
              discardSelector: ".discard-answer"
              ,immediatelyShowMarkdownHelp:true
              );



              );













               

              draft saved


              draft discarded


















              StackExchange.ready(
              function ()
              StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f371067%2ftrouble-relating-the-central-limit-theorem-to-confidence-intervals%23new-answer', 'question_page');

              );

              Post as a guest






























              2 Answers
              2






              active

              oldest

              votes








              2 Answers
              2






              active

              oldest

              votes









              active

              oldest

              votes






              active

              oldest

              votes








              up vote
              1
              down vote













              Probability interval using a pivotal quantity: Confidence intervals are formed from an underlying probability interval for a pivotal quantity. In the present case, if $sigma$ is treated as known, and if $n$ is large enough to justify the required distributional approximation, then you have the pivotal quantity:



              $$fracbarX - musigma / sqrtn oversettextApproxsim textN(0,1).$$



              This result comes from application of the central limit theorem (CLT), assuming that the underlying distribution meets the requirements of the theorem (e.g., finite variance) and a sufficiently large value of $n$. Using this pivotal quantity you can obtain the following probability interval:



              $$mathbbP Bigg( - z_alpha/2 leqslant fracbarX - musigma / sqrtn leqslant z_alpha/2 Bigg) approx 1- alpha.$$



              (Note that the value $z_alpha/2$ is the critical value of the standard normal distribution having an upper-tail probability of $alpha/2$.$^dagger$) Re-arranging the inequalities inside the probability statement you obtain the equivalent probability statement:



              $$mathbbP Bigg( barX - fracz_alpha/2sqrtn cdot sigma leqslant mu leqslant barX + fracz_alpha/2sqrtn cdot sigma Bigg) approx 1- alpha.$$



              This shows that there is a fixed probability that the unknown mean parameter $mu$ will fall within the stated bounds. Note here that the sample mean $barX$ is the random quantity in the expression, so the statement expressed the probability that a fixed parameter value $mu$ falls within the random bounds of the interval.




              The confidence interval: From here, we form the confidence interval by substituting the observed sample mean, yielding the $1-alpha$ level confidence interval:



              $$textCI_mu(1-alpha) = Bigg[ barx pm fracz_alpha/2sqrtn cdot sigma Bigg].$$



              We refer to this as a "confidence interval" (as opposed to a probability interval) since we have now substituted the random bounds with observed bounds. Note that the mean parameter is treated as fixed, so the interval either does or does not contain the parameter; no non-trivial probability statement is applicable here.



              Note that this particular confidence interval assumes that $sigma$ is known. It is generally the case that this parameter is not known, and so we commonly derive a slightly different confidence interval which substitutes the variance parameter with the sample variance. This interval has a similar derivation, using a pivotal quantity that has a Student's T distribution.




              Some further comments on your notes: The notes you have linked to seem to me to be pretty good on the whole. However, it is unfortunately the case that explanations of confidence intervals in statistics courses often skip over the actual derivation of the interval, and there is often a lot of rough hand-waving, in terms of explanation. The logic presented in the linked notes is typical of the kind of vague explanation that is often given in introductory courses, where lecturers tend to prefer to minimise mathematics.



              Personally, I am not a fan of these kinds of vague explanations, especially since it is not terribly difficult to show the mathematical derivation of the interval. Some lecturers in this field regard the mathematical derivation as being too complicated to assist introductory students, and so they omit it, but I personally think it is more confusing to students to try to muddle out the logic behind the interval without a clear presentation of its derivation.



              You can see from the above mathematics that the confidence interval is formed by analogy to an actual probability interval, which can be formed by re-arranging a simple probability statement for the pivotal quantity in the analysis. Once you understand the derivation of the probability interval, understanding the analogy to the confidence interval is quite simple.




              $^dagger$ The critical point is defined mathematically as the (implicit) solution to:



              $$fracalpha2 = frac1sqrt2 pi int limits_z_alpha/2^infty exp (-tfrac12 r^2) dr.$$






              share|cite|improve this answer


























                up vote
                1
                down vote













                Probability interval using a pivotal quantity: Confidence intervals are formed from an underlying probability interval for a pivotal quantity. In the present case, if $sigma$ is treated as known, and if $n$ is large enough to justify the required distributional approximation, then you have the pivotal quantity:



                $$fracbarX - musigma / sqrtn oversettextApproxsim textN(0,1).$$



                This result comes from application of the central limit theorem (CLT), assuming that the underlying distribution meets the requirements of the theorem (e.g., finite variance) and a sufficiently large value of $n$. Using this pivotal quantity you can obtain the following probability interval:



                $$mathbbP Bigg( - z_alpha/2 leqslant fracbarX - musigma / sqrtn leqslant z_alpha/2 Bigg) approx 1- alpha.$$



                (Note that the value $z_alpha/2$ is the critical value of the standard normal distribution having an upper-tail probability of $alpha/2$.$^dagger$) Re-arranging the inequalities inside the probability statement you obtain the equivalent probability statement:



                $$mathbbP Bigg( barX - fracz_alpha/2sqrtn cdot sigma leqslant mu leqslant barX + fracz_alpha/2sqrtn cdot sigma Bigg) approx 1- alpha.$$



                This shows that there is a fixed probability that the unknown mean parameter $mu$ will fall within the stated bounds. Note here that the sample mean $barX$ is the random quantity in the expression, so the statement expressed the probability that a fixed parameter value $mu$ falls within the random bounds of the interval.




                The confidence interval: From here, we form the confidence interval by substituting the observed sample mean, yielding the $1-alpha$ level confidence interval:



                $$textCI_mu(1-alpha) = Bigg[ barx pm fracz_alpha/2sqrtn cdot sigma Bigg].$$



                We refer to this as a "confidence interval" (as opposed to a probability interval) since we have now substituted the random bounds with observed bounds. Note that the mean parameter is treated as fixed, so the interval either does or does not contain the parameter; no non-trivial probability statement is applicable here.



                Note that this particular confidence interval assumes that $sigma$ is known. It is generally the case that this parameter is not known, and so we commonly derive a slightly different confidence interval which substitutes the variance parameter with the sample variance. This interval has a similar derivation, using a pivotal quantity that has a Student's T distribution.




                Some further comments on your notes: The notes you have linked to seem to me to be pretty good on the whole. However, it is unfortunately the case that explanations of confidence intervals in statistics courses often skip over the actual derivation of the interval, and there is often a lot of rough hand-waving, in terms of explanation. The logic presented in the linked notes is typical of the kind of vague explanation that is often given in introductory courses, where lecturers tend to prefer to minimise mathematics.



                Personally, I am not a fan of these kinds of vague explanations, especially since it is not terribly difficult to show the mathematical derivation of the interval. Some lecturers in this field regard the mathematical derivation as being too complicated to assist introductory students, and so they omit it, but I personally think it is more confusing to students to try to muddle out the logic behind the interval without a clear presentation of its derivation.



                You can see from the above mathematics that the confidence interval is formed by analogy to an actual probability interval, which can be formed by re-arranging a simple probability statement for the pivotal quantity in the analysis. Once you understand the derivation of the probability interval, understanding the analogy to the confidence interval is quite simple.




                $^dagger$ The critical point is defined mathematically as the (implicit) solution to:



                $$fracalpha2 = frac1sqrt2 pi int limits_z_alpha/2^infty exp (-tfrac12 r^2) dr.$$






                share|cite|improve this answer
























                  up vote
                  1
                  down vote










                  up vote
                  1
                  down vote









                  Probability interval using a pivotal quantity: Confidence intervals are formed from an underlying probability interval for a pivotal quantity. In the present case, if $sigma$ is treated as known, and if $n$ is large enough to justify the required distributional approximation, then you have the pivotal quantity:



                  $$fracbarX - musigma / sqrtn oversettextApproxsim textN(0,1).$$



                  This result comes from application of the central limit theorem (CLT), assuming that the underlying distribution meets the requirements of the theorem (e.g., finite variance) and a sufficiently large value of $n$. Using this pivotal quantity you can obtain the following probability interval:



                  $$mathbbP Bigg( - z_alpha/2 leqslant fracbarX - musigma / sqrtn leqslant z_alpha/2 Bigg) approx 1- alpha.$$



                  (Note that the value $z_alpha/2$ is the critical value of the standard normal distribution having an upper-tail probability of $alpha/2$.$^dagger$) Re-arranging the inequalities inside the probability statement you obtain the equivalent probability statement:



                  $$mathbbP Bigg( barX - fracz_alpha/2sqrtn cdot sigma leqslant mu leqslant barX + fracz_alpha/2sqrtn cdot sigma Bigg) approx 1- alpha.$$



                  This shows that there is a fixed probability that the unknown mean parameter $mu$ will fall within the stated bounds. Note here that the sample mean $barX$ is the random quantity in the expression, so the statement expressed the probability that a fixed parameter value $mu$ falls within the random bounds of the interval.




                  The confidence interval: From here, we form the confidence interval by substituting the observed sample mean, yielding the $1-alpha$ level confidence interval:



                  $$textCI_mu(1-alpha) = Bigg[ barx pm fracz_alpha/2sqrtn cdot sigma Bigg].$$



                  We refer to this as a "confidence interval" (as opposed to a probability interval) since we have now substituted the random bounds with observed bounds. Note that the mean parameter is treated as fixed, so the interval either does or does not contain the parameter; no non-trivial probability statement is applicable here.



                  Note that this particular confidence interval assumes that $sigma$ is known. It is generally the case that this parameter is not known, and so we commonly derive a slightly different confidence interval which substitutes the variance parameter with the sample variance. This interval has a similar derivation, using a pivotal quantity that has a Student's T distribution.




                  Some further comments on your notes: The notes you have linked to seem to me to be pretty good on the whole. However, it is unfortunately the case that explanations of confidence intervals in statistics courses often skip over the actual derivation of the interval, and there is often a lot of rough hand-waving, in terms of explanation. The logic presented in the linked notes is typical of the kind of vague explanation that is often given in introductory courses, where lecturers tend to prefer to minimise mathematics.



                  Personally, I am not a fan of these kinds of vague explanations, especially since it is not terribly difficult to show the mathematical derivation of the interval. Some lecturers in this field regard the mathematical derivation as being too complicated to assist introductory students, and so they omit it, but I personally think it is more confusing to students to try to muddle out the logic behind the interval without a clear presentation of its derivation.



                  You can see from the above mathematics that the confidence interval is formed by analogy to an actual probability interval, which can be formed by re-arranging a simple probability statement for the pivotal quantity in the analysis. Once you understand the derivation of the probability interval, understanding the analogy to the confidence interval is quite simple.




                  $^dagger$ The critical point is defined mathematically as the (implicit) solution to:



                  $$fracalpha2 = frac1sqrt2 pi int limits_z_alpha/2^infty exp (-tfrac12 r^2) dr.$$






                  share|cite|improve this answer














                  Probability interval using a pivotal quantity: Confidence intervals are formed from an underlying probability interval for a pivotal quantity. In the present case, if $sigma$ is treated as known, and if $n$ is large enough to justify the required distributional approximation, then you have the pivotal quantity:



                  $$fracbarX - musigma / sqrtn oversettextApproxsim textN(0,1).$$



                  This result comes from application of the central limit theorem (CLT), assuming that the underlying distribution meets the requirements of the theorem (e.g., finite variance) and a sufficiently large value of $n$. Using this pivotal quantity you can obtain the following probability interval:



                  $$mathbbP Bigg( - z_alpha/2 leqslant fracbarX - musigma / sqrtn leqslant z_alpha/2 Bigg) approx 1- alpha.$$



                  (Note that the value $z_alpha/2$ is the critical value of the standard normal distribution having an upper-tail probability of $alpha/2$.$^dagger$) Re-arranging the inequalities inside the probability statement you obtain the equivalent probability statement:



                  $$mathbbP Bigg( barX - fracz_alpha/2sqrtn cdot sigma leqslant mu leqslant barX + fracz_alpha/2sqrtn cdot sigma Bigg) approx 1- alpha.$$



                  This shows that there is a fixed probability that the unknown mean parameter $mu$ will fall within the stated bounds. Note here that the sample mean $barX$ is the random quantity in the expression, so the statement expressed the probability that a fixed parameter value $mu$ falls within the random bounds of the interval.




                  The confidence interval: From here, we form the confidence interval by substituting the observed sample mean, yielding the $1-alpha$ level confidence interval:



                  $$textCI_mu(1-alpha) = Bigg[ barx pm fracz_alpha/2sqrtn cdot sigma Bigg].$$



                  We refer to this as a "confidence interval" (as opposed to a probability interval) since we have now substituted the random bounds with observed bounds. Note that the mean parameter is treated as fixed, so the interval either does or does not contain the parameter; no non-trivial probability statement is applicable here.



                  Note that this particular confidence interval assumes that $sigma$ is known. It is generally the case that this parameter is not known, and so we commonly derive a slightly different confidence interval which substitutes the variance parameter with the sample variance. This interval has a similar derivation, using a pivotal quantity that has a Student's T distribution.




                  Some further comments on your notes: The notes you have linked to seem to me to be pretty good on the whole. However, it is unfortunately the case that explanations of confidence intervals in statistics courses often skip over the actual derivation of the interval, and there is often a lot of rough hand-waving, in terms of explanation. The logic presented in the linked notes is typical of the kind of vague explanation that is often given in introductory courses, where lecturers tend to prefer to minimise mathematics.



                  Personally, I am not a fan of these kinds of vague explanations, especially since it is not terribly difficult to show the mathematical derivation of the interval. Some lecturers in this field regard the mathematical derivation as being too complicated to assist introductory students, and so they omit it, but I personally think it is more confusing to students to try to muddle out the logic behind the interval without a clear presentation of its derivation.



                  You can see from the above mathematics that the confidence interval is formed by analogy to an actual probability interval, which can be formed by re-arranging a simple probability statement for the pivotal quantity in the analysis. Once you understand the derivation of the probability interval, understanding the analogy to the confidence interval is quite simple.




                  $^dagger$ The critical point is defined mathematically as the (implicit) solution to:



                  $$fracalpha2 = frac1sqrt2 pi int limits_z_alpha/2^infty exp (-tfrac12 r^2) dr.$$







                  share|cite|improve this answer














                  share|cite|improve this answer



                  share|cite|improve this answer








                  edited 1 hour ago

























                  answered 1 hour ago









                  Ben

                  15.6k12183




                  15.6k12183






















                      up vote
                      1
                      down vote













                      3 is simply stating 2 in different words. For each case that $barX$ is within $2sigma$ of $mu$, $mu$ is within $2sigma$ of $barX$. Distance is a symmetric relation; the distance between $barX$ and $mu$ is the same as the distance between $mu$ and $barX$.




                      It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).




                      Yes, and the slide that you link to specifically says:




                      Note that we are being very careful about the language here - the 96%
                      here only applies to random samples in the abstract. Once we have
                      actually taken a sample $barX$ will either be within 2 SEs or outside of 2 SEs




                      The slide never says that for a particular $barX$, there is a 96% probability that $mu$ will be within $2sigma$. It says that out of the entire population of $barX$, for 96% of them $mu$ will be within $2sigma$. Simply because $S$ is in population $P$, percentage $p$ of them have attribute $a$, does not mean $S$ has probability $p$ of having attribute $a$. $frac1 52$ of the cards from a deck are Ace of Spades, but once you choose a card, that card is either the Ace of Spades or not. It doesn't make sense to point to a face-up card and say "That card has probability $frac1 52$ of being an Ace of Spades".



                      The process of creating confidence intervals of width $2sigma$ has probability .96 of generating a confidence interval that contains the true mean. A particular confidence interval does not have probability .96 of containing the true mean, any more than a particular card has probability $frac1 52$ of being an Ace of Spades.






                      share|cite|improve this answer
























                        up vote
                        1
                        down vote













                        3 is simply stating 2 in different words. For each case that $barX$ is within $2sigma$ of $mu$, $mu$ is within $2sigma$ of $barX$. Distance is a symmetric relation; the distance between $barX$ and $mu$ is the same as the distance between $mu$ and $barX$.




                        It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).




                        Yes, and the slide that you link to specifically says:




                        Note that we are being very careful about the language here - the 96%
                        here only applies to random samples in the abstract. Once we have
                        actually taken a sample $barX$ will either be within 2 SEs or outside of 2 SEs




                        The slide never says that for a particular $barX$, there is a 96% probability that $mu$ will be within $2sigma$. It says that out of the entire population of $barX$, for 96% of them $mu$ will be within $2sigma$. Simply because $S$ is in population $P$, percentage $p$ of them have attribute $a$, does not mean $S$ has probability $p$ of having attribute $a$. $frac1 52$ of the cards from a deck are Ace of Spades, but once you choose a card, that card is either the Ace of Spades or not. It doesn't make sense to point to a face-up card and say "That card has probability $frac1 52$ of being an Ace of Spades".



                        The process of creating confidence intervals of width $2sigma$ has probability .96 of generating a confidence interval that contains the true mean. A particular confidence interval does not have probability .96 of containing the true mean, any more than a particular card has probability $frac1 52$ of being an Ace of Spades.






                        share|cite|improve this answer






















                          up vote
                          1
                          down vote










                          up vote
                          1
                          down vote









                          3 is simply stating 2 in different words. For each case that $barX$ is within $2sigma$ of $mu$, $mu$ is within $2sigma$ of $barX$. Distance is a symmetric relation; the distance between $barX$ and $mu$ is the same as the distance between $mu$ and $barX$.




                          It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).




                          Yes, and the slide that you link to specifically says:




                          Note that we are being very careful about the language here - the 96%
                          here only applies to random samples in the abstract. Once we have
                          actually taken a sample $barX$ will either be within 2 SEs or outside of 2 SEs




                          The slide never says that for a particular $barX$, there is a 96% probability that $mu$ will be within $2sigma$. It says that out of the entire population of $barX$, for 96% of them $mu$ will be within $2sigma$. Simply because $S$ is in population $P$, percentage $p$ of them have attribute $a$, does not mean $S$ has probability $p$ of having attribute $a$. $frac1 52$ of the cards from a deck are Ace of Spades, but once you choose a card, that card is either the Ace of Spades or not. It doesn't make sense to point to a face-up card and say "That card has probability $frac1 52$ of being an Ace of Spades".



                          The process of creating confidence intervals of width $2sigma$ has probability .96 of generating a confidence interval that contains the true mean. A particular confidence interval does not have probability .96 of containing the true mean, any more than a particular card has probability $frac1 52$ of being an Ace of Spades.






                          share|cite|improve this answer












                          3 is simply stating 2 in different words. For each case that $barX$ is within $2sigma$ of $mu$, $mu$ is within $2sigma$ of $barX$. Distance is a symmetric relation; the distance between $barX$ and $mu$ is the same as the distance between $mu$ and $barX$.




                          It seems to me that the CLT speaks to how confident we can be that a sample mean will fall within some interval surrounding the population mean (i.e., point 2), as opposed to saying how confident we can be that some interval surrounding a sample mean will contain the population mean (i.e., point 3).




                          Yes, and the slide that you link to specifically says:




                          Note that we are being very careful about the language here - the 96%
                          here only applies to random samples in the abstract. Once we have
                          actually taken a sample $barX$ will either be within 2 SEs or outside of 2 SEs




                          The slide never says that for a particular $barX$, there is a 96% probability that $mu$ will be within $2sigma$. It says that out of the entire population of $barX$, for 96% of them $mu$ will be within $2sigma$. Simply because $S$ is in population $P$, percentage $p$ of them have attribute $a$, does not mean $S$ has probability $p$ of having attribute $a$. $frac1 52$ of the cards from a deck are Ace of Spades, but once you choose a card, that card is either the Ace of Spades or not. It doesn't make sense to point to a face-up card and say "That card has probability $frac1 52$ of being an Ace of Spades".



                          The process of creating confidence intervals of width $2sigma$ has probability .96 of generating a confidence interval that contains the true mean. A particular confidence interval does not have probability .96 of containing the true mean, any more than a particular card has probability $frac1 52$ of being an Ace of Spades.







                          share|cite|improve this answer












                          share|cite|improve this answer



                          share|cite|improve this answer










                          answered 1 hour ago









                          Acccumulation

                          1,36026




                          1,36026



























                               

                              draft saved


                              draft discarded















































                               


                              draft saved


                              draft discarded














                              StackExchange.ready(
                              function ()
                              StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f371067%2ftrouble-relating-the-central-limit-theorem-to-confidence-intervals%23new-answer', 'question_page');

                              );

                              Post as a guest













































































                              Comments

                              Popular posts from this blog

                              Long meetings (6-7 hours a day): Being “babysat” by supervisor

                              Is the Concept of Multiple Fantasy Races Scientifically Flawed? [closed]

                              Confectionery