How to test if the difference between the means of two groups is more than a given value?
Clash Royale CLAN TAG#URR8PPP
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty margin-bottom:0;
up vote
1
down vote
favorite
The null hypothesis for the t-test is the means between two groups are the same (i.e. the difference between the means of two groups equals 0). However, my null hypothesis is the difference between the means of two groups is less than 5 (alternate hypothesis is > 5). What's the appropriate test/approach in this situation?
t-test
add a comment |Â
up vote
1
down vote
favorite
The null hypothesis for the t-test is the means between two groups are the same (i.e. the difference between the means of two groups equals 0). However, my null hypothesis is the difference between the means of two groups is less than 5 (alternate hypothesis is > 5). What's the appropriate test/approach in this situation?
t-test
1
Possible duplicate of Can a paired t-test test if the difference between two means is less than a specific value?
– Stefan
3 hours ago
add a comment |Â
up vote
1
down vote
favorite
up vote
1
down vote
favorite
The null hypothesis for the t-test is the means between two groups are the same (i.e. the difference between the means of two groups equals 0). However, my null hypothesis is the difference between the means of two groups is less than 5 (alternate hypothesis is > 5). What's the appropriate test/approach in this situation?
t-test
The null hypothesis for the t-test is the means between two groups are the same (i.e. the difference between the means of two groups equals 0). However, my null hypothesis is the difference between the means of two groups is less than 5 (alternate hypothesis is > 5). What's the appropriate test/approach in this situation?
t-test
t-test
asked 4 hours ago
Ray Zhang
212
212
1
Possible duplicate of Can a paired t-test test if the difference between two means is less than a specific value?
– Stefan
3 hours ago
add a comment |Â
1
Possible duplicate of Can a paired t-test test if the difference between two means is less than a specific value?
– Stefan
3 hours ago
1
1
Possible duplicate of Can a paired t-test test if the difference between two means is less than a specific value?
– Stefan
3 hours ago
Possible duplicate of Can a paired t-test test if the difference between two means is less than a specific value?
– Stefan
3 hours ago
add a comment |Â
2 Answers
2
active
oldest
votes
up vote
2
down vote
Non- inferiority testing, if your null hypothesis is $mu_1-mu_2>delta$ and equivalence testing, if your null hypothesis is $|mu_1-mu_2|>delta$.
There are usually no tests with fancy names for doing this, but you can usually look at confidence intervals (two-sided level $1-alpha$ ones to get a level $alpha$ test) and see whether they overlap with your null hypothesis. If so, you cannot reject, otherwise you reject. If asymptotics apply, it's usually trivial to construct a test, too.
add a comment |Â
up vote
0
down vote
Note: the following assumes that by "difference", you mean the unsigned difference, i.e. you take one value minus the other, then take the absolute value. You should be precise, however, and explicitly say which you mean.
The purpose of having a null hypothesis is so that you can calculate the probability of seeing your results, given the null hypothesis. "This statistic is comes from a student-t-distribution whose mean has an absolute value less than 5" is not specific enough to calculate probability; you have different values within that range, and each value will give a different probability.
What you can do is take your data and then take the "worst case" (note that you normally should decide what your null hypothesis is before collecting any data, but taking the worst case ensures that you aren't improperly detecting significant). By "worst case", I mean: what null hypothesis would give you the least significance? If your sample mean is greater than 5, then the worst case would be taking the null hypothesis to be that the true mean is 5. You should then calculate the probability, given that the true mean is 5, of getting a sample mean greater than or equal to what you observed. If your sample mean less than -5, then the worst case would be taking the null hypothesis to be that the true mean is -5, and finding the probability, given that the true mean is -5, of getting a sample mean less than or equal to what you observed. If the sample mean is between -5 and 5, then you should not reject the mean. Since you don't know ahead of time which direction you're going, you should consider this a two-tailed test.
add a comment |Â
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
2
down vote
Non- inferiority testing, if your null hypothesis is $mu_1-mu_2>delta$ and equivalence testing, if your null hypothesis is $|mu_1-mu_2|>delta$.
There are usually no tests with fancy names for doing this, but you can usually look at confidence intervals (two-sided level $1-alpha$ ones to get a level $alpha$ test) and see whether they overlap with your null hypothesis. If so, you cannot reject, otherwise you reject. If asymptotics apply, it's usually trivial to construct a test, too.
add a comment |Â
up vote
2
down vote
Non- inferiority testing, if your null hypothesis is $mu_1-mu_2>delta$ and equivalence testing, if your null hypothesis is $|mu_1-mu_2|>delta$.
There are usually no tests with fancy names for doing this, but you can usually look at confidence intervals (two-sided level $1-alpha$ ones to get a level $alpha$ test) and see whether they overlap with your null hypothesis. If so, you cannot reject, otherwise you reject. If asymptotics apply, it's usually trivial to construct a test, too.
add a comment |Â
up vote
2
down vote
up vote
2
down vote
Non- inferiority testing, if your null hypothesis is $mu_1-mu_2>delta$ and equivalence testing, if your null hypothesis is $|mu_1-mu_2|>delta$.
There are usually no tests with fancy names for doing this, but you can usually look at confidence intervals (two-sided level $1-alpha$ ones to get a level $alpha$ test) and see whether they overlap with your null hypothesis. If so, you cannot reject, otherwise you reject. If asymptotics apply, it's usually trivial to construct a test, too.
Non- inferiority testing, if your null hypothesis is $mu_1-mu_2>delta$ and equivalence testing, if your null hypothesis is $|mu_1-mu_2|>delta$.
There are usually no tests with fancy names for doing this, but you can usually look at confidence intervals (two-sided level $1-alpha$ ones to get a level $alpha$ test) and see whether they overlap with your null hypothesis. If so, you cannot reject, otherwise you reject. If asymptotics apply, it's usually trivial to construct a test, too.
answered 2 hours ago


Björn
8,3141833
8,3141833
add a comment |Â
add a comment |Â
up vote
0
down vote
Note: the following assumes that by "difference", you mean the unsigned difference, i.e. you take one value minus the other, then take the absolute value. You should be precise, however, and explicitly say which you mean.
The purpose of having a null hypothesis is so that you can calculate the probability of seeing your results, given the null hypothesis. "This statistic is comes from a student-t-distribution whose mean has an absolute value less than 5" is not specific enough to calculate probability; you have different values within that range, and each value will give a different probability.
What you can do is take your data and then take the "worst case" (note that you normally should decide what your null hypothesis is before collecting any data, but taking the worst case ensures that you aren't improperly detecting significant). By "worst case", I mean: what null hypothesis would give you the least significance? If your sample mean is greater than 5, then the worst case would be taking the null hypothesis to be that the true mean is 5. You should then calculate the probability, given that the true mean is 5, of getting a sample mean greater than or equal to what you observed. If your sample mean less than -5, then the worst case would be taking the null hypothesis to be that the true mean is -5, and finding the probability, given that the true mean is -5, of getting a sample mean less than or equal to what you observed. If the sample mean is between -5 and 5, then you should not reject the mean. Since you don't know ahead of time which direction you're going, you should consider this a two-tailed test.
add a comment |Â
up vote
0
down vote
Note: the following assumes that by "difference", you mean the unsigned difference, i.e. you take one value minus the other, then take the absolute value. You should be precise, however, and explicitly say which you mean.
The purpose of having a null hypothesis is so that you can calculate the probability of seeing your results, given the null hypothesis. "This statistic is comes from a student-t-distribution whose mean has an absolute value less than 5" is not specific enough to calculate probability; you have different values within that range, and each value will give a different probability.
What you can do is take your data and then take the "worst case" (note that you normally should decide what your null hypothesis is before collecting any data, but taking the worst case ensures that you aren't improperly detecting significant). By "worst case", I mean: what null hypothesis would give you the least significance? If your sample mean is greater than 5, then the worst case would be taking the null hypothesis to be that the true mean is 5. You should then calculate the probability, given that the true mean is 5, of getting a sample mean greater than or equal to what you observed. If your sample mean less than -5, then the worst case would be taking the null hypothesis to be that the true mean is -5, and finding the probability, given that the true mean is -5, of getting a sample mean less than or equal to what you observed. If the sample mean is between -5 and 5, then you should not reject the mean. Since you don't know ahead of time which direction you're going, you should consider this a two-tailed test.
add a comment |Â
up vote
0
down vote
up vote
0
down vote
Note: the following assumes that by "difference", you mean the unsigned difference, i.e. you take one value minus the other, then take the absolute value. You should be precise, however, and explicitly say which you mean.
The purpose of having a null hypothesis is so that you can calculate the probability of seeing your results, given the null hypothesis. "This statistic is comes from a student-t-distribution whose mean has an absolute value less than 5" is not specific enough to calculate probability; you have different values within that range, and each value will give a different probability.
What you can do is take your data and then take the "worst case" (note that you normally should decide what your null hypothesis is before collecting any data, but taking the worst case ensures that you aren't improperly detecting significant). By "worst case", I mean: what null hypothesis would give you the least significance? If your sample mean is greater than 5, then the worst case would be taking the null hypothesis to be that the true mean is 5. You should then calculate the probability, given that the true mean is 5, of getting a sample mean greater than or equal to what you observed. If your sample mean less than -5, then the worst case would be taking the null hypothesis to be that the true mean is -5, and finding the probability, given that the true mean is -5, of getting a sample mean less than or equal to what you observed. If the sample mean is between -5 and 5, then you should not reject the mean. Since you don't know ahead of time which direction you're going, you should consider this a two-tailed test.
Note: the following assumes that by "difference", you mean the unsigned difference, i.e. you take one value minus the other, then take the absolute value. You should be precise, however, and explicitly say which you mean.
The purpose of having a null hypothesis is so that you can calculate the probability of seeing your results, given the null hypothesis. "This statistic is comes from a student-t-distribution whose mean has an absolute value less than 5" is not specific enough to calculate probability; you have different values within that range, and each value will give a different probability.
What you can do is take your data and then take the "worst case" (note that you normally should decide what your null hypothesis is before collecting any data, but taking the worst case ensures that you aren't improperly detecting significant). By "worst case", I mean: what null hypothesis would give you the least significance? If your sample mean is greater than 5, then the worst case would be taking the null hypothesis to be that the true mean is 5. You should then calculate the probability, given that the true mean is 5, of getting a sample mean greater than or equal to what you observed. If your sample mean less than -5, then the worst case would be taking the null hypothesis to be that the true mean is -5, and finding the probability, given that the true mean is -5, of getting a sample mean less than or equal to what you observed. If the sample mean is between -5 and 5, then you should not reject the mean. Since you don't know ahead of time which direction you're going, you should consider this a two-tailed test.
answered 3 hours ago
Acccumulation
1,38826
1,38826
add a comment |Â
add a comment |Â
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f371632%2fhow-to-test-if-the-difference-between-the-means-of-two-groups-is-more-than-a-giv%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
1
Possible duplicate of Can a paired t-test test if the difference between two means is less than a specific value?
– Stefan
3 hours ago