Talk Elections

Election Archive => 2004 U.S. Presidential Election Polls => Topic started by: ?????????? on June 06, 2004, 02:20:46 PM



Title: Arkansas Rasmussen poll!
Post by: ?????????? on June 06, 2004, 02:20:46 PM
Bush- 48%
Kerry- 43%

Full Story here (http://www.rasmussenreports.com/Arkansas%20Jun%206.htm)


Title: Re:Arkansas Rasmussen poll!
Post by: agcatter on June 06, 2004, 04:03:51 PM
sounds about right - - but who knows with Rasmussen's state polls.


Title: Re:Arkansas Rasmussen poll!
Post by: I spent the winter writing songs about getting better on June 06, 2004, 04:08:40 PM
Vorlon said these polls are unreliable for small states, since they were set to get a sample right for the entire nation, and thus it's unlikely they got a good sample for a small state, with the correct numbers of men, women, whites, blacks, ect.


Title: Re:Arkansas Rasmussen poll!
Post by: © tweed on June 06, 2004, 04:10:08 PM
Bush is doing 3% better in Arkansas than Virginia?

Rasmussen has proven itself to be crap.


Title: Re:Arkansas Rasmussen poll!
Post by: I spent the winter writing songs about getting better on June 06, 2004, 04:12:05 PM
Bush is doing 3% better in Arkansas than Virginia?

Rasmussen has proven itself to be crap.

Or maybe what Al's been saying for awhile has a little validity to it.


Title: Re:Arkansas Rasmussen poll!
Post by: © tweed on June 06, 2004, 04:13:44 PM
Or maybe what Al's been saying for awhile has a little validity to it.

No, Al has Kerry winning Arkansas.

Plus, don't listen to Al, he's delusional.


Title: Re:Arkansas Rasmussen poll!
Post by: The Vorlon on June 06, 2004, 04:44:50 PM
Vorlon said these polls are unreliable for small states, since they were set to get a sample right for the entire nation, and thus it's unlikely they got a good sample for a small state, with the correct numbers of men, women, whites, blacks, ect. (Same applies for blacks/whites, rural/urban, young/old, etc)

()

I expect that for his National polls Rasmussen is using something called a "cluster sample" bought from a firm that specializes in producing telephone calling lists (very creatively named "Survey Sample International") to have his robots make his calls from.

Cluster samples are designed to give you representative sample for the entire population, but not within small sub sets.

For example, the sample he is buying is balanced to indeed give you 51% Women and 49% men nationally, but it is not guaranteed to give you 51%/49% in say Ohio or New Jersey..(same applies for young/old, black/white, etc)

In the big states (California, texas, Ohio, MIchigan, etc) his subsets might work ok, but after that it gets pretty dicey IMHO.

The dividing line is VERY VERY roughly 12 EVS or so

If I were to take a guess.... (and labled as such) based on what I know of how Cluster samples usually fill out when you actually try to call them. the following is likely...

Bush will do worse than expected in the EST time zone, about right to a bit (?) better than expected in the central time zone, and also better than expected in the mountain and pacific time zones...

The problem is that when you do a national sample, in the small states you sample very few people.  Out of a 1500 sample, you would talk to maybe 9 people in Montana, which needless to say is NOT a representative sample of Montana.  You add up a bunch of small UNrepresentative samples, and you end up with a BIG unrepresentative sample.. :)

The smaller the state, the bigger the potential distortion.

Bush +2 in Washington State anybody?  

If Nevada, which is a small state in the Pacific Time zone, comes in Bush +9 I think we just toss the entire Rasmussen lot out the window from Coast to Coast (I am tempted to do that anyway BTW) ... we will see.

There is a possibility he is using a different type of sample which should give good results, but I think it is unlikely he is using this type of sample for his national polls from which these state "polls" are extracted.

Again this is a semi-educated guess... , but I'd be willing to bet a reasonably fresh bag of donuts.... :)

These errors (if they exist) are over and above the BIG sampling random error from only 400 sample size, which will be in additional to any survey design error...

Remember the +/- 5% applies to both candidates, so the margin of error on the "lead" is actually 10%

Statistically there is a 68% chance the reported "lead" is within 5% - ie one out of 3 (32%) will report a lead that is wrong by 5% or more.

If Rasmussen does 40 of these state polls we can expect 10-15 of them to be wrong by more than 5%, and that is assuming ONLY normal statistical errors, without any additional errors due to the way he is actually doing these polls.

These things are pretty darn dicy in my estimation...

Maybe Rasmussen is just doing this to save money?

These "polls" cost him nothing - he has already collected all the data, he just has to add them up and he gets "free" polls to use... ?

Link to Arkansas Polling (http://www.uselectionatlas.org/FORUM/index.php?board=5;action=display;threadid=4455)


Title: Re:Arkansas Rasmussen poll!
Post by: Lunar on June 06, 2004, 07:33:52 PM
Going off the 2000 voting numbers, an absolute perfect likely voter survey of 600 would include 1 person from Wyoming.


Title: Re:Arkansas Rasmussen poll!
Post by: muon2 on June 06, 2004, 07:56:06 PM
I agree with the Vorlon. The systematic bias in the smaller states makes any results suspect. I haven't seen any evidence from Rasmussen that they are properly correcting for the kind of bias due to breaking a national sample into state pieces.


Title: Re:Arkansas Rasmussen poll!
Post by: Fmr. Gov. NickG on June 07, 2004, 09:15:44 AM

I don't understand: Rasmussen says the MoE for these small states is 5%, which would mean a sample size of about 500.  

But if you take 500 people a day, you'll only get about 4 or 5 each day from Arkansas, Alabama, Oregon, and South Carolina and only two/day from Maine.  This would be samples of 120-150 for the medium-sized states, a MoE of around 9%, and an insanely small 60 person sample for Maine.  

Is Rasmsussen oversampling the small states, or it this whole project BS?


Title: Re:Arkansas Rasmussen poll!
Post by: DarthKosh on June 07, 2004, 09:17:29 AM

I don't understand: Rasmussen says the MoE for these small states is 5%, which would mean a sample size of about 500.  

But if you take 500 people a day, you'll only get about 4 or 5 each day from Arkansas, Alabama, Oregon, and South Carolina and only two/day from Maine.  This would be samples of 120-150 for the medium-sized states, a MoE of around 9%, and an insanely small 60 person sample for Maine.  

Is Rasmsussen oversampling the small states, or it this whole project BS?

I put my vote with BS.


Title: Re:Arkansas Rasmussen poll!
Post by: The Vorlon on June 07, 2004, 09:39:08 AM

I don't understand: Rasmussen says the MoE for these small states is 5%, which would mean a sample size of about 500.  

But if you take 500 people a day, you'll only get about 4 or 5 each day from Arkansas, Alabama, Oregon, and South Carolina and only two/day from Maine.  This would be samples of 120-150 for the medium-sized states, a MoE of around 9%, and an insanely small 60 person sample for Maine.  

Is Rasmsussen oversampling the small states, or it this whole project BS?

Actually, +/- 5% is only a sample of about 400 (384 if we want to be picky)

Yes he is oversampling, and/or doing supplemental interviews in ceratin states to get up to a minimum sample size.

Three states which (I think) might blow up real bad on Rasmussen are Colorado, Arizona, and Washington.  I am curious about Nevada also.

These states are big enough that most of their interviews will be "subset" interviews from the daily tracks all put together.

Since the really little states will be mostly suplemental interviews they "might" be ok.

The statistical validity of this thing is getting pretty thin... IMHO.

And again, at +/- 5% if we get 40 of these state polls, be can expect 10-15 of them to be wrong by more than 5%.


Title: Re:Arkansas Rasmussen poll!
Post by: Fmr. Gov. NickG on June 07, 2004, 10:10:13 AM

I don't understand: Rasmussen says the MoE for these small states is 5%, which would mean a sample size of about 500.  

But if you take 500 people a day, you'll only get about 4 or 5 each day from Arkansas, Alabama, Oregon, and South Carolina and only two/day from Maine.  This would be samples of 120-150 for the medium-sized states, a MoE of around 9%, and an insanely small 60 person sample for Maine.  

Is Rasmsussen oversampling the small states, or it this whole project BS?

Actually, +/- 5% is only a sample of about 400 (384 if we want to be picky)

Yes he is oversampling, and/or doing supplemental interviews in ceratin states to get up to a minimum sample size.

Three states which (I think) might blow up real bad on Rasmussen are Colorado, Arizona, and Washington.  I am curious about Nevada also.

These states are big enough that most of their interviews will be "subset" interviews from the daily tracks all put together.

Since the really little states will be mostly suplemental interviews they "might" be ok.

The statistical validity of this thing is getting pretty thin... IMHO.

And again, at +/- 5% if we get 40 of these state polls, be can expect 10-15 of them to be wrong by more than 5%.

Ah, I see that now at the bottom of each article.  This could actually make the small state polls more reliable than the larger state polls.  And I meant 400 instead of 500...sorry.


Title: Re:Arkansas Rasmussen poll!
Post by: The Vorlon on June 07, 2004, 10:21:23 AM

I don't understand: Rasmussen says the MoE for these small states is 5%, which would mean a sample size of about 500.  

But if you take 500 people a day, you'll only get about 4 or 5 each day from Arkansas, Alabama, Oregon, and South Carolina and only two/day from Maine.  This would be samples of 120-150 for the medium-sized states, a MoE of around 9%, and an insanely small 60 person sample for Maine.  

Is Rasmsussen oversampling the small states, or it this whole project BS?

Actually, +/- 5% is only a sample of about 400 (384 if we want to be picky)

Yes he is oversampling, and/or doing supplemental interviews in ceratin states to get up to a minimum sample size.

Three states which (I think) might blow up real bad on Rasmussen are Colorado, Arizona, and Washington.  I am curious about Nevada also.

These states are big enough that most of their interviews will be "subset" interviews from the daily tracks all put together.

Since the really little states will be mostly suplemental interviews they "might" be ok.

The statistical validity of this thing is getting pretty thin... IMHO.

And again, at +/- 5% if we get 40 of these state polls, be can expect 10-15 of them to be wrong by more than 5%.

Ah, I see that now at the bottom of each article.  This could actually make the small state polls more reliable than the larger state polls.  And I meant 400 instead of 500...sorry.

Does a sample size of 400 (+/-5%) = "reliable"..? :)

BTW - I posted a partial release of M/Ds poll of West Virginia.