Non-Gallup/Rasmussen tracking polls thread
       |           

Welcome, Guest. Please login or register.
Did you miss your activation email?
March 28, 2024, 05:47:04 PM
News: Election Simulator 2.0 Released. Senate/Gubernatorial maps, proportional electoral votes, and more - Read more

  Talk Elections
  Election Archive
  Election Archive
  2008 Elections
  2008 U.S. Presidential General Election Polls
  Non-Gallup/Rasmussen tracking polls thread
« previous next »
Pages: 1 ... 23 24 25 26 27 [28] 29 30 31 32
Author Topic: Non-Gallup/Rasmussen tracking polls thread  (Read 140429 times)
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #675 on: November 10, 2008, 09:21:37 AM »
« edited: November 10, 2008, 11:11:44 AM by Alcon »

I can include the national trackers too, if you like, but in proportion to their interviews.  Again, there is no logical reason reason to weight them any more strongly than state polls with an equal number of interviews.

I don't want to throw out polls afterward no matter who it is favorable to.  It is unscientific.  It will enter our own experimental bias into the mix.  There is no reason whatsoever not to throw them out beforehand.  Which of the listed polls do you want to remove?

The fact that you're defending something by arguing I should do it because it might show the results I like, is exactly why people are skeptical of your analytical abilities.
Logged
Sam Spade
SamSpade
Atlas Star
*****
Posts: 27,547


Show only this user's posts in this thread
« Reply #676 on: November 10, 2008, 10:32:21 AM »

This thread is hilarious.
Logged
J. J.
Atlas Superstar
*****
Posts: 32,892
United States


Show only this user's posts in this thread
« Reply #677 on: November 10, 2008, 03:33:43 PM »

I can include the national trackers too, if you like, but in proportion to their interviews.  Again, there is no logical reason reason to weight them any more strongly than state polls with an equal number of interviews.

I don't want to throw out polls afterward no matter who it is favorable to.  It is unscientific.  It will enter our own experimental bias into the mix.  There is no reason whatsoever not to throw them out beforehand.  Which of the listed polls do you want to remove?

The fact that you're defending something by arguing I should do it because it might show the results I like, is exactly why people are skeptical of your analytical abilities.

I'd like to look just at state polls for now; the tracing polls were just an example.

Okay, look at all the polls in a given state from 10/28 onward, or you can limit that to 10/29.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #678 on: November 10, 2008, 05:54:56 PM »

All right.  Again, which pollsters do you want to throw out of the above list?
Logged
J. J.
Atlas Superstar
*****
Posts: 32,892
United States


Show only this user's posts in this thread
« Reply #679 on: November 10, 2008, 06:18:38 PM »

All right.  Again, which pollsters do you want to throw out of the above list?

And again, none.  Let's look at the last week of state polling, from 10/28 onward.  The only ones (and I can only think of one of these) that shouldn't be counted would be state tracking polls.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #680 on: November 10, 2008, 07:05:57 PM »

All right.  Again, which pollsters do you want to throw out of the above list?

And again, none.  Let's look at the last week of state polling, from 10/28 onward.  The only ones (and I can only think of one of these) that shouldn't be counted would be state tracking polls.

I don't see why not?  State tracking polls are just three-day polls that roll.  In its last instance, Muhlenberg was just a three-day poll.  Why not use it?

Other than that, I still need you to pick one of the following:

Quote
You must be logged in to read this quote.

Then we'll get to 'er.
Logged
Torie
Moderators
Atlas Legend
*****
Posts: 46,057
Ukraine


Political Matrix
E: -3.48, S: -4.70

Show only this user's posts in this thread
« Reply #681 on: November 10, 2008, 07:56:34 PM »

So have we figured out yet why McCain did a couple of percent better than the polls in general, apparently?  You know what?  We might not really know. Oh the horror, the horror!  By the way, Obama will be close to a 7% lead before this is all over I suspect.
Logged
Verily
Cuivienen
Atlas Icon
*****
Posts: 16,663


Political Matrix
E: 1.81, S: -6.78

Show only this user's posts in this thread
« Reply #682 on: November 10, 2008, 08:05:16 PM »

So have we figured out yet why McCain did a couple of percent better than the polls in general, apparently?  You know what?  We might not really know. Oh the horror, the horror!  By the way, Obama will be close to a 7% lead before this is all over I suspect.

Obama is now at a 6.5-point lead, and that will probably still grow a bit with Oregon, Washington, Georgia (Fulton County, a heavily Dem area), New York and Illinois still not fully counted (plus absentees and provisionals).

http://www.politico.com/electionmap2008/index.html
Logged
Lief 🗽
Lief
Atlas Legend
*****
Posts: 44,876


Show only this user's posts in this thread
« Reply #683 on: November 10, 2008, 08:09:01 PM »

So have we figured out yet why McCain did a couple of percent better than the polls in general, apparently?  You know what?  We might not really know. Oh the horror, the horror!  By the way, Obama will be close to a 7% lead before this is all over I suspect.
Historically, it's common for the candidate with a large lead to overpoll a small amount. Yes, even the whites ones, JJ.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #684 on: November 10, 2008, 08:16:53 PM »

So have we figured out yet why McCain did a couple of percent better than the polls in general, apparently?  You know what?  We might not really know. Oh the horror, the horror!  By the way, Obama will be close to a 7% lead before this is all over I suspect.
Historically, it's common for the candidate with a large lead to overpoll a small amount. Yes, even the whites ones, JJ.

This is true, and an argument to be had if Obama overpolled to statistical significance.
Logged
J. J.
Atlas Superstar
*****
Posts: 32,892
United States


Show only this user's posts in this thread
« Reply #685 on: November 10, 2008, 08:39:24 PM »

All right.  Again, which pollsters do you want to throw out of the above list?

And again, none.  Let's look at the last week of state polling, from 10/28 onward.  The only ones (and I can only think of one of these) that shouldn't be counted would be state tracking polls.

I don't see why not?  State tracking polls are just three-day polls that roll.  In its last instance, Muhlenberg was just a three-day poll.  Why not use it?

I think it has a smaller sample size.  It's also, as a tracker, designed to do something slightly different that a standard state poll.

Quote
You must be logged in to read this quote.

Then we'll get to 'er.
[/quote]

The first thing I'd like to look at are the states where McCain underperformed on the final set of polls verses those where he over performed (and the same date on Obama). 

I'd then like the subset where McCain underperformed outside the MOE (and Obama underperformed outside of the MOE).

I'll look at margin later.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #686 on: November 10, 2008, 08:52:04 PM »

No, as a tracker, it's the same as a state poll.  It's still interviews being conducted over a three-day period.  Muhlenberg's three-day sample size was 618, bigger than Insider Advantage, ARG, Zogby, and only 7 fewer responses than Mason-Dixon.  No reason to throw it out.  It's a minor point, though, but unless you know something about Muhlenberg I don't, I have to include it for consistency if we're including all polls.

So, in other words, you want option B?  That's ([Obama minus final Obama]-[McCain versus final McCain]).

And to clarify, you want all polls, not just the recognized national ones I listed?

Once I get your response on that, I'll compile the results and check for statistical significance.
Logged
J. J.
Atlas Superstar
*****
Posts: 32,892
United States


Show only this user's posts in this thread
« Reply #687 on: November 10, 2008, 09:35:09 PM »

So have we figured out yet why McCain did a couple of percent better than the polls in general, apparently?  You know what?  We might not really know. Oh the horror, the horror!  By the way, Obama will be close to a 7% lead before this is all over I suspect.
Historically, it's common for the candidate with a large lead to overpoll a small amount. Yes, even the whites ones, JJ.

This is true, and an argument to be had if Obama overpolled to statistical significance.

Actually, that wasn't true in a race I looked at a while back, Casey in 2006.  He underpolled slightly.  Both Swann and Rendell underpolled
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #688 on: November 10, 2008, 09:36:49 PM »

Actually, that wasn't true in a race I looked at a while back, Casey in 2006.  He underpolled slightly.  Both Swann and Rendell underpolled

It is not an exceptionless rule (what is -- ever?).  However, FiveThirtyEight did a table and determined that it does tend to happen presidentially.

You didn't really answer either of my questions.  I can't start the procedure until you do.
Logged
J. J.
Atlas Superstar
*****
Posts: 32,892
United States


Show only this user's posts in this thread
« Reply #689 on: November 10, 2008, 09:42:49 PM »

No, as a tracker, it's the same as a state poll.  It's still interviews being conducted over a three-day period.  Muhlenberg's three-day sample size was 618, bigger than Insider Advantage, ARG, Zogby, and only 7 fewer responses than Mason-Dixon.  No reason to throw it out.  It's a minor point, though, but unless you know something about Muhlenberg I don't, I have to include it for consistency if we're including all polls.


Other than being on the top of my list of appallingly bad polls, I would prefer to to compare trackers (in any state) to non trackers.

Quote
You must be logged in to read this quote.

I think that is it, from roughly 10/28 to the final; it would be state by state, of course.  I'll readily agree that it doesn't occur in every state.  After that, I'd like to see where Obama and McCain's final were outside of the MOE.  Plus or minus.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #690 on: November 10, 2008, 09:44:47 PM »

But trackers are the same as a three-day poll.  Do you understand that?  There is no basis for considering them different entities.  They are the same as a three-day poll.  There's no difference.

Anyway, you didn't answer either of my questions, again.  Do you want all polls, regardless of pollster?  Is option B -- ([Obama minus final Obama]-[McCain versus final McCain]) -- acceptable?

I can even arbitrarily exclude Muhlenberg if you really really want.  Just realize that it makes no sense!
Logged
J. J.
Atlas Superstar
*****
Posts: 32,892
United States


Show only this user's posts in this thread
« Reply #691 on: November 11, 2008, 02:29:10 AM »

But trackers are the same as a three-day poll.  Do you understand that?  There is no basis for considering them different entities.  They are the same as a three-day poll.  There's no difference.

Anyway, you didn't answer either of my questions, again.  Do you want all polls, regardless of pollster?  Is option B -- ([Obama minus final Obama]-[McCain versus final McCain]) -- acceptable?

I can even arbitrarily exclude Muhlenberg if you really really want.  Just realize that it makes no sense!

Acceptable but please exclude Muhlenberg.  Yes I want the polls regardless of pollsters, but by state and after 10/28.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #692 on: November 11, 2008, 11:53:00 AM »

OK.  While I'm working on this, you can explain to everyone how the Muhlenberg tracking poll (612 phone interviews conducted over three days) is worth excluding while Insider Advantage (588 phone interviews conducted over three days) should be included.

go!
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #693 on: November 11, 2008, 12:44:00 PM »
« Edited: February 28, 2014, 04:23:21 AM by Grad Students are the Worst »

Too slow!  (But, seriously, keep working on that explanation.)

Anyway, done.  Excluding Muhlenberg and the UNH tracker, which I think is ridiculous and arbitrary but whatever, we have 135 state polls during the specified time period.

On average, they underestimated Obama -- yes, Obama -- by a 1.02% margin.  This was not statistically significant.

Of the 50 states, 37 had polling during this period.  Obama was under-estimated in 15, and over-estimated in 21.  Montana was an exact statistical hit.  More of McCain's 21 were small margin errors (i.e., <2.5%) or based on a single poll -- hence why all other measures showed Obama being the one under-estimated.

None of the aforementioned 36 were statistically significant, save for the following:

* Obama under-estimations in Massachuestts, Michigan, Nevada, New Mexico and Pennsylvania and Vermont.

* Obama over-estimations in Alaska (serious pollster meltdown there), Arizona, Arkansas, Iowa and Wyoming.

So, we have a statistically insignificant overall under-estimation of Obama.  There were five six states where Obama was under-estimated to statistical significance, and four where he was over-estimated.

Now, speaking of individual polls, 26 of 135 (19%) were off to statistical significance, which is actually a little bit better than a perfectly-conducted batch should be (the joys of weighting)

In any case, conclusions:

* On average, state polls slightly under-estimated Obama, but not to statistical significance.

* As one would expect with his overall being slightly under-estimated in the state polls, Obama's under-estimation achieved statistical significance in more states than did McCain's (6 vs. 4).

Iowa Arizona and one Obama-underpoll state (closed the window Kansas) narrowly missed SS.

* While Obama was over-estimated in more states than McCain, they tended to be states with few polls, and thus more potential for noise.  Of Obama's statistically significant under-estimations, all but MA had a good number of polls; only two of McCain's did (AK, AZ IA).

In closing, there is no strong evidence that polls under-estimated Obama.  However, there is no evidence whatsoever of a Bradley Effect, or any kind of Obama over-representation.  If it happened, it was eaten up by noise, an opposing pro-Obama effect, or perhaps was all a dream.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #694 on: November 11, 2008, 12:57:40 PM »

And just for fun, to further drive the point in, I looked at 538's time/sample size-adjusted model.  This is a bit more friendly to your thesis.  Obama was only under-estimated by 0.13% there, which is a lot further from statistical significance than 1.02%.  The biggest botch here wasn't Alaska, though; it was D.C., where the polls were off a whopping 20 points.  (Hawai'i was second-worse, another Obama under-estimation, then Alaska barely before another Obama under-estimation in Vermont.)

Convinced that you might be wrong about the Bradley Effect, yet?  Even a little?  My guess is "no."

(How's the tracker poll explanation going, btw?)

This is fun Tongue
Logged
Lunar
Atlas Superstar
*****
Posts: 30,404
Ireland, Republic of
Show only this user's posts in this thread
« Reply #695 on: November 11, 2008, 01:01:12 PM »

I think it's time to retroactively throw some polls out.
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #696 on: November 11, 2008, 01:03:31 PM »

I think it's time to retroactively throw some polls out.

Amusingly, throwing tracking polls out (very barely) increases Obama's under-estimation, since Muhlenberg was a little bit less pro-McCain in PA than UNH was pro-Obama in NH.
Logged
J. J.
Atlas Superstar
*****
Posts: 32,892
United States


Show only this user's posts in this thread
« Reply #697 on: November 11, 2008, 04:18:23 PM »
« Edited: November 11, 2008, 04:26:12 PM by J. J. »

Alcon, my thought was a 1-2 point overestimation of Obama, nationally and that the states could give mixed results. 

Now, in what  states where Obama overpolled did McCain underpoll?

In what states did McCain overpolled did Obama underpoll?
Logged
Alcon
Atlas Superstar
*****
Posts: 30,867
United States


Show only this user's posts in this thread
« Reply #698 on: November 11, 2008, 05:31:35 PM »



Still waiting to find out why a three-day tracker is different than a three-day poll, btw.
Logged
Lunar
Atlas Superstar
*****
Posts: 30,404
Ireland, Republic of
Show only this user's posts in this thread
« Reply #699 on: November 11, 2008, 05:55:23 PM »
« Edited: November 11, 2008, 06:02:06 PM by Lunar »



Still waiting to find out why a three-day tracker is different than a three-day poll, btw.

...wait, you mean that polling accuracy fluctuates up and down, possibly due to poor weighting, and it's stupid to apply analysis to tiny amounts of error without statistical significance, especially if it doesn't stand out from the overall sample?
Logged
Pages: 1 ... 23 24 25 26 27 [28] 29 30 31 32  
« previous next »
Jump to:  


Login with username, password and session length

Terms of Service - DMCA Agent and Policy - Privacy Policy and Cookies

Powered by SMF 1.1.21 | SMF © 2015, Simple Machines

Page created in 0.058 seconds with 13 queries.