Sample sizes?
Likely voters?
Margin of error?

On Nov. 5, election officials across America will count more than 150 million ballots to answer a burning political question: Who will be president of the United States? Until then, the best signals we can get will mostly come from public opinion polls, which will be the fuel of endless debate on who has the lead, Democrat Joe Biden or Republican Donald Trump. But what do polls really tell us? Like a picture from a weather satellite, a poll can be pretty good at telling you what people think right now. It's much harder to tell what people will be doing weeks or months from now.

SAMPLE SIZE

Some polls ask a few hundred people what they think. Others ask several thousand. The number of people surveyed is called the sample size. A big sample is like having more pixels in a digital photo. The more people surveyed, the clearer the picture.

Each person in a poll is like a pixel in an image – the more you have, the clearer the image. But not every pixel is necessary.

HOW TO READ BETWEEN THE LINES

Pollsters usually tell us how clear the picture is by giving a margin of error. A big margin might mean that the picture may be too fuzzy to draw clear conclusions. Also, the margin applies to each estimate in a poll. If one candidate has a lead over another, that lead should be about twice as large as the margin in order for the advantage to be meaningful.

Anytime the Margin Of Error (currently 10%) overlaps, it's best to view the poll as a tie. Twice the MOE signals a clear lead.

Go ahead, see for yourself!

40%
60%
It’s a tie!
0% 50% 100%

SHIFT THE DIFFERENCE

or

THE MARGIN OF ERROR

The margin of error is tied to the number of people in a poll and the larger the sample size the smaller the margin of error. The margin serves to give a little wiggle room when extrapolating the results of a 1,000 person sample to the entire nation.

If candidate A is leading by 1 point in the latest poll

(with a 4% margin of error)

THESE ARE ALL POSSIBLE

Candidate A is 5 points ahead ofCandidate B

Candidate A is 4 points ahead ofCandidate B

Candidate A is 3 points ahead ofCandidate B

Candidate A is 2 points ahead ofCandidate B

Candidate A is 1 point ahead ofCandidate B

most likely

Candidate A is  about even with Candidate B

Candidate A is 1 point behind Candidate B

Candidate A is 2 points behind Candidate B

Candidate A is 3 points behind Candidate B

Pollsters usually describe the margin as having a 95% confidence interval. That means that if they did the poll 100 times, the results would be expected to fall within the margin 95 times.

WHO ARE WE POLLING AND WHY?

A lot of people don't vote. So as elections approach and people want to know who is going to win, pollsters try to focus on the people who will actually be casting ballots.

Many polls describe their sample as hundreds or thousands of registered voters, who are more likely to vote than those who aren't registered.

Other polls focus on "likely voters" which are based on complicated statistical models. Some pollsters guard their methodology as a trade secret. Their assumptions are important because even if the sample is large and the margin is small, poll findings might look very different from election results if the pollster is wrong in projecting who will cast a ballot.

Voters also change their minds. Pollsters often ask people who they would vote for if the election were today, even if that election is six months or a year away.

Making predictions is hard,

especially about the future

POLLING AND THE ELECTORAL COLLEGE

Many polls are based on responses gathered nationwide and give an idea of the share of the votes in the election each candidate might get. But the popular vote doesn't determine who will be president. The winner is determined by an arcane body known as the Electoral College, which divides 538 electors across U.S. states and the District of Columbia. A handful of states determine the course of the election, and the winner of the popular vote sometimes loses the Electoral College. That makes polls in states such as Pennsylvania and Arizona particularly important, though keep in mind there may not be many battleground state polls and their sample sizes could be small.

Popular vote and electoral vote counts can vary widely

Presidential election winners in the last 100 years and the difference between the share of the electoral vote won and the share of the popular vote won.

A chart showing presidential elections from 1920 to 2020 and the difference between the share of the popular votes and electoral votes won.

WEIGHTING, OR ADJUSTING THE DATA TO FIT AMERICA

How do we know a poll actually represents America? When pollsters go about surveying people, they try to make sure they are getting responses from all sorts of people. They ask people about their race, ethnicity, gender, education and where they live. Then they check that the mix of people in the poll matches the Census Bureau’s estimates on the mix of people that make up the whole country.

No HS
HS/GED
Some college
Bachelor’s degree
Master’s degree or above
Match the population by moving the sliders

HOW TO MAKE SENSE OF IT ALL

It helps to look at lots of polls. There might be more polls done nationally than in the battleground states that will decide the election. Look at both. Remember that every poll has a margin of error so the results might look like they are whip-sawing. Averages of those polls will smooth out the trend.

“I think the way to really use polling most effectively is to read a lot of them... understand that no single one is going to tell you the truth, but that you have to sort of triangulate a truth from all of the (polls) that you're seeing.”

-Chris Jackson, Ipsos

Sources

Ipsos, American Presidency Project

Additional reporting by

Ben Kellerman

Editing by

Scott Malone, Julia Wolfe and Alistair Bell