Source: Who or what is the source?
- Who is presenting the statistics?
The data source and the reporter/citer/publisher are not always the same.
- Can you trace the data or statistics back to the original source?
- Who collected the data?
- What are the credentials of the original source?
- If the source is unclear, be skeptical about the data/statistics.
- Make sure it's a source you can trust.
Motive: What’s in it for them?
- What was the purpose of the collection or study? Why was the information collected?
- Who was the intended audience for or users of the data/statistics?
- Was it collected as part of the mission of an organization, for advocacy, or for business purposes?
- Does the reporter/citer/publisher have a known bias? (A special interest or particular point of view)
Try to get as close to the data source as possible.
- Do the statistics/data from the reporter/citer/publisher match the statistics/data of the data source?
- Does the data source have a known bias?
- Biased sources can be accurate, but you need to check them carefully.
Authority: Who produced the data/statistics?
- What are the author's/data producer's credentials?
- How widely known or cited is the producer?
- Who else uses the data?
- Is the producer an expert on the subject?
- If an individual, what organizations are they associated with? Could that association affect the work?
Review: Go over the collection methods & completeness carefully.
- What methodology was used? Is the methodology documented?
- How are the data collected - count, measurement, or estimation?
- What was the total sample size? How does that compare to the size of the population it is supposed to represent?
- What methods were used to select the sample population? How was the population sampled? (Was it self-selection, random sample, etc)
- What populations were included and/or excluded?
- If a survey:
- What was the response rate?
- Can you read the survey questions used?
- Are there any notable errors in facts or conclusions?
- Is the information current enough?
Remember that there is often a delay between data collection and data reporting because analysis and publication take time.
- Does it sound reasonable/plausible?
Two-source Test: Double check everything if possible.
- Do other sources provide similar numbers?
Research the subject in library resources or online
- Does your two-source test confirm or contradict the data/statistics?
Content on this page was adapted from "Savvy Info Consumers: Data & Statistics" by University of Washington Libraries.
