Evaluating Sources

Whenever you locate a source—print or electronic—you should always take the time to evaluate it. When you evaluate a source, you assess the objectivity of the author, the credibility of the source, and its relevance to your argument. (Although a librarian or an instructor has screened the print and electronic sources in your college library for general accuracy and trustworthiness, you cannot simply assume that these sources are suitable for your particular writing project.)

The photograph shows three open books lying one above other on the middle of a table and on the left and right of this a pile of books are kept. A long book shelf can be seen the background.

Sources must be evaluated carefully.

©Viorika Prikhodko/iStock/Getty Images

Material that you access online presents particular problems. Because anyone can publish on the Internet, the information you find there has to be evaluated carefully for accuracy. Although some material on the Internet (for example, journal articles that are published in both print and digital format) is reliable, other material (for example, personal websites and blogs) may be unreliable and unsuitable for your research. To be reasonably certain that the information you are accessing is appropriate, you have to approach it critically.

As you locate sources, make sure that they are suitable for your research. (Remember, if you use an untrustworthy source, you undercut your credibility.)

To evaluate sources, you use the same process that you use when you evaluate anything else. For example, if you are thinking about buying a laptop computer, you use several criteria to help you make your decision—for example, price, speed, memory, reliability, and availability of technical support. The same is true for evaluating research sources. You can use the following criteria to decide whether a source is appropriate for your research:

  • Accuracy

  • Credibility

  • Objectivity

  • Currency

  • Comprehensiveness

  • Authority

The illustrations on page 293 show where to find information that can help you evaluate a source.

Accuracy

A source is accurate when it is factual and free of errors. One way to judge the accuracy of a source is to compare the information it contains to that same information in several other sources. If a source has factual errors, then it probably includes other types of errors as well. Needless to say, errors in spelling and grammar should also cause you to question a source’s general accuracy.

You can also judge the accuracy of a source by checking to see if the author cites sources for the information that is discussed. Documentation can help readers determine both the quality of information in a source and the range of sources used. It can also show readers what sources a writer has failed to consult. (Failure to cite an important book or article should cause you to question the writer’s familiarity with a subject.) If possible, verify the legitimacy of some of the books and articles that a writer cites by seeing what you can find out about them online. If a source has caused a great deal of debate or if it is disreputable, you will probably be able to find information about the source by researching it on Google.

Credibility

A source is credible when it is believable. You can begin checking a source’s credibility by determining where a book or article was published. If a university press published the book, you can be reasonably certain that it was peer reviewed —read by experts in the field to confirm the accuracy of the information. If a commercial press published the book, you will have to consider other criteria—the author’s reputation and the date of publication, for example—to determine quality. If your source is an article, see if it appears in a scholarly journal —a periodical aimed at experts in a particular field—or in a popular magazine —a periodical aimed at general readers. Journal articles are almost always acceptable research sources because they are usually documented, peer reviewed, and written by experts. (They can, however, be difficult for general readers to understand.) Articles in high-level popular magazines, such as the Atlantic and the Economist, may also be suitable—provided experts wrote them. However, articles in lower-level popular magazines—such as Sports Illustrated and Time —may be easy to understand, but they are seldom acceptable sources for research.

You can determine how well respected a source is by reading reviews written by critics. You can find reviews of books by consulting Book Review Digest —either in print or online—which lists books that have been reviewed in at least three magazines or newspapers and includes excerpts of reviews. In addition, you can consult the New York Times Book Review website—www.nytimes.com/pages/books/index.html—to access reviews printed by the newspaper since 1981. (Both professional and reader reviews are also available at Amazon.com.)

The image shows the cover page of a book. “TOMMIE SHELBY” is written on the top of the page which is marked as the “Author”. The title of the book is “We Who Are Dark: The Philosophical Foundations of Black Solidarity”. The bottom of the page reads “The Belknap of Harvard University Press. Cambridge, Massachusetts London, England 2005” is marked as Publisher.
The image shows an inner side of the cover page which starts with ‘Copyright © 2005 by the President and Fellows of Harvard College All rights reserved is marked as Date of Publication. “Includes bibliographical references and index” Contents: Two conceptions of Black nationalism—Class, poverty, and shame—Black power nationalism—Black solidarity after Black power—Race, culture, and politics—Social identity and group solidarity.” These are marked as Sources Cited.

Finally, you can determine how well respected a source is by seeing how often other scholars in the field refer to it. Citation indexes indicate how often books and articles are mentioned by other sources in a given year. This information can give you an idea of how important a work is in a particular field. Citation indexes for the humanities, the social sciences, and the sciences are available online and in your college library.

Objectivity

A source is objective when it is not unduly influenced by personal opinions or feelings. Ideally, you want to find sources that are objective, but to one degree or another, all sources are biased. In short, all sources—especially those that take a stand on an issue—reflect the opinions of their authors, regardless of how hard they may try to be impartial. (Of course, an opinion is perfectly acceptable—as long as it is supported by evidence.)

As a researcher, you should recognize that bias exists and ask yourself whether a writer’s assumptions are justified by the facts or are simply the result of emotion or preconceived ideas. You can make this determination by looking at a writer’s choice of words and seeing if the language is slanted or by reviewing the writer’s points and seeing if his or her argument is one-sided. Get in the habit of asking yourself whether you are being offered a legitimate point of view or simply being fed propaganda.

The cover page of “THE NEW YORKER”.

The covers of the liberal and conservative magazines shown here suggest different biases.

© Roz Chast/The New Yorker

The cover page of “TOWNHALL” magazine.

The covers of the liberal and conservative magazines shown here suggest different biases.

© Yasamin Khalili/Townhall Magazine

Currency

A source is current when it is up-to-date. (For a book, you can find the date of publication on the copyright page, as above. For an article, you can find the date on the front cover of the magazine or journal.) If you are dealing with a scientific subject, the date of publication can be very important. Older sources might contain outdated information, so you want to use the most up-to-date source that you can find. For other subjects—literary criticism, for example—the currency of the information may not be as important as it is in the sciences.

Comprehensiveness

A source is comprehensive when it covers a subject in sufficient depth. The first thing to consider is whether the source deals specifically with your subject. (If it treats your subject only briefly, it will probably not be useful.) Does it treat your subject in enough detail? Does the source include the background information that you need to understand the discussion? Does the source mention other important sources that discuss your subject? Are facts and interpretations supported by the other sources you have read, or are there major points of disagreement? Finally, does the author include documentation?

How comprehensive a source needs to be depends on your purpose and audience as well as on your writing assignment. For a short essay for an introductory course, editorials from the New York Times or the Wall Street Journal might give you enough information to support your argument. If you are writing a longer essay, however, you might need to consult journal articles (and possibly books) about your subject.

Authority

A source has authority when a writer has the expertise to write about a subject. Always try to determine if the author is a recognized authority or simply a person who has decided to write about a particular topic. For example, what other books or articles has the author written? Has your instructor ever mentioned the author’s name? Is the author mentioned in your textbook? Has the author published other works on the same subject or on related subjects? (You can find this information on Amazon.com.)

You should also determine if the author has an academic affiliation. Is he or she a faculty member at a respected college or university? Do other established scholars have a high opinion of the author? You can often find this information by using a search engine such as Google or by consulting one of the following directories:

Contemporary Authors

Directory of American Scholars

International Who’s Who

National Faculty Directory

Who’s Who in America

Wilson Biographies Plus Illustrated

Evaluating Websites

The Internet is like a freewheeling frontier town in the old West. Occasionally, a federal marshal may pass through, but for the most part, there is no law and order, so you are on your own. On the Internet, literally anything goes—exaggerations, misinformation, errors, and even complete fabrications. Some websites contain reliable content, but many do not. The main reason for this situation is that there is no authority—as there is in a college library—who evaluates sites for accuracy and trustworthiness. That job falls to you, the user.

Another problem is that websites often lack important information. For example, a site may lack a date, a sponsoring organization, or even the name of the author of the page. For this reason, it is not always easy to evaluate the material you find there.

inline

Most sources found in a college library have been evaluated by a reference librarian for their suitability as research sources.

© Steve Hix/Somos Images/Corbis

When you evaluate a website (especially when it is in the form of a blog or a series of posts), you need to begin by viewing it skeptically—unless you know for certain that it is reliable. In other words, assume that its information is questionable until you establish that it is not. Then apply the same criteria you use to evaluate any sources—accuracy, credibility, objectivity, currency, comprehensiveness, and authority.

The Web page pictured on page 303 shows where to find information that can help you evaluate a website.

Accuracy

Information on a website is accurate when it is factual and free of errors. Information in the form of facts, opinions, statistics, and interpretations is everywhere on the Internet, and in the case of Wiki sites, this information is continually being rewritten and revised. Given the volume and variety of this material, it is a major challenge to determine its accuracy. You can assess the accuracy of information on a website by asking the following questions:

  • Does the site contain errors of fact? Factual errors—inaccuracies that relate directly to the central point of the source—should immediately disqualify a site as a reliable source.

  • Does the site contain a list of references or any other type of documentation? Reliable sources indicate where their information comes from. The authors know that people want to be sure that the information they are using is accurate and reliable. If a site provides no documentation, you should not trust the information it contains.

  • Does the site provide links to other sites? Does the site have links to reliable websites that are created by respected authorities or sponsored by trustworthy institutions? If it does, then you can conclude that your source is at least trying to maintain a certain standard of quality.

  • Can you verify information? A good test for accuracy is to try to verify key information on a site. You can do this by checking it in a reliable print source or on a good reference website such as Encyclopedia.com.

Credibility

Information on a website is credible when it is believable. Just as you would not naively believe a stranger who approached you on the street, you should not automatically believe a site that you randomly encounter on the Web. You can assess the credibility of a website by asking the following questions:

  • Does the site list authors, directors, or editors? Anonymity—whether on a website or on a blog—should be a red flag for a researcher who is considering using a source.

  • Is the site refereed? Does a panel of experts or an advisory board decide what material appears on the website? If not, what standards are used to determine the suitability of content?

  • Does the site contain errors in grammar, spelling, or punctuation? If it does, you should be on the alert for other types of errors. If the people maintaining the site do not care enough to make sure that the site is free of small errors, you have to wonder if they will take the time to verify the accuracy of the information presented.

  • Does an organization sponsor the site? If so, do you know (or can you find out) anything about the sponsoring organization? Use a search engine such as Google to determine the purpose and point of view of the organization.

The image shows a web page of the ‘Mexican Migration Project’.

Courtesy from the Mexican Migration Project, mmp.opr.princeton.edu.

Objectivity

Information on a website is objective when it limits the amount of bias that it displays. Some sites—such as those that support a particular political position or social cause—make no secret of their biases. They present them clearly in their policy statements on their home pages. Others, however, try to hide their biases—for example, by referring only to sources that support a particular point of view and not mentioning those that do not.

Keep in mind that bias does not automatically disqualify a source. It should, however, alert you to the fact that you are seeing only one side of an issue and that you will have to look further to get a complete picture. You can assess the objectivity of a website by asking the following questions:

  • Does advertising appear on the site? If the site contains advertising, check to make sure that the commercial aspect of the site does not affect its objectivity. The site should keep advertising separate from content.

  • Does a commercial entity sponsor the site? A for-profit company may sponsor a website, but it should not allow commercial interests to determine content. If it does, there is a conflict of interest. For example, if a site is sponsored by a company that sells organic products, it may include testimonials that emphasize the virtues of organic products and ignore information that is skeptical of their benefits.

  • Does a political organization or special-interest group sponsor the site? Just as you would for a commercial site, you should make sure that the sponsoring organization is presenting accurate information. It is a good idea to check the information you get from a political site against information you get from an educational or a reference site—Ask.com or Encyclopedia.com, for example. Organizations have specific agendas, and you should make sure that they are not bending the truth to satisfy their own needs.

  • Does the site link to strongly biased sites? Even if a site seems trustworthy, it is a good idea to check some of its links. Just as you can judge people by the company they keep, you can also judge websites by the sites they link to. Links to overly biased sites should cause you to reevaluate the information on the original site.

Currency

Information on a website is current when it is up-to-date. Some sources—such as fiction and poetry—are timeless and therefore are useful whatever their age. Other sources, however—such as those in the hard sciences—must be current because advances in some disciplines can quickly make information outdated. For this reason, you should be aware of the shelf life of information in the discipline you are researching and choose information accordingly. You can assess the currency of a website by asking the following questions:

  • Does the website include the date when it was last updated? As you look at Web pages, check the date on which they were created or updated. (Some websites automatically display the current date, so be careful not to confuse this date with the date the page was last updated.)

  • Are all links on the site live? If a website is properly maintained, all the links it contains will be live —that is, a click on the link will take you to other websites. If a site contains a number of links that are not live, you should question its currency.

  • Is the information on the site up-to-date? A site might have been updated, but this does not necessarily mean that it contains the most up-to-date information. In addition to checking when a website was last updated, look at the dates of the individual articles that appear on the site to make sure they are not outdated.

Comprehensiveness

Information on a website is comprehensive when it covers a subject in depth. A site that presents itself as a comprehensive source should include (or link to) the most important sources of information that you need to understand a subject. (A site that leaves out a key source of information or that ignores opposing points of view cannot be called comprehensive.) You can assess the comprehensiveness of a website by asking the following questions:

  • Does the site provide in-depth coverage? Articles in professional journals—which are available both in print and online—treat subjects in enough depth for college-level research. Other types of articles—especially those in popular magazines and in general encyclopedias, such as Wikipedia —are often too superficial (or untrustworthy) for college-level research.

  • Does the site provide information that is not available elsewhere? The website should provide information that is not available from other sources. In other words, it should make a contribution to your knowledge and do more than simply repackage information from other sources.

  • Who is the intended audience for the site? Knowing the target audience for a website can help you to assess a source’s comprehensiveness. Is it aimed at general readers or at experts? Is it aimed at high school students or at college students? It stands to reason that a site that is aimed at experts or college students will include more detailed information than one that is aimed at general readers or high school students.

Authority

Information on a website has authority when you can establish the legitimacy of both the author and the site. You can determine the authority of a source by asking the following questions:

  • Is the author an expert in the field that he or she is writing about? What credentials does the author have? Does he or she have the expertise to write about the subject? Sometimes you can find this information on the website itself. For example, the site may contain an “About the Author” section or links to other publications by the author. If this information is not available, do a Web search with the author’s name as a keyword. If you cannot confirm the author’s expertise (or if the site has no listed author), you should not use material from the site.

  • What do the links show? What information is revealed by the links on the site? Do they lead to reputable sites, or do they take you to sites that suggest that the author has a clear bias or a hidden agenda? Do other reliable sites link back to the site you are evaluating?

  • Is the site a serious publication? Does it include information that enables you to judge its legitimacy? For example, does it include a statement of purpose? Does it provide information that enables you to determine the criteria for publication? Does the site have a board of advisers? Are these advisers experts? Does the site include a mailing address and a phone number? Can you determine if the site is the domain of a single individual or the effort of a group of individuals?

  • Does the site have a sponsor? If so, is the site affiliated with a reputable institutional sponsor, such as a governmental, educational, or scholarly organization?