2020).
Format | Author surname, initial. (Year) . Available at: URL (Accessed: Day Month Year). |
Example | Google (2019) . Available at: https://policies.google.com/terms?hl=en-US (Accessed: 29 April 2020). |
Notes |
Format | Author surname, initial. (Year) ‘Article title’, , Date. Available at: URL (Accessed: Day Month Year). |
Example | Rakich, N. (2020) ‘How does Biden stack up to past Democratic nominees?’, , 28 April. Available at: https://fivethirtyeight.com/features/how-does-biden-stack-up-to-past-democratic-nominees/ (Accessed: 29 April 2020). |
Notes |
Format | Author surname, initial. [username] (Year) or text [Website name] Date. Available at: URL (Accessed: Day Month Year). |
Example | Dorsey, J. [@jack] (2018) We’re committing Twitter to help increase the collective health, openness, and civility of public conversation … [Twitter] 1 March. Available at: https://twitter.com/jack/status/969234275420655616 (Accessed: 29 April 2020). |
Notes |
Format | Author surname, initial. (Year) [Medium]. Institution, City or Available at: URL (Accessed: Day Month Year). |
Example | Bosch, H. (1482) [Triptych]. Groeningemuseum, Bruges. |
Notes |
Format | Author surname, initial. (Year) . Date. Available at: URL (Accessed: Day Month Year). |
Example | Vox (2020) . 10 April. Available at: https://youtu.be/BE-cA4UK07c (Accessed: 29 April 2020). |
Notes |
Format | Author surname, initial. (Year) ‘Article title’, , date, p. page number. Available at: URL (Accessed: Day Month Year). |
Example | Butler, S. (2020) ‘Women’s fashion manufacturer to make reusable gowns for NHS’, , 28 April. Available at: https://www.theguardian.com/society/2020/apr/28/womens-fashion-manufacturer-to-make-reusable-gowns-for-nhs (Accessed: 29 April 2020). |
Notes |
Format | Author surname, initial. (Year) ‘Article title’, , Volume(Issue) or (Month) or (Season), pp. page range. Available at: URL (Accessed: Day Month Year). |
Example | Newman, J. (2020) ‘For autistic youths entering adulthood, a new world of challenges awaits’, , (May), pp. 20–24. |
Notes |
When a source has up to three authors, list all of them in the order their names appear on the source. If there are four or more, give only the first name followed by ‘ et al. ’:
Number of authors | Reference example |
---|---|
1 author | Davis, V. (2019) … |
2 authors | Davis, V. and Barrett, M. (2019) … |
3 authors | Davis, V., Barrett, M. and McLachlan, F. (2019) … |
4+ authors | Davis, V. (2019) … |
Sometimes a source won’t list all the information you need for your reference. Here’s what to do when you don’t know the publication date or author of a source.
Some online sources, as well as historical documents, may lack a clear publication date. In these cases, you can replace the date in the reference list entry with the words ‘no date’. With online sources, you still include an access date at the end:
When a source doesn’t list an author, you can often list a corporate source as an author instead, as with ‘Scribbr’ in the above example. When that’s not possible, begin the entry with the title instead of the author:
Though the terms are sometimes used interchangeably, there is a difference in meaning:
In Harvard referencing, up to three author names are included in an in-text citation or reference list entry. When there are four or more authors, include only the first, followed by ‘ et al. ’
In-text citation | Reference list | |
---|---|---|
1 author | (Smith, 2014) | Smith, T. (2014) … |
2 authors | (Smith and Jones, 2014) | Smith, T. and Jones, F. (2014) … |
3 authors | (Smith, Jones and Davies, 2014) | Smith, T., Jones, F. and Davies, S. (2014) … |
4+ authors | (Smith , 2014) | Smith, T. (2014) … |
In Harvard style referencing , to distinguish between two sources by the same author that were published in the same year, you add a different letter after the year for each source:
Add ‘a’ to the first one you cite, ‘b’ to the second, and so on. Do the same in your bibliography or reference list .
To create a hanging indent for your bibliography or reference list :
If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.
Caulfield, J. (2022, November 07). Harvard Style Bibliography | Format & Examples. Scribbr. Retrieved 9 September 2024, from https://www.scribbr.co.uk/referencing/harvard-bibliography/
Other students also liked, a quick guide to harvard referencing | citation examples, harvard in-text citation | a complete guide & examples, referencing books in harvard style | templates & examples, scribbr apa citation checker.
An innovative new tool that checks your APA citations with AI software. Say goodbye to inaccurate citations!
An APA format bibliography lists all of the sources that might be used in a paper. A bibliography can be a great tool to help you keep track of information during the research and writing process. In some cases, your instructor may require you to include a bibliography as part of your assignment.
A well-written APA format bibliography can help you keep track of information and sources as you research and write your psychology paper. To create a bibliography, gather up all of the sources that you might use in your paper. Create an APA format reference for each source and then write a brief annotation. Your annotation should be a brief summary of what each reference is about. You can quickly refer to these annotations When writing your paper and determine which to include.
An APA format bibliography is an alphabetical listing of all sources that might be used to write an academic paper, essay, article, or research paper—particularly work that is covering psychology or psychology-related topics. APA format is the official style of the American Psychological Association (APA). This format is used by many psychology professors, students, and researchers.
Even if it is not a required part of your assignment, writing a bibliography can help you keep track of your sources and make it much easier to create your final reference page in proper APA format.
A bibliography is similar in many ways to a reference section , but there are some important differences. While a reference section includes every source that was actually used in your paper, a bibliography may include sources that you considered using but may have dismissed because they were irrelevant or outdated.
Bibliographies can be a great way to keep track of information you might want to use in your paper and to organize the information that you find in different sources. The following are four steps you can follow to create your APA format bibliography.
Your working bibliography should be kept separate from the rest of your paper. Start it on a new page, with the title "Bibliography" centered at the top and in bold text. Some people use the title "References" instead, so it's best to check with your professor or instructor about which they prefer you to use.
Compile all the sources you might possibly use in your paper. While you might not use all of these sources in your paper, having a complete list will make it easier later on when you prepare your reference section.
Gathering your sources can be particularly helpful when outlining and writing your paper.
By quickly glancing through your working bibliography, you will be able to get a better idea of which sources will be the most appropriate to support your thesis and main points.
Your references should be listed alphabetically by the author’s last name, and they should be double-spaced. The first line of each reference should be flush left, while each additional line of a single reference should be a few spaces to the right of the left margin, which is known as a hanging indent.
The format of each source is as follows for academic journals:
The following examples are scholarly articles in academic journals, cited in APA format:
Visit the American Psychological Association's website for more information on citing other types of sources including online media, audiovisual media, and more.
Normally a bibliography contains only references' information, but in some cases you might decide to create an annotated bibliography. An annotation is a summary or evaluation of the source.
An annotation is a brief description of approximately 150 words describing the information in the source, your evaluation of its credibility, and how it pertains to your topic. Writing one of these for each piece of research will make your writing process faster and easier.
This step helpful in determining which sources to ultimately use in your paper. Your instructor may also require it as part of the assignment so they can assess your thought process and understanding of your topic.
One of the biggest reasons to create an APA format bibliography is simply to make the research and writing process easier.
If you do not have a comprehensive list of all of your references, you might find yourself scrambling to figure out where you found certain bits of information that you included in your paper.
A bibliography is also an important tool that your readers can use to access your sources.
While writing an annotated bibliography might not be required for your assignment, it can be a very useful step. The process of writing an annotation helps you learn more about your topic, develop a deeper understanding of the subject, and become better at evaluating various sources of information.
The following is an example of an APA format bibliography by the website EasyBib:
There are many online resources that demonstrate different formats of bibliographies, including the American Psychological Association website . Purdue University's Online Writing Lab also has examples of formatting an APA format bibliography.
Check out this video on their YouTube channel which provides detailed instructions on formatting an APA style bibliography in Microsoft Word.
You can check out the Purdue site for more information on writing an annotated APA bibliography as well.
If you are taking a psychology class, you may be asked to create a bibliography as part of the research paper writing process. Even if your instructor does not expressly require a bibliography, creating one can be a helpful way to help structure your research and make the writing process more manageable.
For psychology majors , it can be helpful to save any bibliographies you have written throughout your studies so that you can refer back to them later when studying for exams or writing papers for other psychology courses.
American Psychological Association. Publication Manual of the American Psychological Association . 7th Edition. Washington, DC: American Psychological Association; 2020.
Masic I. The importance of proper citation of references in biomedical articles. Acta Inform Med . 2013;21(3):148–155. doi:10.5455/aim.2013.21.148-155
American Psychological Association. How do you format a bibliography in APA Style?
Cornell University Library. How to prepare an annotated bibliography: The annotated bibliography .
By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."
Learn how to easily write a bibliography by following the format outlined in this article.
This resource will help your students properly cite different resources in the bibliography of a research paper, and how to format those citations, for books, encyclopedias, films, websites, and people.
Add to Folder | |
---|---|
creative writing | |
children's book | |
activities | |
classroom tools | |
language arts and writing | |
vocabulary |
According to Infoplease.com, A bibliography is a list of the types of sources you used to get information for your report. It is included at the end of your report, on the last page (or last few pages).
The 3 most common bibliography/citation styles are:
We’ll give examples of how to create bibliography entries in various styles further down in this article.
An annotated bibliography should include a reference list of any sources you use in writing a research paper. Any printed sources from which you use a text citation, including books, websites, newspaper articles, journal articles, academic writing, online sources (such as PDFs), and magazines should be included in a reference list. In some cases, you may need or want to cite conversations or interviews, works of art, visual works such as movies, television shows, or documentaries - these (and many others) can also be included in a reference list.
You will find it easier to prepare your MLA, APA, or Chicago annotated bibliography if you keep track of each book, encyclopedia, journal article, webpage or online source you use as you are reading and taking notes. Start a preliminary, or draft, bibliography by listing on a separate sheet of paper all your sources. Note down the full title, author’s last name, place of publication, web address, publisher, and date of publication for each source.
Haven't started your paper yet and need an outline? These sample essay outlines include a research paper outline from an actual student paper.
General Format: Author (last name first). Title of the book. Publisher, Date of publication.
MLA Style: Sibley, David Allen. What It’s Like to Be a Bird. From Flying to Nesting, Eating to Singing, What Birds Are Doing, and Why. Alfred A. Knopf, 2020.
APA Style: Sibley, D.A. (2020). What It’s Like to Be a Bird. From Flying to Nesting, Eating to Singing, What Birds Are Doing, and Why . Alfred A. Knopf.
Notes: Use periods, not commas, to separate the data in the entry. Use a hanging indent if the entry is longer than one line. For APA style, do not use the full author’s first name.
MLA Style: The SB Nation Family of Sites. Pension Plan Puppets: A Toronto Maple Leafs Blog, 2022, www.pensionplanpuppets.com. Accessed 15 Feb. 2022.
APA Style: American Heart Association. (2022, April 11). How to keep your dog’s heart healthy. https://www.heart.org/en/news/2022/04/11/how-to-keep-your-dogs-heart-healthy
APA Style: Duehren, A. (2022, April 9). Janet Yellen faces challenge to keep pressure on Russia. Wall Street Journal. https://www.wsj.com/articles/janet-yellen-faces-challenge-to-keep-pressure-on-russia-while-addressing-global-consequences-11650366000
MLA Style: Booch, Grady. "Patterns in Object-Oriented Design." IEEE Software Engineering, vol. 6, no. 6, 2006, pp. 31-50.
APA Style: Booch, G. (2006). Patterns in object-oriented design. IEEE Software Engineering, 6(6), 31–50.
Note: It is suggested that you include a DOI and a webpage address when referencing either a printed journal article, and electronic journal article, or an journal article that appears in both formats.
MLA Style: Gamma, Eric, and Peter A. Coad. “Exceptions to the Unified Modeling Language in Python Patterns.” IEEE Software Engineering, vol. 2, no. 6, 8 Mar. 2006, pp. 190-194. O’Reilly Software Engineering Library, https://doi.org/10.1006/se.20061. Accessed 26 May 2009.
APA Style: Masters, H., Barron, J., & Chanda, L. (2017). Motivational interviewing techniques for adolescent populations in substance abuse counseling. NAADAC Notes, 7(8), 7–13. https://www.naadac.com/notes/adolescent-techniques
ML:A Style: @Grady_Booch. “That’s a bold leap over plain old battery power cars.” Twitter, 13 Mar. 2013, 12:06 p.m., https://twitter.com/Grady_Booch/status/1516379006727188483.
APA Style: Westborough Library [@WestboroughLib]. (2022, April 12). Calling all 3rd through 5th grade kids! Join us for the Epic Writing Showdown! Winner receives a prize! Space is limited so register, today. loom.ly/ypaTG9Q [Tweet; thumbnail link to article]. Twitter. https://twitter.com/WestboroughLib/status/1516373550415896588.
General format: Author (last name first), "Article Title." Name of magazine. Volume number, (Date): page numbers.
MLA Style: Stiteler, Sharon. "Tracking Red-Breasted Grosbeak Migration." Minnesota Bird Journal, 7 Sept. 2019, pp. 7-11.
APA Style: Jordan, Jennifer, "Filming at the Top of the World." Museum of Science Magazine. Volume 47, No. 1, (Winter 1998): p. 11.
General format: Author (last name first), "Article Title." Name of newspaper, city, state of publication. (date): edition if available, section, page number(s).
MLA Style: Adelman, Martin. "Augustus Announces Departure from City Manager Post." New York Times, late ed., 15 February 2020, p. A1
APA Style: Adelman, M. (2020, February 15). Augustus announced departure from city manager post. New York Times, A1.
General Format: Encyclopedia Title, Edition Date. Volume Number, "Article Title," page numbers.
MLA Style: “Gorillas.” The Encyclopedia Brittanica. 15th ed. 2010.
APA Style: Encyclopedia Brittanica, Inc. (1997.) Gorillas. In The Encyclopedia Brittanica (15th ed., pp. 50-51). Encyclopedia Brittanica, Inc.
General format: Full name (last name first). Personal Interview. (Occupation.) Date of interview.
MLA Style: Smithfield, Joseph. Personal interview. 19 May 2014.
APA Style: APA does not require a formal citation for a personal interview. Published interviews from other sources should be cited accordingly.
General format: Title, Director, Distributor, Year.
MLA Style: Fury. Directed by David Ayer, performances by Brad Pitt, Shia LaBeouf, Jon Bernthal, Sony Pictures, 2014.
APA Style: Ayer, D. (Director). (2014). Fury [Film]. Sony Pictures.
The TeacherVision editorial team is comprised of teachers, experts, and content professionals dedicated to bringing you the most accurate and relevant information in the teaching space.
Free printable to elevate your AI game 🤖
Give credit where credit is due.
Writing a research paper involves a lot of work. Students need to consult a variety of sources to gather reliable information and ensure their points are well supported. Research papers include a bibliography, which can be a little tricky for students. Learn how to write a bibliography in multiple styles and find basic examples below.
Plus grab our printable Bibliography Guide for Students with examples from all three major style guides: APA (American Psychological Association), MLA (Modern Language Association), or The Chicago Manual of Style . Just fill out the form on this page to get the free guide.
IMPORTANT: Each style guide has its own very specific rules, and they often conflict with one another. Additionally, each type of reference material has many possible formats, depending on a variety of factors. The overviews shown here are meant to guide students in writing basic bibliographies, but this information is by no means complete. Students should always refer directly to the preferred style guide to ensure they’re using the most up-to-date formats and styles.
When you’re researching a paper, you’ll likely consult a wide variety of sources. You may quote some of these directly in your work, summarize some of the points they make, or simply use them to further the knowledge you need to write your paper. Since these ideas are not your own, it’s vital to give credit to the authors who originally wrote them. This list of sources, organized alphabetically, is called a bibliography.
A bibliography should include all the materials you consulted in your research, even if you don’t quote directly from them in your paper. These resources could include (but aren’t limited to):
These two terms are sometimes used interchangeably, but they actually have different meanings. As noted above, a bibliography includes all the materials you used while researching your paper, whether or not you quote from them or refer to them directly in your writing.
A list of references only includes the materials you cite throughout your work. You might use direct quotes or summarize the information for the reader. Either way, you must ensure you give credit to the original author or document. This section can be titled “List of Works Cited” or simply “References.”
Your teacher may specify whether you should include a bibliography or a reference list. If they don’t, consider choosing a bibliography to show all the works you used in researching your paper. This can help the reader see that your points are well supported and allow them to do further reading on their own if they’re interested.
Citations refer to direct quotations from a text that are woven into your own writing. There are a variety of ways to write citations, including footnotes and endnotes. These are generally shorter than the entries in a reference list or bibliography. Learn more about writing citations here.
Depending on the reference material, bibliography entries include a variety of information intended to help a reader locate the material if they want to refer to it themselves. These entries are listed in alphabetical order and may include: ADVERTISEMENT
These entries don’t generally need to include specific page numbers or locations within the work (except for print magazine or journal articles). That type of information is usually only needed in a footnote or endnote citation.
In most cases, writers use one of three major style guides: APA (American Psychological Association), MLA (Modern Language Association), or The Chicago Manual of Style . There are many others as well, but these three are the most common choices for K–12 students.
Many teachers will state their preference for one style guide over another. If they don’t, you can choose your own preferred style. However, you should also use that guide for your entire paper, following their recommendations for punctuation, grammar, and more. This will ensure you are consistent throughout.
Below, you’ll learn how to write a simple bibliography using each of the three major style guides. We’ve included details for books and e-books, periodicals, and electronic sources like websites and videos. If the reference material type you need to include isn’t shown here, refer directly to the style guide you’re using.
Technically, APA style calls for a list of references instead of a bibliography. If your teacher requires you to use the APA style guide , you can limit your reference list to only items you cite throughout your work.
Here are some general notes on writing an APA reference list:
For books, APA reference list entries use this format (only include the publisher’s website for e-books):
Last Name, First Initial. Middle Initial. (Publication date). Title with only first word capitalized (unless there’s a proper name/noun) . Publisher. Publisher’s website
For journal or magazine articles, use the following format. If you viewed the article online, include the URL at the end of the citation.
Last Name, First Initial. Middle Initial. (Publication date). Title of article. Magazine or Journal Title (Volume number) Issue number, page numbers. URL
Here’s the format for newspapers. For print editions, include the page number/s. For online articles, include the full URL:
Last Name, First Initial. Middle Initial. (Year, Month Date) Title of article. Newspaper title. Page number/s. URL
For articles with a specific author on a website, use this format:
Last Name, First Initial. Middle Initial. (Year, Month Date). Title . Site name. URL
When an online article doesn’t include a specific author or date, list it like this:
Title . (Year, Month Date). Site name. Retrieved Month Date, Year, from URL
When you need to list a YouTube video, use the name of the account that uploaded the video, and format it like this:
Name of Account. (Upload year, month day). Title [Video]. YouTube. URL
For more information on writing APA bibliographies, see the APA Style Guide website.
MLA style calls for a Works Cited section, which includes all materials quoted or referred to in your paper. You may also include a Works Consulted section, including other reference sources you reviewed but didn’t directly cite. Together, these constitute a bibliography. If your teacher requests an MLA Style Guide bibliography, ask if you should include Works Consulted as well as Works Cited.
For both MLA Works Cited and Works Consulted sections, use these general guidelines:
For books, MLA reference list entries use the following format. Add the URL at the end for e-books.
Last Name, First Name Middle Name. Title . Publisher, Date. URL
Here’s the MLA-style format for magazines, journals, and newspapers. For online articles, add the URL at the end of the listing:
For magazines and journals:
Last Name, First Name. “Title: Subtitle.” Name of Journal , volume number, issue number, Date of Publication, First Page Number–Last Page Number.
When citing newspapers, include the page number/s for print editions or the URL for online articles:
Last Name, First Name. “Title of article.” Newspaper title. Page number/s. Year, month day. Page number or URL
Last Name, First Name. Year. “Title.” Month Day, Year published. URL
Website. n.d. “Title.” Accessed Day Month Year. URL.
Here’s how to list YouTube and other online videos:
Creator, if available. “Title of Video.” Website. Uploaded by Username, Day Month Year. URL.
For more information on writing MLA-style bibliographies, see the MLA Style website.
The Chicago Manual of Style (sometimes called “Turabian”) actually has two options for citing reference material: Notes and Bibliography and Author-Date. Regardless of which you use, you’ll need a complete detailed list of reference items at the end of your paper. The examples below demonstrate how to write that list.
Here are some general notes on writing a Chicago -style bibliography:
For books, Chicago -style reference list entries use the following format. (For print books, leave off the information about how the book was accessed.)
Last Name, First Name Middle Name. Title . City of Publication: Publisher, Date. How e-book was accessed.
Here’s the style format for magazines, journals, and newspapers. For online articles, add the URL at the end of the listing.
For journal and magazine articles, use this format:
Last Name, First Name. Year of Publication. “Title: Subtitle.” Name of Journal , Volume Number, issue number, First Page Number–Last Page Number. URL.
When citing newspapers, include the URL for online articles:
Last Name, First Name. Year of Publication. “Title: Subtitle.” Name of Newspaper , Month day, year. URL.
Last Name, First Name Middle Name. “Title.” Site Name . Year, Month Day. URL.
“Title.” Site Name . URL. Accessed Month Day, Year.
Creator or Username. “Title of Video.” Website video, length. Month Day, Year. URL.
For more information on writing Chicago -style bibliographies, see the Chicago Manual of Style website.
Just fill out the form on this page to grab our printable Bibliography Guide for Students with examples from all three major style guides: APA (American Psychological Association), MLA (Modern Language Association), or The Chicago Manual of Style .
Plus, get all the latest teaching tips and ideas when you sign up for our free newsletters , you might also like.
Powered by chegg.
Start a new citation or manage your existing projects.
Scan your paper for plagiarism and grammar errors.
Catch plagiarism and grammar mistakes with our paper checker
Double check for plagiarism mistakes and advanced grammar errors before you turn in your paper.
No matter what citation style you're using (APA, MLA, Chicago, etc.) we'll help you create the right bibliography
Scan your paper the way your teacher would to catch unintentional plagiarism. Then, easily add the right citation
Give your paper an in-depth check. Receive feedback within 24 hours from writing experts on your paper's main idea, structure, conclusion, and more.
Don't give up sweet paper points for small mistakes. Our algorithms flag grammar and writing issues and provide smart suggestions
Mla format guide.
This is the total package when it comes to MLA format. Our easy to read guides come complete with examples and step-by-step instructions to format your full and in-text citations, paper, and works cited in MLA style. There’s even information on annotated bibliographies.
Works Cited | In-Text Citations | Bibliography | Annotated Bibliography | Website | Book | Journal | YouTube | View all MLA Citation Examples
Get the facts on citing and writing in APA format with our comprehensive guides. Formatting instructions, in-text citation and reference examples, and sample papers provide you with the tools you need to style your paper in APA.
Reference Page | In-Text Citations | Annotated Bibliography | Website | Books | Journal | YouTube | View all APA citation Examples
Looking to format your paper in Chicago style and not sure where to start? Our guide provides everything you need! Learn the basics and fundamentals to creating references and footnotes in Chicago format. With numerous examples and visuals, you’ll be citing in Chicago style in no time.
Footnotes | Website | Book | Journal
Learn the requirements to properly reference your paper in Harvard style. The guides we have provide the basics and fundamentals to give credit to the sources used in your work.
In-Text Citations | Books | Article | YouTube | View all Harvard Referencing Examples
Avoid common grammar mistakes and unintentional plagiarism with our essay checker. Receive personalized feedback to help identify citations that may be missing, and help improve your sentence structure, punctuation, and more to turn in an error-free paper.
Grammar Check | Plagiarism Checker | Spell Check
Our blog features current and innovative topics to keep you up to speed on citing and writing. Whether you’re an educator, student, or someone who lives and breathes citations (it’s not as uncommon as you might think!), our blog features new and exciting articles to discover and learn from.
Our Writing Center is jam-packed with tons of exciting resources. Videos, infographics, research guides, and many other citation-related resources are found here. Check it out to find what you need to succeed!
Bibliography.
In addition to the sources cited in the individual text boxes of this writing guide, listed below are books about how to effectively write and organize a college-level research paper or dissertation [which frequently have good advice on writing, regardless of their purpose]. Enter the title of the book in the USC Libraries' search engine to check the availability of these or any other books on college-level writing and research. If the library does not own a particular title, you can request to borrow the book free of charge from the USC Libraries' interlibrary loan department .
Carter, Caron, editor. Successful Dissertations: The Complete Guide for Education, Childhood and Early Childhood Studies Students . New York: Bloomsbury Academic, 2018.
Floyd, Randy G., editor. Publishing in School Psychology and Related Fields: An Insider's Guide . New York: Routledge, Taylor and Francis Group, 2018.
Graff, Gerald and Cathy Birkenstein. "They Say / I Say": The Moves that Matter in Academic Writing . New York: W.W. Norton and Company, 2017.
A publication of the harvard college writing program.
Harvard Guide to Using Sources
Below you’ll find a Bibliography adapted from a research paper written by Aishani Aatresh for her Technology, Environment, and Society course.
Bibliography Barnard, Anne, and Grace Ashford. “Can New York Really Get to 100% Clean Energy by 2040?” , November 29, 2021, sec. New York. . Berman, Bradley. “Fuel Cells at Center Stage.” , November 22, 2013, sec. Automobiles. . Boudette, Neal E. “First Came the Hydrogen Cars. Now, the Refilling Stations.” , May 18, 2017, sec. Automobiles. . Coen, Deborah R. “Big Is a Thing of the Past: Climate Change and Methodology in the History of Ideas.” 77, no. 2 (2016): 305–21. . The White House. “FACT SHEET: President Biden Announces Steps to Drive American Leadership Forward on Clean Cars and Trucks,” August 5, 2021. . Jasanoff, Sheila. “A New Climate for Society.” 27, no. 2–3 (March 2010): 233–53. . Jasanoff, Sheila, and Sang-Hyun Kim. “Containing the Atom: Sociotechnical Imaginaries and Nuclear Power in the United States and South Korea.” 47, no. 2 (2009): 119–46. Motavalli, Jim. “Cheap Natural Gas Prompts Energy Department to Soften Its Line on Fuel Cells.” (blog), May 29, 2012. . Tabuchi, Hiroko. “Toyota Led on Clean Cars. Now Critics Say It Works to Delay Them.” , July 25, 2021, sec. Climate. .
|
Educational resources and simple solutions for your research journey
As an academician, terms such as citations, references and bibliography might be a part of almost every work-related conversation in your daily life. However, many researchers, especially during the early stages of their academic career, may find it hard to differentiate between citations, references and bibliography in research papers and often find it confusing to implement their usage. If you are amongst them, this article will provide you with some respite. Let us start by first understanding the individual terms better.
Citation in research papers: A citation appears in the main text of the paper. It is a way of giving credit to the information that you have specifically mentioned in your research paper by leading the reader to the original source of information. You will need to use citation in research papers whenever you are using information to elaborate a particular concept in the paper, either in the introduction or discussion sections or as a way to support your research findings in the results section.
Reference in research papers: A reference is a detailed description of the source of information that you want to give credit to via a citation. The references in research papers are usually in the form of a list at the end of the paper. The essential difference between citations and references is that citations lead a reader to the source of information, while references provide the reader with detailed information regarding that particular source.
Bibliography in research papers:
A bibliography in research paper is a list of sources that appears at the end of a research paper or an article, and contains information that may or may not be directly mentioned in the research paper. The difference between reference and bibliography in research is that an individual source in the list of references can be linked to an in-text citation, while an individual source in the bibliography may not necessarily be linked to an in-text citation.
It’s understandable how these terms may often be used interchangeably as they are serve the same purpose – namely to give intellectual and creative credit to an original idea that is elaborated in depth in a research paper. One of the easiest ways to understand when to use an in-text citation in research papers, is to check whether the information is an ongoing work of research or if it has been proven to be a ‘fact’ through reproducibility. If the information is a proven fact, you need not specifically add the original source to the list of references but can instead choose to mention it in your bibliography. For instance, if you use a statement such as “The effects of global warming and climate changes on the deterioration of environment have been described in depth”, you need not use an in-text citation, but can choose to mention key sources in the bibliography section. An example of a citation in a research paper would be if you intend to elaborate on the impact of climate change in a particular population and/or a specific geographical location. In this case, you will need to add an in-text citation and mention the correct source in the list of references.
Citations | References | Bibliography | |
Purpose | To lead a reader toward a source of information included in the text | To elaborate on of a particular source of information cited in the research paper | To provide a list of all relevant sources of information on the research topic
|
Placement | In the main text | At the end of the text; necessarily linked to an in-text citation | At the end of the text; not necessarily linked to an in-text citation
|
Information | Minimal; denoting only the essential components of the source, such as numbering, names of the first and last authors, etc.
| Descriptive; gives complete details about a particular source that can be used to find and read the original paper if needed | Descriptive; gives all the information regarding a particular source for those who want to refer to it |
Now that you have understood the basic similarities and differences in these terms, you should also know that every journal follows a particular style and format for these elements. So when working out how to write citations and add references in research papers, be mindful of using the preferred style of your target journal before you submit your research document.
R Discovery is a literature search and research reading platform that accelerates your research discovery journey by keeping you updated on the latest, most relevant scholarly content. With 250M+ research articles sourced from trusted aggregators like CrossRef, Unpaywall, PubMed, PubMed Central, Open Alex and top publishing houses like Springer Nature, JAMA, IOP, Taylor & Francis, NEJM, BMJ, Karger, SAGE, Emerald Publishing and more, R Discovery puts a world of research at your fingertips.
Try R Discovery Prime FREE for 1 week or upgrade at just US$72 a year to access premium features that let you listen to research on the go, read in your language, collaborate with peers, auto sync with reference managers, and much more. Choose a simpler, smarter way to find and read research – Download the app and start your free 7-day trial today !
Purdue Online Writing Lab Purdue OWL® College of Liberal Arts
This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.
Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.
Below you will find sample annotations from annotated bibliographies, each with a different research project. Remember that the annotations you include in your own bibliography should reflect your research project and/or the guidelines of your assignment.
As mentioned elsewhere in this resource, depending on the purpose of your bibliography, some annotations may summarize, some may assess or evaluate a source, and some may reflect on the source’s possible uses for the project at hand. Some annotations may address all three of these steps. Consider the purpose of your annotated bibliography and/or your instructor’s directions when deciding how much information to include in your annotations.
Please keep in mind that all your text, including the write-up beneath the citation, must be indented so that the author's last name is the only text that is flush left.
Lamott, Anne. Bird by Bird: Some Instructions on Writing and Life . Anchor Books, 1995.
Lamott's book offers honest advice on the nature of a writing life, complete with its insecurities and failures. Taking a humorous approach to the realities of being a writer, the chapters in Lamott's book are wry and anecdotal and offer advice on everything from plot development to jealousy, from perfectionism to struggling with one's own internal critic.
In the process, Lamott includes writing exercises designed to be both productive and fun. Lamott offers sane advice for those struggling with the anxieties of writing, but her main project seems to be offering the reader a reality check regarding writing, publishing, and struggling with one's own imperfect humanity in the process. Rather than a practical handbook to producing and/or publishing, this text is indispensable because of its honest perspective, its down-to-earth humor, and its encouraging approach.
Chapters in this text could easily be included in the curriculum for a writing class. Several of the chapters in Part 1 address the writing process and would serve to generate discussion on students' own drafting and revising processes. Some of the writing exercises would also be appropriate for generating classroom writing exercises. Students should find Lamott's style both engaging and enjoyable.
In the sample annotation above, the writer includes three paragraphs: a summary, an evaluation of the text, and a reflection on its applicability to his/her own research, respectively.
For information on formatting MLA citations, see our MLA 9th Edition (2021) Formatting and Style Guide .
Ehrenreich, B. (2001). Nickel and dimed: On (not) getting by in America . Henry Holt and Company.
In this book of nonfiction based on the journalist's experiential research, Ehrenreich attempts to ascertain whether it is currently possible for an individual to live on a minimum-wage in America. Taking jobs as a waitress, a maid in a cleaning service, and a Walmart sales employee, the author summarizes and reflects on her work, her relationships with fellow workers, and her financial struggles in each situation.
An experienced journalist, Ehrenreich is aware of the limitations of her experiment and the ethical implications of her experiential research tactics and reflects on these issues in the text. The author is forthcoming about her methods and supplements her experiences with scholarly research on her places of employment, the economy, and the rising cost of living in America. Ehrenreich’s project is timely, descriptive, and well-researched.
The annotation above both summarizes and assesses the book in the citation. The first paragraph provides a brief summary of the author's project in the book, covering the main points of the work. The second paragraph points out the project’s strengths and evaluates its methods and presentation. This particular annotation does not reflect on the source’s potential importance or usefulness for this person’s own research.
For information on formatting APA citations, see our APA Formatting and Style Guide .
Davidson, Hilda Ellis. Roles of the Northern Goddess . London: Routledge, 1998.
Davidson's book provides a thorough examination of the major roles filled by the numerous pagan goddesses of Northern Europe in everyday life, including their roles in hunting, agriculture, domestic arts like weaving, the household, and death. The author discusses relevant archaeological evidence, patterns of symbol and ritual, and previous research. The book includes a number of black and white photographs of relevant artifacts.
This annotation includes only one paragraph, a summary of the book. It provides a concise description of the project and the book's project and its major features.
For information on formatting Chicago Style citations, see our Chicago Manual of Style resources.
Peer Reviewed
Article metrics.
CrossRef Citations
Altmetric Score
PDF Downloads
Academic journals, archives, and repositories are seeing an increasing number of questionable research papers clearly produced using generative AI. They are often created with widely available, general-purpose AI applications, most likely ChatGPT, and mimic scientific writing. Google Scholar easily locates and lists these questionable papers alongside reputable, quality-controlled research. Our analysis of a selection of questionable GPT-fabricated scientific papers found in Google Scholar shows that many are about applied, often controversial topics susceptible to disinformation: the environment, health, and computing. The resulting enhanced potential for malicious manipulation of society’s evidence base, particularly in politically divisive domains, is a growing concern.
Swedish School of Library and Information Science, University of Borås, Sweden
Department of Arts and Cultural Sciences, Lund University, Sweden
Division of Environmental Communication, Swedish University of Agricultural Sciences, Sweden
The use of ChatGPT to generate text for academic papers has raised concerns about research integrity. Discussion of this phenomenon is ongoing in editorials, commentaries, opinion pieces, and on social media (Bom, 2023; Stokel-Walker, 2024; Thorp, 2023). There are now several lists of papers suspected of GPT misuse, and new papers are constantly being added. 1 See for example Academ-AI, https://www.academ-ai.info/ , and Retraction Watch, https://retractionwatch.com/papers-and-peer-reviews-with-evidence-of-chatgpt-writing/ . While many legitimate uses of GPT for research and academic writing exist (Huang & Tan, 2023; Kitamura, 2023; Lund et al., 2023), its undeclared use—beyond proofreading—has potentially far-reaching implications for both science and society, but especially for their relationship. It, therefore, seems important to extend the discussion to one of the most accessible and well-known intermediaries between science, but also certain types of misinformation, and the public, namely Google Scholar, also in response to the legitimate concerns that the discussion of generative AI and misinformation needs to be more nuanced and empirically substantiated (Simon et al., 2023).
Google Scholar, https://scholar.google.com , is an easy-to-use academic search engine. It is available for free, and its index is extensive (Gusenbauer & Haddaway, 2020). It is also often touted as a credible source for academic literature and even recommended in library guides, by media and information literacy initiatives, and fact checkers (Tripodi et al., 2023). However, Google Scholar lacks the transparency and adherence to standards that usually characterize citation databases. Instead, Google Scholar uses automated crawlers, like Google’s web search engine (Martín-Martín et al., 2021), and the inclusion criteria are based on primarily technical standards, allowing any individual author—with or without scientific affiliation—to upload papers to be indexed (Google Scholar Help, n.d.). It has been shown that Google Scholar is susceptible to manipulation through citation exploits (Antkare, 2020) and by providing access to fake scientific papers (Dadkhah et al., 2017). A large part of Google Scholar’s index consists of publications from established scientific journals or other forms of quality-controlled, scholarly literature. However, the index also contains a large amount of gray literature, including student papers, working papers, reports, preprint servers, and academic networking sites, as well as material from so-called “questionable” academic journals, including paper mills. The search interface does not offer the possibility to filter the results meaningfully by material type, publication status, or form of quality control, such as limiting the search to peer-reviewed material.
To understand the occurrence of ChatGPT (co-)authored work in Google Scholar’s index, we scraped it for publications, including one of two common ChatGPT responses (see Appendix A) that we encountered on social media and in media reports (DeGeurin, 2024). The results of our descriptive statistical analyses showed that around 62% did not declare the use of GPTs. Most of these GPT-fabricated papers were found in non-indexed journals and working papers, but some cases included research published in mainstream scientific journals and conference proceedings. 2 Indexed journals mean scholarly journals indexed by abstract and citation databases such as Scopus and Web of Science, where the indexation implies journals with high scientific quality. Non-indexed journals are journals that fall outside of this indexation. More than half (57%) of these GPT-fabricated papers concerned policy-relevant subject areas susceptible to influence operations. To avoid increasing the visibility of these publications, we abstained from referencing them in this research note. However, we have made the data available in the Harvard Dataverse repository.
The publications were related to three issue areas—health (14.5%), environment (19.5%) and computing (23%)—with key terms such “healthcare,” “COVID-19,” or “infection”for health-related papers, and “analysis,” “sustainable,” and “global” for environment-related papers. In several cases, the papers had titles that strung together general keywords and buzzwords, thus alluding to very broad and current research. These terms included “biology,” “telehealth,” “climate policy,” “diversity,” and “disrupting,” to name just a few. While the study’s scope and design did not include a detailed analysis of which parts of the articles included fabricated text, our dataset did contain the surrounding sentences for each occurrence of the suspicious phrases that formed the basis for our search and subsequent selection. Based on that, we can say that the phrases occurred in most sections typically found in scientific publications, including the literature review, methods, conceptual and theoretical frameworks, background, motivation or societal relevance, and even discussion. This was confirmed during the joint coding, where we read and discussed all articles. It became clear that not just the text related to the telltale phrases was created by GPT, but that almost all articles in our sample of questionable articles likely contained traces of GPT-fabricated text everywhere.
Evidence hacking and backfiring effects
Generative pre-trained transformers (GPTs) can be used to produce texts that mimic scientific writing. These texts, when made available online—as we demonstrate—leak into the databases of academic search engines and other parts of the research infrastructure for scholarly communication. This development exacerbates problems that were already present with less sophisticated text generators (Antkare, 2020; Cabanac & Labbé, 2021). Yet, the public release of ChatGPT in 2022, together with the way Google Scholar works, has increased the likelihood of lay people (e.g., media, politicians, patients, students) coming across questionable (or even entirely GPT-fabricated) papers and other problematic research findings. Previous research has emphasized that the ability to determine the value and status of scientific publications for lay people is at stake when misleading articles are passed off as reputable (Haider & Åström, 2017) and that systematic literature reviews risk being compromised (Dadkhah et al., 2017). It has also been highlighted that Google Scholar, in particular, can be and has been exploited for manipulating the evidence base for politically charged issues and to fuel conspiracy narratives (Tripodi et al., 2023). Both concerns are likely to be magnified in the future, increasing the risk of what we suggest calling evidence hacking —the strategic and coordinated malicious manipulation of society’s evidence base.
The authority of quality-controlled research as evidence to support legislation, policy, politics, and other forms of decision-making is undermined by the presence of undeclared GPT-fabricated content in publications professing to be scientific. Due to the large number of archives, repositories, mirror sites, and shadow libraries to which they spread, there is a clear risk that GPT-fabricated, questionable papers will reach audiences even after a possible retraction. There are considerable technical difficulties involved in identifying and tracing computer-fabricated papers (Cabanac & Labbé, 2021; Dadkhah et al., 2023; Jones, 2024), not to mention preventing and curbing their spread and uptake.
However, as the rise of the so-called anti-vaxx movement during the COVID-19 pandemic and the ongoing obstruction and denial of climate change show, retracting erroneous publications often fuels conspiracies and increases the following of these movements rather than stopping them. To illustrate this mechanism, climate deniers frequently question established scientific consensus by pointing to other, supposedly scientific, studies that support their claims. Usually, these are poorly executed, not peer-reviewed, based on obsolete data, or even fraudulent (Dunlap & Brulle, 2020). A similar strategy is successful in the alternative epistemic world of the global anti-vaccination movement (Carrion, 2018) and the persistence of flawed and questionable publications in the scientific record already poses significant problems for health research, policy, and lawmakers, and thus for society as a whole (Littell et al., 2024). Considering that a person’s support for “doing your own research” is associated with increased mistrust in scientific institutions (Chinn & Hasell, 2023), it will be of utmost importance to anticipate and consider such backfiring effects already when designing a technical solution, when suggesting industry or legal regulation, and in the planning of educational measures.
Recommendations
Solutions should be based on simultaneous considerations of technical, educational, and regulatory approaches, as well as incentives, including social ones, across the entire research infrastructure. Paying attention to how these approaches and incentives relate to each other can help identify points and mechanisms for disruption. Recognizing fraudulent academic papers must happen alongside understanding how they reach their audiences and what reasons there might be for some of these papers successfully “sticking around.” A possible way to mitigate some of the risks associated with GPT-fabricated scholarly texts finding their way into academic search engine results would be to provide filtering options for facets such as indexed journals, gray literature, peer-review, and similar on the interface of publicly available academic search engines. Furthermore, evaluation tools for indexed journals 3 Such as LiU Journal CheckUp, https://ep.liu.se/JournalCheckup/default.aspx?lang=eng . could be integrated into the graphical user interfaces and the crawlers of these academic search engines. To enable accountability, it is important that the index (database) of such a search engine is populated according to criteria that are transparent, open to scrutiny, and appropriate to the workings of science and other forms of academic research. Moreover, considering that Google Scholar has no real competitor, there is a strong case for establishing a freely accessible, non-specialized academic search engine that is not run for commercial reasons but for reasons of public interest. Such measures, together with educational initiatives aimed particularly at policymakers, science communicators, journalists, and other media workers, will be crucial to reducing the possibilities for and effects of malicious manipulation or evidence hacking. It is important not to present this as a technical problem that exists only because of AI text generators but to relate it to the wider concerns in which it is embedded. These range from a largely dysfunctional scholarly publishing system (Haider & Åström, 2017) and academia’s “publish or perish” paradigm to Google’s near-monopoly and ideological battles over the control of information and ultimately knowledge. Any intervention is likely to have systemic effects; these effects need to be considered and assessed in advance and, ideally, followed up on.
Our study focused on a selection of papers that were easily recognizable as fraudulent. We used this relatively small sample as a magnifying glass to examine, delineate, and understand a problem that goes beyond the scope of the sample itself, which however points towards larger concerns that require further investigation. The work of ongoing whistleblowing initiatives 4 Such as Academ-AI, https://www.academ-ai.info/ , and Retraction Watch, https://retractionwatch.com/papers-and-peer-reviews-with-evidence-of-chatgpt-writing/ . , recent media reports of journal closures (Subbaraman, 2024), or GPT-related changes in word use and writing style (Cabanac et al., 2021; Stokel-Walker, 2024) suggest that we only see the tip of the iceberg. There are already more sophisticated cases (Dadkhah et al., 2023) as well as cases involving fabricated images (Gu et al., 2022). Our analysis shows that questionable and potentially manipulative GPT-fabricated papers permeate the research infrastructure and are likely to become a widespread phenomenon. Our findings underline that the risk of fake scientific papers being used to maliciously manipulate evidence (see Dadkhah et al., 2017) must be taken seriously. Manipulation may involve undeclared automatic summaries of texts, inclusion in literature reviews, explicit scientific claims, or the concealment of errors in studies so that they are difficult to detect in peer review. However, the mere possibility of these things happening is a significant risk in its own right that can be strategically exploited and will have ramifications for trust in and perception of science. Society’s methods of evaluating sources and the foundations of media and information literacy are under threat and public trust in science is at risk of further erosion, with far-reaching consequences for society in dealing with information disorders. To address this multifaceted problem, we first need to understand why it exists and proliferates.
Finding 1: 139 GPT-fabricated, questionable papers were found and listed as regular results on the Google Scholar results page. Non-indexed journals dominate.
Most questionable papers we found were in non-indexed journals or were working papers, but we did also find some in established journals, publications, conferences, and repositories. We found a total of 139 papers with a suspected deceptive use of ChatGPT or similar LLM applications (see Table 1). Out of these, 19 were in indexed journals, 89 were in non-indexed journals, 19 were student papers found in university databases, and 12 were working papers (mostly in preprint databases). Table 1 divides these papers into categories. Health and environment papers made up around 34% (47) of the sample. Of these, 66% were present in non-indexed journals.
Indexed journals* | 5 | 3 | 4 | 7 | 19 |
Non-indexed journals | 18 | 18 | 13 | 40 | 89 |
Student papers | 4 | 3 | 1 | 11 | 19 |
Working papers | 5 | 3 | 2 | 2 | 12 |
Total | 32 | 27 | 20 | 60 | 139 |
Finding 2: GPT-fabricated, questionable papers are disseminated online, permeating the research infrastructure for scholarly communication, often in multiple copies. Applied topics with practical implications dominate.
The 20 papers concerning health-related issues are distributed across 20 unique domains, accounting for 46 URLs. The 27 papers dealing with environmental issues can be found across 26 unique domains, accounting for 56 URLs. Most of the identified papers exist in multiple copies and have already spread to several archives, repositories, and social media. It would be difficult, or impossible, to remove them from the scientific record.
As apparent from Table 2, GPT-fabricated, questionable papers are seeping into most parts of the online research infrastructure for scholarly communication. Platforms on which identified papers have appeared include ResearchGate, ORCiD, Journal of Population Therapeutics and Clinical Pharmacology (JPTCP), Easychair, Frontiers, the Institute of Electrical and Electronics Engineer (IEEE), and X/Twitter. Thus, even if they are retracted from their original source, it will prove very difficult to track, remove, or even just mark them up on other platforms. Moreover, unless regulated, Google Scholar will enable their continued and most likely unlabeled discoverability.
Environment | researchgate.net (13) | orcid.org (4) | easychair.org (3) | ijope.com* (3) | publikasiindonesia.id (3) |
Health | researchgate.net (15) | ieee.org (4) | twitter.com (3) | jptcp.com** (2) | frontiersin.org (2) |
A word rain visualization (Centre for Digital Humanities Uppsala, 2023), which combines word prominences through TF-IDF 5 Term frequency–inverse document frequency , a method for measuring the significance of a word in a document compared to its frequency across all documents in a collection. scores with semantic similarity of the full texts of our sample of GPT-generated articles that fall into the “Environment” and “Health” categories, reflects the two categories in question. However, as can be seen in Figure 1, it also reveals overlap and sub-areas. The y-axis shows word prominences through word positions and font sizes, while the x-axis indicates semantic similarity. In addition to a certain amount of overlap, this reveals sub-areas, which are best described as two distinct events within the word rain. The event on the left bundles terms related to the development and management of health and healthcare with “challenges,” “impact,” and “potential of artificial intelligence”emerging as semantically related terms. Terms related to research infrastructures, environmental, epistemic, and technological concepts are arranged further down in the same event (e.g., “system,” “climate,” “understanding,” “knowledge,” “learning,” “education,” “sustainable”). A second distinct event further to the right bundles terms associated with fish farming and aquatic medicinal plants, highlighting the presence of an aquaculture cluster. Here, the prominence of groups of terms such as “used,” “model,” “-based,” and “traditional” suggests the presence of applied research on these topics. The two events making up the word rain visualization, are linked by a less dominant but overlapping cluster of terms related to “energy” and “water.”
The bar chart of the terms in the paper subset (see Figure 2) complements the word rain visualization by depicting the most prominent terms in the full texts along the y-axis. Here, word prominences across health and environment papers are arranged descendingly, where values outside parentheses are TF-IDF values (relative frequencies) and values inside parentheses are raw term frequencies (absolute frequencies).
Finding 3: Google Scholar presents results from quality-controlled and non-controlled citation databases on the same interface, providing unfiltered access to GPT-fabricated questionable papers.
Google Scholar’s central position in the publicly accessible scholarly communication infrastructure, as well as its lack of standards, transparency, and accountability in terms of inclusion criteria, has potentially serious implications for public trust in science. This is likely to exacerbate the already-known potential to exploit Google Scholar for evidence hacking (Tripodi et al., 2023) and will have implications for any attempts to retract or remove fraudulent papers from their original publication venues. Any solution must consider the entirety of the research infrastructure for scholarly communication and the interplay of different actors, interests, and incentives.
We searched and scraped Google Scholar using the Python library Scholarly (Cholewiak et al., 2023) for papers that included specific phrases known to be common responses from ChatGPT and similar applications with the same underlying model (GPT3.5 or GPT4): “as of my last knowledge update” and/or “I don’t have access to real-time data” (see Appendix A). This facilitated the identification of papers that likely used generative AI to produce text, resulting in 227 retrieved papers. The papers’ bibliographic information was automatically added to a spreadsheet and downloaded into Zotero. 6 An open-source reference manager, https://zotero.org .
We employed multiple coding (Barbour, 2001) to classify the papers based on their content. First, we jointly assessed whether the paper was suspected of fraudulent use of ChatGPT (or similar) based on how the text was integrated into the papers and whether the paper was presented as original research output or the AI tool’s role was acknowledged. Second, in analyzing the content of the papers, we continued the multiple coding by classifying the fraudulent papers into four categories identified during an initial round of analysis—health, environment, computing, and others—and then determining which subjects were most affected by this issue (see Table 1). Out of the 227 retrieved papers, 88 papers were written with legitimate and/or declared use of GPTs (i.e., false positives, which were excluded from further analysis), and 139 papers were written with undeclared and/or fraudulent use (i.e., true positives, which were included in further analysis). The multiple coding was conducted jointly by all authors of the present article, who collaboratively coded and cross-checked each other’s interpretation of the data simultaneously in a shared spreadsheet file. This was done to single out coding discrepancies and settle coding disagreements, which in turn ensured methodological thoroughness and analytical consensus (see Barbour, 2001). Redoing the category coding later based on our established coding schedule, we achieved an intercoder reliability (Cohen’s kappa) of 0.806 after eradicating obvious differences.
The ranking algorithm of Google Scholar prioritizes highly cited and older publications (Martín-Martín et al., 2016). Therefore, the position of the articles on the search engine results pages was not particularly informative, considering the relatively small number of results in combination with the recency of the publications. Only the query “as of my last knowledge update” had more than two search engine result pages. On those, questionable articles with undeclared use of GPTs were evenly distributed across all result pages (min: 4, max: 9, mode: 8), with the proportion of undeclared use being slightly higher on average on later search result pages.
To understand how the papers making fraudulent use of generative AI were disseminated online, we programmatically searched for the paper titles (with exact string matching) in Google Search from our local IP address (see Appendix B) using the googlesearch – python library(Vikramaditya, 2020). We manually verified each search result to filter out false positives—results that were not related to the paper—and then compiled the most prominent URLs by field. This enabled the identification of other platforms through which the papers had been spread. We did not, however, investigate whether copies had spread into SciHub or other shadow libraries, or if they were referenced in Wikipedia.
We used descriptive statistics to count the prevalence of the number of GPT-fabricated papers across topics and venues and top domains by subject. The pandas software library for the Python programming language (The pandas development team, 2024) was used for this part of the analysis. Based on the multiple coding, paper occurrences were counted in relation to their categories, divided into indexed journals, non-indexed journals, student papers, and working papers. The schemes, subdomains, and subdirectories of the URL strings were filtered out while top-level domains and second-level domains were kept, which led to normalizing domain names. This, in turn, allowed the counting of domain frequencies in the environment and health categories. To distinguish word prominences and meanings in the environment and health-related GPT-fabricated questionable papers, a semantically-aware word cloud visualization was produced through the use of a word rain (Centre for Digital Humanities Uppsala, 2023) for full-text versions of the papers. Font size and y-axis positions indicate word prominences through TF-IDF scores for the environment and health papers (also visualized in a separate bar chart with raw term frequencies in parentheses), and words are positioned along the x-axis to reflect semantic similarity (Skeppstedt et al., 2024), with an English Word2vec skip gram model space (Fares et al., 2017). An English stop word list was used, along with a manually produced list including terms such as “https,” “volume,” or “years.”
Haider, J., Söderström, K. R., Ekström, B., & Rödl, M. (2024). GPT-fabricated scientific papers on Google Scholar: Key features, spread, and implications for preempting evidence manipulation. Harvard Kennedy School (HKS) Misinformation Review . https://doi.org/10.37016/mr-2020-156
Antkare, I. (2020). Ike Antkare, his publications, and those of his disciples. In M. Biagioli & A. Lippman (Eds.), Gaming the metrics (pp. 177–200). The MIT Press. https://doi.org/10.7551/mitpress/11087.003.0018
Barbour, R. S. (2001). Checklists for improving rigour in qualitative research: A case of the tail wagging the dog? BMJ , 322 (7294), 1115–1117. https://doi.org/10.1136/bmj.322.7294.1115
Bom, H.-S. H. (2023). Exploring the opportunities and challenges of ChatGPT in academic writing: A roundtable discussion. Nuclear Medicine and Molecular Imaging , 57 (4), 165–167. https://doi.org/10.1007/s13139-023-00809-2
Cabanac, G., & Labbé, C. (2021). Prevalence of nonsensical algorithmically generated papers in the scientific literature. Journal of the Association for Information Science and Technology , 72 (12), 1461–1476. https://doi.org/10.1002/asi.24495
Cabanac, G., Labbé, C., & Magazinov, A. (2021). Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals . arXiv. https://doi.org/10.48550/arXiv.2107.06751
Carrion, M. L. (2018). “You need to do your research”: Vaccines, contestable science, and maternal epistemology. Public Understanding of Science , 27 (3), 310–324. https://doi.org/10.1177/0963662517728024
Centre for Digital Humanities Uppsala (2023). CDHUppsala/word-rain [Computer software]. https://github.com/CDHUppsala/word-rain
Chinn, S., & Hasell, A. (2023). Support for “doing your own research” is associated with COVID-19 misperceptions and scientific mistrust. Harvard Kennedy School (HSK) Misinformation Review, 4 (3). https://doi.org/10.37016/mr-2020-117
Cholewiak, S. A., Ipeirotis, P., Silva, V., & Kannawadi, A. (2023). SCHOLARLY: Simple access to Google Scholar authors and citation using Python (1.5.0) [Computer software]. https://doi.org/10.5281/zenodo.5764801
Dadkhah, M., Lagzian, M., & Borchardt, G. (2017). Questionable papers in citation databases as an issue for literature review. Journal of Cell Communication and Signaling , 11 (2), 181–185. https://doi.org/10.1007/s12079-016-0370-6
Dadkhah, M., Oermann, M. H., Hegedüs, M., Raman, R., & Dávid, L. D. (2023). Detection of fake papers in the era of artificial intelligence. Diagnosis , 10 (4), 390–397. https://doi.org/10.1515/dx-2023-0090
DeGeurin, M. (2024, March 19). AI-generated nonsense is leaking into scientific journals. Popular Science. https://www.popsci.com/technology/ai-generated-text-scientific-journals/
Dunlap, R. E., & Brulle, R. J. (2020). Sources and amplifiers of climate change denial. In D.C. Holmes & L. M. Richardson (Eds.), Research handbook on communicating climate change (pp. 49–61). Edward Elgar Publishing. https://doi.org/10.4337/9781789900408.00013
Fares, M., Kutuzov, A., Oepen, S., & Velldal, E. (2017). Word vectors, reuse, and replicability: Towards a community repository of large-text resources. In J. Tiedemann & N. Tahmasebi (Eds.), Proceedings of the 21st Nordic Conference on Computational Linguistics (pp. 271–276). Association for Computational Linguistics. https://aclanthology.org/W17-0237
Google Scholar Help. (n.d.). Inclusion guidelines for webmasters . https://scholar.google.com/intl/en/scholar/inclusion.html
Gu, J., Wang, X., Li, C., Zhao, J., Fu, W., Liang, G., & Qiu, J. (2022). AI-enabled image fraud in scientific publications. Patterns , 3 (7), 100511. https://doi.org/10.1016/j.patter.2022.100511
Gusenbauer, M., & Haddaway, N. R. (2020). Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources. Research Synthesis Methods , 11 (2), 181–217. https://doi.org/10.1002/jrsm.1378
Haider, J., & Åström, F. (2017). Dimensions of trust in scholarly communication: Problematizing peer review in the aftermath of John Bohannon’s “Sting” in science. Journal of the Association for Information Science and Technology , 68 (2), 450–467. https://doi.org/10.1002/asi.23669
Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: Writing better scientific review articles. American Journal of Cancer Research , 13 (4), 1148–1154. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
Jones, N. (2024). How journals are fighting back against a wave of questionable images. Nature , 626 (8000), 697–698. https://doi.org/10.1038/d41586-024-00372-6
Kitamura, F. C. (2023). ChatGPT is shaping the future of medical writing but still requires human judgment. Radiology , 307 (2), e230171. https://doi.org/10.1148/radiol.230171
Littell, J. H., Abel, K. M., Biggs, M. A., Blum, R. W., Foster, D. G., Haddad, L. B., Major, B., Munk-Olsen, T., Polis, C. B., Robinson, G. E., Rocca, C. H., Russo, N. F., Steinberg, J. R., Stewart, D. E., Stotland, N. L., Upadhyay, U. D., & Ditzhuijzen, J. van. (2024). Correcting the scientific record on abortion and mental health outcomes. BMJ , 384 , e076518. https://doi.org/10.1136/bmj-2023-076518
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology, 74 (5), 570–581. https://doi.org/10.1002/asi.24750
Martín-Martín, A., Orduna-Malea, E., Ayllón, J. M., & Delgado López-Cózar, E. (2016). Back to the past: On the shoulders of an academic search engine giant. Scientometrics , 107 , 1477–1487. https://doi.org/10.1007/s11192-016-1917-2
Martín-Martín, A., Thelwall, M., Orduna-Malea, E., & Delgado López-Cózar, E. (2021). Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: A multidisciplinary comparison of coverage via citations. Scientometrics , 126 (1), 871–906. https://doi.org/10.1007/s11192-020-03690-4
Simon, F. M., Altay, S., & Mercier, H. (2023). Misinformation reloaded? Fears about the impact of generative AI on misinformation are overblown. Harvard Kennedy School (HKS) Misinformation Review, 4 (5). https://doi.org/10.37016/mr-2020-127
Skeppstedt, M., Ahltorp, M., Kucher, K., & Lindström, M. (2024). From word clouds to Word Rain: Revisiting the classic word cloud to visualize climate change texts. Information Visualization , 23 (3), 217–238. https://doi.org/10.1177/14738716241236188
Swedish Research Council. (2017). Good research practice. Vetenskapsrådet.
Stokel-Walker, C. (2024, May 1.). AI Chatbots Have Thoroughly Infiltrated Scientific Publishing . Scientific American. https://www.scientificamerican.com/article/chatbots-have-thoroughly-infiltrated-scientific-publishing/
Subbaraman, N. (2024, May 14). Flood of fake science forces multiple journal closures: Wiley to shutter 19 more journals, some tainted by fraud. The Wall Street Journal . https://www.wsj.com/science/academic-studies-research-paper-mills-journals-publishing-f5a3d4bc
The pandas development team. (2024). pandas-dev/pandas: Pandas (v2.2.2) [Computer software]. Zenodo. https://doi.org/10.5281/zenodo.10957263
Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science , 379 (6630), 313–313. https://doi.org/10.1126/science.adg7879
Tripodi, F. B., Garcia, L. C., & Marwick, A. E. (2023). ‘Do your own research’: Affordance activation and disinformation spread. Information, Communication & Society , 27 (6), 1212–1228. https://doi.org/10.1080/1369118X.2023.2245869
Vikramaditya, N. (2020). Nv7-GitHub/googlesearch [Computer software]. https://github.com/Nv7-GitHub/googlesearch
This research has been supported by Mistra, the Swedish Foundation for Strategic Environmental Research, through the research program Mistra Environmental Communication (Haider, Ekström, Rödl) and the Marcus and Amalia Wallenberg Foundation [2020.0004] (Söderström).
The authors declare no competing interests.
The research described in this article was carried out under Swedish legislation. According to the relevant EU and Swedish legislation (2003:460) on the ethical review of research involving humans (“Ethical Review Act”), the research reported on here is not subject to authorization by the Swedish Ethical Review Authority (“etikprövningsmyndigheten”) (SRC, 2017).
This is an open access article distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided that the original author and source are properly credited.
All data needed to replicate this study are available at the Harvard Dataverse: https://doi.org/10.7910/DVN/WUVD8X
The authors wish to thank two anonymous reviewers for their valuable comments on the article manuscript as well as the editorial group of Harvard Kennedy School (HKS) Misinformation Review for their thoughtful feedback and input.
COMMENTS
Bibliography Entry for a Book. A bibliography entry for a book begins with the author's name, which is written in this order: last name, comma, first name, period. After the author's name comes the title of the book. If you are handwriting your bibliography, underline each title. If you are working on a computer, put the book title in ...
What is the purpose of a bibliography? A bibliography is the list of sources a work's author used to create the work. It accompanies just about every type of academic writing, like essays, research papers, and reports.You might also find a brief, less formal bibliography at the end of a journalistic piece, presentation, or video when the author feels it's necessary to cite their sources.
APA lists only the sources cited within the body of the research paper. The citation page is labeled "References." APA will be used for research papers that cover social sciences or technical subjects. APA makes citing sources like journals, manuals, and other technical sources easier and uses an author-date in-text citation method.
Formatting a Harvard style bibliography. Sources are alphabetised by author last name. The heading 'Reference list' or 'Bibliography' appears at the top. Each new source appears on a new line, and when an entry for a single source extends onto a second line, a hanging indent is used: Harvard bibliography example.
An APA format bibliography is an alphabetical listing of all sources that might be used to write an academic paper, essay, article, or research paper—particularly work that is covering psychology or psychology-related topics. APA format is the official style of the American Psychological Association (APA). This format is used by many ...
APA 7 style guidelines require a reference list of all the sources you included in your research paper. APA references follow the author-date style of citation. You may be asked to create an annotated APA bibliography, however. This could be a separate assignment or part of the larger research project.
A Chicago style bibliography lists the sources cited in your text. Each bibliography entry begins with the author's name and the title of the source, followed by relevant publication details. The bibliography is alphabetized by authors' last names. A bibliography is not mandatory, but is strongly recommended for all but very short papers.
An annotated bibliography should include a reference list of any sources you use in writing a research paper. Any printed sources from which you use a text citation, including books, websites, newspaper articles, journal articles, academic writing, online sources (such as PDFs), and magazines should be included in a reference list.
Bibliography. If you are using Chicago style footnotes or endnotes, you should include a bibliography at the end of your paper that provides complete citation information for all of the sources you cite in your paper. Bibliography entries are formatted differently from notes. For bibliography entries, you list the sources alphabetically by last ...
Writing a research paper involves a lot of work. Students need to consult a variety of sources to gather reliable information and ensure their points are well supported. Research papers include a bibliography, which can be a little tricky for students. Learn how to write a bibliography in multiple styles and find basic examples below.
At college level, you must properly cite your sources in all essays, research papers, and other academic texts (except exams and in-class exercises). Add a citation whenever you quote, paraphrase, or summarize information or ideas from a source. You should also give full source details in a bibliography or reference list at the end of your text.
The list is known as a bibliography and is placed at the end of a research paper or writing project. This article features a comprehensive guide to writing a bibliography, complete with all the information one must include in it as well as formats and examples based on the style guide being followed. Information Included in a Bibliography
Throughout your paper, you need to apply the following APA format guidelines: Set page margins to 1 inch on all sides. Double-space all text, including headings. Indent the first line of every paragraph 0.5 inches. Use an accessible font (e.g., Times New Roman 12pt., Arial 11pt., or Georgia 11pt.). Include a page number on every page.
However, a bibliography refers to all works that you have consulted in your research, even if you did not use their information directly in your paper. When you use the correct MLA bibliography format, it shows the reader what sources you consulted, makes finding your sources easier for the reader, and gives credibility to your work as a ...
The Chicago/Turabian style of citing sources is generally used when citing sources for humanities papers, and is best known for its requirement that writers place bibliographic citations at the bottom of a page (in Chicago-format footnotes) or at the end of a paper (endnotes). The Turabian and Chicago citation styles are almost identical, but ...
Annotated bibliographies can be part of a larger research project, or can be a stand-alone report in itself. Annotation versus abstracts. An abstract is a paragraph at the beginning of the paper that discusses the main point of the original work. They typically do not include evaluation comments. Annotations can either be descriptive or evaluative.
Examples of Bibliography Format Examples of Bibliography Formats. There are standards for documenting sources of information in research papers. Even though different journals may use a slightly different format for the bibliography, they all contain the same basic information.
This is the total package when it comes to MLA format. Our easy to read guides come complete with examples and step-by-step instructions to format your full and in-text citations, paper, and works cited in MLA style. There's even information on annotated bibliographies.
English for Research: Usage, Style, and Grammar. New York: Springer Science and Business Media, 2012. Wang, Gabe T. and Keumjae Park. Student Research and Report Writing: From Topic Selection to the Complete Paper. Malden, MA: Wiley Blackwell, 2016. Warner, John. The Writer's Practice: Building Confidence in Your Non-Fiction Writing. New York ...
Below you'll find a Bibliography adapted from a research paper written by Aishani Aatresh for her Technology, Environment, and Society course. Barnard, Anne, and Grace Ashford. "Can New York Really Get to 100% Clean Energy by 2040?". New York Times, November 29, 2021, sec.
The essential difference between citations and references is that citations lead a reader to the source of information, while references provide the reader with detailed information regarding that particular source. Bibliography in research papers: A bibliography in research paper is a list of sources that appears at the end of a research paper ...
Citation Generator: Automatically generate accurate references and in-text citations using Scribbr's APA Citation Generator, MLA Citation Generator, Harvard Referencing Generator, and Chicago Citation Generator. Plagiarism Checker: Detect plagiarism in your paper using the most accurate Turnitin-powered plagiarism software available to ...
Some annotations may address all three of these steps. Consider the purpose of your annotated bibliography and/or your instructor's directions when deciding how much information to include in your annotations. Please keep in mind that all your text, including the write-up beneath the citation, must be indented so that the author's last name ...
Purpose: This paper is designed to critically review and analyze the body of research on a popular gang reduction strategy, implemented widely in the United States and a number of other countries, to: (1) assess whether researchers designed their evaluations to align with the theorized causal mechanisms that bring about reductions in violence; and (2) discuss how evidence on gang programs is ...
Academic journals, archives, and repositories are seeing an increasing number of questionable research papers clearly produced using generative AI. They are often created with widely available, general-purpose AI applications, most likely ChatGPT, and mimic scientific writing. Google Scholar easily locates and lists these questionable papers alongside reputable, quality-controlled research.