C. Worrell (Eds.), (pp. 345–359). American Psychological Association.
Parenthetical citation: (Aron et al., 2019)
Narrative citation: Aron et al. (2019)
Merriam-Webster. (n.d.). Culture. In . Retrieved September 9, 2019, from |
Parenthetical citation: (Merriam-Webster, n.d.)
Narrative citation: Merriam-Webster (n.d.)
National Cancer Institute. (2019). (NIH Publication No. 18-2059). U.S. Department of Health and Human Services, National Institutes of Health. |
Parenthetical citation: (National Cancer Institute, 2019)
Narrative citation: National Cancer Institute (2019)
The specific agency responsible for the report appears as the author. The names of parent agencies not present in the group author name appear in the source element as the publisher. This creates concise in-text citations and complete reference list entries.
Harvard University. (2019, August 28). [Video]. YouTube. |
Parenthetical citation: (Harvard University, 2019)
Narrative citation: Harvard University (2019)
APA Databases [@APA_Databases]. (2019, September 5). [Tweet]. Twitter. Gates, B. [@BillGates]. (2019, September 7). [Thumbnail with link attached] [Tweet]. Twitter. |
Parenthetical citations: (APA Databases, 2019; Gates, 2019)
Narrative citations: APA Databases (2019) and Gates (2019)
News From Science. (2019, June 21). [Image attached] [Status update]. Facebook. |
Parenthetical citation: (News From Science, 2019)
Narrative citation: News From Science (2019)
Fagan, J. (2019, March 25). . OER Commons. Retrieved September 17, 2019, from National Institute of Mental Health. (2018, July). . U.S. Department of Health and Human Services, National Institutes of Health. Woodyatt, A. (2019, September 10). . CNN. World Health Organization. (2018, May 24). . |
Parenthetical citations: (Fagan, 2019; National Institute of Mental Health, 2018; Woodyatt, 2019; World Health Organization, 2018)
Narrative citations: Fagan (2019), National Institute of Mental Health (2018), Woodyatt (2019), and World Health Organization (2018)
The following supplemental example references are mention in the Publication Manual:
Archival document and collections are not presented in the APA Publication Manual, Seventh Edition . This content is available only on the APA Style website . This guidance has been expanded from the 6th edition.
Archival sources include letters, unpublished manuscripts, limited-circulation brochures and pamphlets, in-house institutional and corporate documents, clippings, and other documents, as well as such nontextual materials as photographs and apparatus, that are in the personal possession of an author, form part of an institutional collection, or are stored in an archive such as the Archives of the History of American Psychology at the University of Akron or the APA Archives. For any documents like these that are available on the open web or via a database (subscription or nonsubscription), follow the reference templates shown in Chapter 10 of the Publication Manual.
The general format for the reference for an archival work includes the author, date, title, and source. The reference examples shown on this page may be modified for collections requiring more or less specific information to locate materials, for different types of collections, or for additional descriptive information (e.g., a translation of a letter). Authors may choose to list correspondence from their own personal collections, but correspondence from other private collections should be listed only with the permission of the collector.
Keep in mind the following principles when creating references to archival documents and collections:
Frank, L. K. (1935, February 4). [Letter to Robert M. Ogden]. Rockefeller Archive Center (GEB Series 1.3, Box 371, Folder 3877), Tarrytown, NY, United States.
Zacharius, G. P. (1953, August 15). [Letter to William Rickel (W. Rickel, Trans.)]. Copy in possession of Hendrika Vande Kemp.
Allport, G. W. (1930–1967). Correspondence. Gordon W. Allport Papers (HUG 4118.10), Harvard University Archives, Cambridge, MA, United States.
To cite specific letters in the text, provide the author and range of years as shown in the reference list entry, plus details about who wrote the specific letter to whom and when the specific letter was written.
Berliner, A. (1959). Notes for a lecture on reminiscences of Wundt and Leipzig. Anna Berliner Memoirs (Box M50), Archives of the History of American Psychology, University of Akron, Akron, OH, United States.
Allport, A. (presumed). (ca. 1937). Marion Taylor today—by the biographer [Unpublished manuscript]. Marion Taylor Papers, Schlesinger Library, Radcliffe College, Cambridge, MA, United States.
Subcommittee on Mental Hygiene Personnel in School Programs. (1949, November 5–6). Meeting of Subcommittee on Mental Hygiene Personnel in School Programs. David Shakow Papers (M1360), Archives of the History of American Psychology, University of Akron, Akron, OH, United States.
Smith, M. B. (1989, August 12). Interview by C. A. Kiesler [Tape recording]. President’s Oral History Project, American Psychological Association, APA Archives, Washington, DC, United States.
Sparkman, C. F. (1973). An oral history with Dr. Colley F. Sparkman/Interviewer: Orley B. Caudill. Mississippi Oral History Program (Vol. 289), University of Southern Mississippi, Hattiesburg, MS, United States.
Psychoanalysis institute to open. (1948, September 18). [Clipping from an unidentified Dayton, OH, United States, newspaper]. Copy in possession of author.
Sci-Art Publishers. (1935). Sci-Art publications [Brochure]. Roback Papers (HUGFP 104.50, Box 2, Folder “Miscellaneous Psychological Materials”), Harvard University Archives, Cambridge, MA, United States.
[Photographs of Robert M. Yerkes]. (ca. 1917–1954). Robert Mearns Yerkes Papers (Box 137, Folder 2292), Manuscripts and Archives, Yale University Library, New Haven, CT, United States.
U.S. Census Bureau. (1880). 1880 U.S. census: Defective, dependent, and delinquent classes schedule: Virginia [Microfilm]. NARA Microfilm Publication T1132 (Rolls 33–34), National Archives and Records Administration, Washington, DC, United States.
Read the full APA guidelines on citing ChatGPT
OpenAI. (2023). ChatGPT (Mar 14 version) [Large language model]. https://chat.openai.com/chat
Author: The author of the model is OpenAI.
Date: The date is the year of the version you used. Following the template in Section 10.10, you need to include only the year, not the exact date. The version number provides the specific date information a reader might need.
Title: The name of the model is “ChatGPT,” so that serves as the title and is italicized in your reference, as shown in the template. Although OpenAI labels unique iterations (i.e., ChatGPT-3, ChatGPT-4), they are using “ChatGPT” as the general name of the model, with updates identified with version numbers.
The version number is included after the title in parentheses. The format for the version number in ChatGPT references includes the date because that is how OpenAI is labeling the versions. Different large language models or software might use different version numbering; use the version number in the format the author or publisher provides, which may be a numbering system (e.g., Version 2.0) or other methods.
Bracketed text is used in references for additional descriptions when they are needed to help a reader understand what’s being cited. References for a number of common sources, such as journal articles and books, do not include bracketed descriptions, but things outside of the typical peer-reviewed system often do. In the case of a reference for ChatGPT, provide the descriptor “Large language model” in square brackets. OpenAI describes ChatGPT-4 as a “large multimodal model,” so that description may be provided instead if you are using ChatGPT-4. Later versions and software or models from other companies may need different descriptions, based on how the publishers describe the model. The goal of the bracketed text is to briefly describe the kind of model to your reader.
Source: When the publisher name and the author name are the same, do not repeat the publisher name in the source element of the reference, and move directly to the URL. This is the case for ChatGPT. The URL for ChatGPT is https://chat.openai.com/chat . For other models or products for which you may create a reference, use the URL that links as directly as possible to the source (i.e., the page where you can access the model, not the publisher’s homepage).
Works included in a reference list.
The reference list provides a reliable way for readers to identify and locate the works cited in a paper. APA Style papers generally include reference lists, not bibliographies.
In general, each work cited in the text must appear in the reference list, and each work in the reference list must be cited in the text. Check your work carefully before submitting your manuscript or course assignment to ensure no works cited in the text are missing from the reference list and vice versa, with only the following exceptions.
There are a few kinds of works that are not included in a reference list. Usually a work is not included because readers cannot recover it or because the mention is so broad that readers do not need a reference list entry to understand the use.
Information on works included in a reference list is covered in Sections 2.12 and 8.4 of the APA Publication Manual, Seventh Edition
*This guidance has been expanded from the 6th edition.*
The DOI or URL is the final component of a reference list entry. Because so much scholarship is available and/or retrieved online, most reference list entries end with either a DOI or a URL.
Follow these guidelines for including DOIs and URLs in references:
Follow these guidelines to format DOIs and URLs:
https://doi.org/ xxxxx
When a DOI or URL is long or complex, you may use shortDOIs or shortened URLs if desired.
Click below to watch a video: .
(Looking for the old 6th edition guide?)
Most academic writing cites others' ideas and research, for several reasons:
Different academic disciplines prefer different citation styles, most commonly APA and MLA styles.
Besides these styles, there are Chicago , Turabian , AAA , AP , and more. Only use the most current edition of the citation style.
Ask your instructors which citation style they want you to use for assignments.
When to cite.
To avoid plagiarism, provide a citation for ideas that are not your own:
You do not need to cite common knowledge (ex. George Washington was the first President of the United States) or proverbs unless you are using a direct quotation. When in doubt, cite your source.
Home / Guides / Citation Guides / How to Cite Sources
Here is a complete list for how to cite sources. Most of these guides present citation guidance and examples in MLA, APA, and Chicago.
If you’re looking for general information on MLA or APA citations , the EasyBib Writing Center was designed for you! It has articles on what’s needed in an MLA in-text citation , how to format an APA paper, what an MLA annotated bibliography is, making an MLA works cited page, and much more!
The Modern Language Association created the MLA Style, currently in its 9th edition, to provide researchers with guidelines for writing and documenting scholarly borrowings. Most often used in the humanities, MLA style (or MLA format ) has been adopted and used by numerous other disciplines, in multiple parts of the world.
MLA provides standard rules to follow so that most research papers are formatted in a similar manner. This makes it easier for readers to comprehend the information. The MLA in-text citation guidelines, MLA works cited standards, and MLA annotated bibliography instructions provide scholars with the information they need to properly cite sources in their research papers, articles, and assignments.
The American Psychological Association created the APA citation style in 1929 as a way to help psychologists, anthropologists, and even business managers establish one common way to cite sources and present content.
APA is used when citing sources for academic articles such as journals, and is intended to help readers better comprehend content, and to avoid language bias wherever possible. The APA style (or APA format ) is now in its 7th edition, and provides citation style guides for virtually any type of resource.
The Chicago/Turabian style of citing sources is generally used when citing sources for humanities papers, and is best known for its requirement that writers place bibliographic citations at the bottom of a page (in Chicago-format footnotes ) or at the end of a paper (endnotes).
The Turabian and Chicago citation styles are almost identical, but the Turabian style is geared towards student published papers such as theses and dissertations, while the Chicago style provides guidelines for all types of publications. This is why you’ll commonly see Chicago style and Turabian style presented together. The Chicago Manual of Style is currently in its 17th edition, and Turabian’s A Manual for Writers of Research Papers, Theses, and Dissertations is in its 8th edition.
The world of citations may seem cut and dry, but there’s more to them than just specific capitalization rules, MLA in-text citations , and other formatting specifications. Citations have been helping researches document their sources for hundreds of years, and are a great way to learn more about a particular subject area.
Ever wonder what sets all the different styles apart, or how they came to be in the first place? Read on for some interesting facts about citations!
You may be familiar with MLA and APA citation styles, but there are actually thousands of citation styles used for all different academic disciplines all across the world. Deciding which one to use can be difficult, so be sure to ask you instructor which one you should be using for your next paper.
While a majority of citation styles are named for the specific organizations that publish them (i.e. APA is published by the American Psychological Association, and MLA format is named for the Modern Language Association), some are actually named after individuals. The most well-known example of this is perhaps Turabian style, named for Kate L. Turabian, an American educator and writer. She developed this style as a condensed version of the Chicago Manual of Style in order to present a more concise set of rules to students.
How specific can citation styles get? The answer is very. For example, the “Flavour and Fragrance Journal” style is based on a bimonthly, peer-reviewed scientific journal published since 1985 by John Wiley & Sons. It publishes original research articles, reviews and special reports on all aspects of flavor and fragrance. Another example is “Nordic Pulp and Paper Research,” a style used by an international scientific magazine covering science and technology for the areas of wood or bio-mass constituents.
The US Census Bureau estimates that approximately 39.5 million people live in the state of California. Meanwhile, about 43 million citations were made on EasyBib from January to March of 2018. That’s a lot of citations.
The word “citations” can be traced back literally thousands of years to the Latin word “citare” meaning “to summon, urge, call; put in sudden motion, call forward; rouse, excite.” The word then took on its more modern meaning and relevance to writing papers in the 1600s, where it became known as the “act of citing or quoting a passage from a book, etc.”
The concept of citations always stays the same. It is a means of preventing plagiarism and demonstrating where you relied on outside sources. The specific style rules, however, can and do change regularly. For example, in 2018 alone, 46 new citation styles were introduced , and 106 updates were made to exiting styles. At EasyBib, we are always on the lookout for ways to improve our styles and opportunities to add new ones to our list.
Here are the ways accurate citations can help your students achieve academic success, and how you can answer the dreaded question, “why should I cite my sources?”
Citing their sources makes sure that the reader can differentiate the student’s original thoughts from those of other researchers. Not only does this make sure that the sources they use receive proper credit for their work, it ensures that the student receives deserved recognition for their unique contributions to the topic. Whether the student is citing in MLA format , APA format , or any other style, citations serve as a natural way to place a student’s work in the broader context of the subject area, and serve as an easy way to gauge their commitment to the project.
Having many citations from a wide variety of sources related to their idea means that the student is working on a well-researched and respected subject. Citing sources that back up their claim creates room for fact-checking and further research . And, if they can cite a few sources that have the converse opinion or idea, and then demonstrate to the reader why they believe that that viewpoint is wrong by again citing credible sources, the student is well on their way to winning over the reader and cementing their point of view.
The point of research projects is not to regurgitate information that can already be found elsewhere. We have Google for that! What the student’s project should aim to do is promote an original idea or a spin on an existing idea, and use reliable sources to promote that idea. Copying or directly referencing a source without proper citation can lead to not only a poor grade, but accusations of academic dishonesty. By citing their sources regularly and accurately, students can easily avoid the trap of plagiarism , and promote further research on their topic.
By researching sources to back up and promote their ideas, students are becoming better researchers without even knowing it! Each time a new source is read or researched, the student is becoming more engaged with the project and is developing a deeper understanding of the subject area. Proper citations demonstrate a breadth of the student’s reading and dedication to the project itself. By creating citations, students are compelled to make connections between their sources and discern research patterns. Each time they complete this process, they are helping themselves become better researchers and writers overall.
Make in-text/parenthetical citations as you need them.
As you are writing your paper, be sure to include references within the text that correspond with references in a works cited or bibliography. These are usually called in-text citations or parenthetical citations in MLA and APA formats. The most effective time to complete these is directly after you have made your reference to another source. For instance, after writing the line from Charles Dickens’ A Tale of Two Cities : “It was the best of times, it was the worst of times…,” you would include a citation like this (depending on your chosen citation style):
(Dickens 11).
This signals to the reader that you have referenced an outside source. What’s great about this system is that the in-text citations serve as a natural list for all of the citations you have made in your paper, which will make completing the works cited page a whole lot easier. After you are done writing, all that will be left for you to do is scan your paper for these references, and then build a works cited page that includes a citation for each one.
Need help creating an MLA works cited page ? Try the MLA format generator on EasyBib.com! We also have a guide on how to format an APA reference page .
While reading up on paper formatting may not sound exciting, being aware of how your paper should look early on in the paper writing process is super important. Citation styles can dictate more than just the appearance of the citations themselves, but rather can impact the layout of your paper as a whole, with specific guidelines concerning margin width, title treatment, and even font size and spacing. Knowing how to organize your paper before you start writing will ensure that you do not receive a low grade for something as trivial as forgetting a hanging indent.
Don’t know where to start? Here’s a formatting guide on APA format .
Collecting outside sources that support your research and specific topic is a critical step in writing an effective paper. But before you run to the library and grab the first 20 books you can lay your hands on, keep in mind that selecting a source to include in your paper should not be taken lightly. Before you proceed with using it to backup your ideas, run a quick Internet search for it and see if other scholars in your field have written about it as well. Check to see if there are book reviews about it or peer accolades. If you spot something that seems off to you, you may want to consider leaving it out of your work. Doing this before your start making citations can save you a ton of time in the long run.
Finished with your paper? It may be time to run it through a grammar and plagiarism checker , like the one offered by EasyBib Plus. If you’re just looking to brush up on the basics, our grammar guides are ready anytime you are.
How useful was this post?
Click on a star to rate it!
We are sorry that this post was not useful for you!
Let us improve this post!
Tell us how we can improve this post?
Citation Basics
Harvard Referencing
Plagiarism Basics
Upload a paper to check for plagiarism against billions of sources and get advanced writing suggestions for clarity and style.
Get Started
Author last name, first initial. (Date). Title of report (Publication No.). Publisher. DOI or URL
See specific examples below.
U.S. Government Accountability Office. (2010). Information security: Concerted effort needed to consolidate and secure Internet connections at federal agencies (Publication No. GAO-10-237). http://www.gao.gov/assets/310/301876.pdf
U.S. Government Accountability Office. (2010). Information security: Concerted effort needed to consolidate and secure Internet connections at federal agencies (Publication No. GAO-10-237).
See Publication Manual , 10.4.
Start your research.
A citation identifies for the reader the original source for an idea, information, or image that is referred to in a work.
From: Lemieux Library, University of Seattle
Quoting Are you quoting two or more consecutive words from a source? Then the original source should be cited and the words or phrase placed in quotes.
Paraphrasing If an idea or information comes from another source, even if you put it in your own words , you still need to credit the source. General vs. Unfamiliar Knowledge You do not need to cite material which is accepted common knowledge. If in doubt whether your information is common knowledge or not, cite it. Formats We usually think of books and articles. However, if you use material from web sites, films, music, graphs, tables, etc. you'll also need to cite these as well.
Plagiarism is presenting the words or ideas of someone else as your own without proper acknowledgment of the source. When you work on a research paper and use supporting material from works by others, it's okay to quote people and use their ideas, but you do need to correctly credit them. Even when you summarize or paraphrase information found in books, articles, or Web pages, you must acknowledge the original author.
Helpful links:
For additional writing resources specific to styles listed here visit the Purdue OWL Writing Lab
Creative Commons Attribution 3.0 License except where otherwise noted.
The land on which we gather is the unceded territory of the Awaswas-speaking Uypi Tribe. The Amah Mutsun Tribal Band, comprised of the descendants of indigenous people taken to missions Santa Cruz and San Juan Bautista during Spanish colonization of the Central Coast, is today working hard to restore traditional stewardship practices on these lands and heal from historical trauma.
The land acknowledgement used at UC Santa Cruz was developed in partnership with the Amah Mutsun Tribal Band Chairman and the Amah Mutsun Relearning Program at the UCSC Arboretum .
Don't let plagiarism errors spoil your paper, consider your source's credibility. ask these questions:, contributor/author.
This page contains reference examples for reports with individual authors.
Baral, P., Larsen, M., & Archer, M. (2019). Does money grow on trees? Restoration financing in Southeast Asia . Atlantic Council. https://www.atlanticcouncil.org/in-depth-research-reports/report/does-money-grow-on-trees-restoring-financing-in-southeast-asia/
Stuster, J., Adolf, J., Byrne, V., & Greene, M. (2018). Human exploration of Mars: Preliminary lists of crew tasks (Report No. NASA/CR-2018-220043). National Aeronautics and Space Administration. https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20190001401.pdf
Report references are covered in the seventh edition APA Style manuals in the Publication Manual Section 10.4 and the Concise Guide Section 10.4
Unfortunately we don't fully support your browser. If you have the option to, please upgrade to a newer version or use Mozilla Firefox , Microsoft Edge , Google Chrome , or Safari 14 or newer. If you are unable to, and need support, please send us your feedback .
We'd appreciate your feedback. Tell us what you think! opens in new tab/window
Show more influence and attention to your research than you have ever been able to show before. Scopus metrics are a comprehensive, trustworthy and transparent way to demonstrate your journal, article, author and institutional influence.
Subscribe to Scopus and access metrics
CiteScore™ metrics : Introduced in 2016, a family of eight indicators to analyze the publication influence of serial titles. CiteScore metrics offer more robust, timely and accurate indicators of a serial title’s impact.
SCImago Journal Rank (SJR) : A prestige metric for journals, book series and conference proceedings that weights the value of a citation based on the subject field, quality and reputation of the source.
Source-Normalized Impact per Paper (SNIP) : Measures contextual citation impact by taking differences in disciplinary characteristics into account; can be used to compare journals in different fields.
Source details screen web results at Scopus.com.
Four Scopus-specific metrics can be found on a document’s metrics details page : total number of citations by a date range of the user’s choosing, citations per year for a range, citation benchmarking (percentile) and Field-weighted Citation Impact. We've also recently added a new metric — views count — so users can understand usage at a glance.
PlumX Metrics : Also found on a document’s metrics details page, five comprehensive, item-level metrics that provide insights into the ways people interact with individual pieces of research output (articles, conference proceedings, book chapters, and many more) in the online environment.
h -index and h -graph : View a researcher's performance based on career publications as measured by the lifetime number of citations that each published article receives; h -indices indicate a balance between productivity (scholarly output) and citation influence (citation count).
Citation overview tracker : An adjustable date-range table that includes the number of times each document has been cited per publication year.
Visual analysis tools : Analyze an author’s output with a collection of in-depth tools designed to provide a clearer picture of an individual’s publication history (up to 15 years) and influence: total number of cited documents, total number of citations per year, and a list of documents with numbers of citing documents and links to citing documents per year and per article.
Learn more about CiteScore metrics, a suite of eight metrics that tell a richer story about research and researcher influence.
Our Research Metrics Guidebook provides facts about how data underlying the metrics in Scopus (and SciVal) are used, how the metrics are calculated and displayed, and how variables besides performance can affect the metrics.
Scopus Preview offers free access to journal rankings and other measures. Plus, you can view or download journal and book titles lists, and authors can check their profile and keep it up to date.
Use our free Scopus Preview to see journal rankings and other available metrics.
Librarians: For an easy-to-share handout on key research metrics, use our Research Metrics Quick Reference flyer, developed by Library Connect in collaboration with librarian Jenny Delasalle
Help | Advanced Search
Title: rag vs fine-tuning: pipelines, tradeoffs, and a case study on agriculture.
Abstract: There are two common ways in which developers are incorporating proprietary and domain-specific data when building applications of Large Language Models (LLMs): Retrieval-Augmented Generation (RAG) and Fine-Tuning. RAG augments the prompt with the external data, while fine-Tuning incorporates the additional knowledge into the model itself. However, the pros and cons of both approaches are not well understood. In this paper, we propose a pipeline for fine-tuning and RAG, and present the tradeoffs of both for multiple popular LLMs, including Llama2-13B, GPT-3.5, and GPT-4. Our pipeline consists of multiple stages, including extracting information from PDFs, generating questions and answers, using them for fine-tuning, and leveraging GPT-4 for evaluating the results. We propose metrics to assess the performance of different stages of the RAG and fine-Tuning pipeline. We conduct an in-depth study on an agricultural dataset. Agriculture as an industry has not seen much penetration of AI, and we study a potentially disruptive application - what if we could provide location-specific insights to a farmer? Our results show the effectiveness of our dataset generation pipeline in capturing geographic-specific knowledge, and the quantitative and qualitative benefits of RAG and fine-tuning. We see an accuracy increase of over 6 p.p. when fine-tuning the model and this is cumulative with RAG, which increases accuracy by 5 p.p. further. In one particular experiment, we also demonstrate that the fine-tuned model leverages information from across geographies to answer specific questions, increasing answer similarity from 47% to 72%. Overall, the results point to how systems built using LLMs can be adapted to respond and incorporate knowledge across a dimension that is critical for a specific industry, paving the way for further applications of LLMs in other industrial domains.
Subjects: | Computation and Language (cs.CL); Machine Learning (cs.LG) |
Cite as: | [cs.CL] |
(or [cs.CL] for this version) | |
Focus to learn more arXiv-issued DOI via DataCite |
Access paper:.
Code, data and media associated with this article, recommenders and search tools.
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .
Purdue Online Writing Lab Purdue OWL® College of Liberal Arts
This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.
Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.
Subsections.
Creating standards, guidelines, processes, and workflows for content marketing is not the sexiest job.
But setting standards is the only way to know if you can improve anything (with AI or anything else).
Here’s the good news: All that non-sexy work frees time and resources (human and tech) you can apply to bring your brand’s strategies and plans to life.
But in many organizations, content still isn’t treated as a coordinated business function. That’s one of the big takeaways from our latest research, B2B Content Marketing Benchmarks, Budgets, and Trends: Outlook for 2024, conducted with MarketingProfs and sponsored by Brightspot .
A few symptoms of that reality showed up in the research:
I’ll walk you through the findings and share some advice from CMI Chief Strategy Advisor Robert Rose and other industry voices to shed light on what it all means for B2B marketers. There’s a lot to work through, so feel free to use the table of contents to navigate to the sections that most interest you.
Note: These numbers come from a July 2023 survey of marketers around the globe. We received 1,080 responses. This article focuses on answers from the 894 B2B respondents.
Methodology, ai: 3 out of 4 b2b marketers use generative tools.
Of course, we asked respondents how they use generative AI in content and marketing. As it turns out, most experiment with it: 72% of respondents say they use generative AI tools.
But a lack of standards can get in the way.
“Generative AI is the new, disruptive capability entering the realm of content marketing in 2024,” Robert says. “It’s just another way to make our content process more efficient and effective. But it can’t do either until you establish a standard to define its value. Until then, it’s yet just another technology that may or may not make you better at what you do.”
So, how do content marketers use the tools today? About half (51%) use generative AI to brainstorm new topics. Many use the tools to research headlines and keywords (45%) and write drafts (45%). Fewer say they use AI to outline assignments (23%), proofread (20%), generate graphics (11%), and create audio (5%) and video (5%).
Some marketers say they use AI to do things like generate email headlines and email copy, extract social media posts from long-form content, condense long-form copy into short form, etc.
Only 28% say they don’t use generative AI tools.
Among those who use generative AI tools, 91% use free tools (e.g., ChatGPT ). Thirty-eight percent use tools embedded in their content creation/management systems, and 27% pay for tools such as Writer and Jasper.
Asked if their organizations have guidelines for using generative AI tools, 31% say yes, 61% say no, and 8% are unsure.
We asked Ann Handley , chief content officer of MarketingProfs, for her perspective. “It feels crazy … 61% have no guidelines? But is it actually shocking and crazy? No. It is not. Most of us are just getting going with generative AI. That means there is a clear and rich opportunity to lead from where you sit,” she says.
“Ignite the conversation internally. Press upon your colleagues and your leadership that this isn’t a technology opportunity. It’s also a people and operational challenge in need of thoughtful and intelligent response. You can be the AI leader your organization needs,” Ann says.
While a lack of guidelines may deter some B2B marketers from using generative AI tools, other reasons include accuracy concerns (36%), lack of training (27%), and lack of understanding (27%). Twenty-two percent cite copyright concerns, and 19% have corporate mandates not to use them.
We also wondered how AI’s integration in search engines shifts content marketers’ SEO strategy. Here’s what we found:
Over one-fourth (28%) say they’re not doing any of those things, while 26% say they’re unsure.
AI may heighten the need to rethink your SEO strategy. But it’s not the only reason to do so, as Orbit Media Studios co-founder and chief marketing officer Andy Crestodina points out: “Featured snippets and people-also-ask boxes have chipped away at click-through rates for years,” he says. “AI will make that even worse … but only for information intent queries . Searchers who want quick answers really don’t want to visit websites.
“Focus your SEO efforts on those big questions with big answers – and on the commercial intent queries,” Andy continues. “Those phrases still have ‘visit website intent’ … and will for years to come.”
Many B2B marketers surveyed predict AI will dominate the discussions of content marketing trends in 2024. As one respondent says: “AI will continue to be the shiny thing through 2024 until marketers realize the dedication required to develop prompts, go through the iterative process, and fact-check output . AI can help you sharpen your skills, but it isn’t a replacement solution for B2B marketing.”
Back to table of contents
Generative AI isn’t the only issue affecting content marketing these days. We also asked marketers about how they organize their teams .
Among larger companies (100-plus employees), half say content requests go through a centralized content team. Others say each department/brand produces its own content (23%), and the departments/brand/products share responsibility (21%).
Seventy percent say their organizations integrate content strategy into the overall marketing sales/communication/strategy, and 2% say it’s integrated into another strategy. Eleven percent say content is a stand-alone strategy for content used for marketing, and 6% say it’s a stand-alone strategy for all content produced by the company. Only 9% say they don’t have a content strategy. The remaining 2% say other or are unsure.
Twenty-eight percent of B2B marketers say team members resigned in the last year, 20% say team members were laid off, and about half (49%) say they had new team members acclimating to their ways of working.
While team members come and go, the understanding of content doesn’t. Over half (54%) strongly agree, and 30% somewhat agree the leader to whom their content team reports understands the work they do. Only 11% disagree. The remaining 5% neither agree nor disagree.
And remote work seems well-tolerated: Only 20% say collaboration was challenging due to remote or hybrid work.
We asked B2B marketers about both content creation and non-creation challenges.
Most marketers (57%) cite creating the right content for their audience as a challenge. This is a change from many years when “creating enough content” was the most frequently cited challenge.
One respondent points out why understanding what audiences want is more important than ever: “As the internet gets noisier and AI makes it incredibly easy to create listicles and content that copy each other, there will be a need for companies to stand out. At the same time, as … millennials and Gen Z [grow in the workforce], we’ll begin to see B2B become more entertaining and less boring. We were never only competing with other B2B content. We’ve always been competing for attention.”
Other content creation challenges include creating it consistently (54%) and differentiating it (54%). Close to half (45%) cite optimizing for search and creating quality content (44%). About a third (34%) cite creating enough content to keep up with internal demand, 30% say creating enough content to keep up with external demand, and 30% say creating content that requires technical skills.
The most frequently cited non-creation challenge, by far, is a lack of resources (58%), followed by aligning content with the buyer’s journey (48%) and aligning content efforts across sales and marketing (45%). Forty-one percent say they have issues with workflow/content approval, and 39% say they have difficulty accessing subject matter experts. Thirty-four percent say it is difficult to keep up with new technologies/tools (e.g., AI). Only 25% cite a lack of strategy as a challenge, 19% say keeping up with privacy rules, and 15% point to tech integration issues.
We asked content marketers about the types of content they produce, their distribution channels , and paid content promotion. We also asked which formats and channels produce the best results.
As in the previous year, the three most popular content types/formats are short articles/posts (94%, up from 89% last year), videos (84%, up from 75% last year), and case studies/customer stories (78%, up from 67% last year). Almost three-quarters (71%) use long articles, 60% produce visual content, and 59% craft thought leadership e-books or white papers. Less than half of marketers use brochures (49%), product or technical data sheets (45%), research reports (36%), interactive content (33%), audio (29%), and livestreaming (25%).
Which formats are most effective? Fifty-three percent say case studies/customer stories and videos deliver some of their best results. Almost as many (51%) names thought leadership e-books or white papers, 47% short articles, and 43% research reports.
Regarding the channels used to distribute content, 90% use social media platforms (organic), followed by blogs (79%), email newsletters (73%), email (66%), in-person events (56%), and webinars (56%).
Channels used by the minority of those surveyed include:
Which channels perform the best? Most marketers in the survey point to in-person events (56%) and webinars (51%) as producing better results. Email (44%), organic social media platforms (44%), blogs (40%) and email newsletters (39%) round out the list.
When marketers pay to promote content , which channels do they invest in? Eighty-six percent use paid content distribution channels.
Of those, 78% use social media advertising/promoted posts, 65% use sponsorships, 64% use search engine marketing (SEM)/pay-per-click, and 59% use digital display advertising. Far fewer invest in native advertising (35%), partner emails (29%), and print display ads (21%).
SEM/pay-per-click produces good results, according to 62% of those surveyed. Half of those who use paid channels say social media advertising/promoted posts produce good results, followed by sponsorships (49%), partner emails (36%), and digital display advertising (34%).
When asked which organic social media platforms deliver the best value for their organization, B2B marketers picked LinkedIn by far (84%). Only 29% cite Facebook as a top performer, 22% say YouTube, and 21% say Instagram. Twitter and TikTok see 8% and 3%, respectively.
So it makes sense that 72% say they increased their use of LinkedIn over the last 12 months, while only 32% boosted their YouTube presence, 31% increased Instagram use, 22% grew their Facebook presence, and 10% increased X and TikTok use.
Which platforms are marketers giving up? Did you guess X? You’re right – 32% of marketers say they decreased their X use last year. Twenty percent decreased their use of Facebook, with 10% decreasing on Instagram, 9% pulling back on YouTube, and only 2% decreasing their use of LinkedIn.
Interestingly, we saw a significant rise in B2B marketers who use TikTok: 19% say they use the platform – more than double from last year.
To explore how teams manage content, we asked marketers about their technology use and investments and the challenges they face when scaling their content .
When asked which technologies they use to manage content, marketers point to:
But having technology doesn’t mean it’s the right technology (or that its capabilities are used). So, we asked if they felt their organization had the right technology to manage content across the organization.
Only 31% say yes. Thirty percent say they have the technology but aren’t using its potential, and 29% say they haven’t acquired the right technology. Ten percent are unsure.
Even so, investment in content management technology seems likely in 2024: 45% say their organization is likely to invest in new technology, whereas 32% say their organization is unlikely to do so. Twenty-three percent say their organization is neither likely nor unlikely to invest.
We introduced a new question this year to understand what challenges B2B marketers face while scaling content production .
Almost half (48%) say it’s “not enough content repurposing.” Lack of communication across organizational silos is a problem for 40%. Thirty-one percent say they have no structured content production process, and 29% say they lack an editorial calendar with clear deadlines. Ten percent say scaling is not a current focus.
Among the other hurdles – difficulty locating digital content assets (16%), technology issues (15%), translation/localization issues (12%), and no style guide (11%).
For those struggling with content repurposing, content standardization is critical. “Content reuse is the only way to deliver content at scale. There’s just no other way,” says Regina Lynn Preciado , senior director of content strategy solutions at Content Rules Inc.
“Even if you’re not trying to provide the most personalized experience ever or dominate the metaverse with your omnichannel presence, you absolutely must reuse content if you are going to deliver content effectively,” she says.
“How to achieve content reuse ? You’ve probably heard that you need to move to modular, structured content. However, just chunking your content into smaller components doesn’t go far enough. For content to flow together seamlessly wherever you reuse it, you’ve got to standardize your content. That’s the personalization paradox right there. To personalize, you must standardize.
“Once you have your content standards in place and everyone is creating content in alignment with those standards, there is no limit to what you can do with the content,” Regina explains.
Why do content marketers – who are skilled communicators – struggle with cross-silo communication? Standards and alignment come into play.
“I think in the rush to all the things, we run out of time to address scalable processes that will fix those painful silos, including taking time to align on goals, roles and responsibilities, workflows, and measurement,” says Ali Orlando Wert , senior director of content strategy at Appfire. “It takes time, but the payoffs are worth it. You have to learn how to crawl before you can walk – and walk before you can run.”
Almost half (46%) of B2B marketers agree their organization measures content performance effectively. Thirty-six percent disagree, and 15% neither agree nor disagree. Only 3% say they don’t measure content performance.
The five most frequently used metrics to assess content performance are conversions (73%), email engagement (71%), website traffic (71%), website engagement (69%), and social media analytics (65%).
About half (52%) mention the quality of leads, 45% say they rely on search rankings, 41% use quantity of leads, 32% track email subscribers, and 29% track the cost to acquire a lead, subscriber, or customer.
The most common challenge B2B marketers have while measuring content performance is integrating/correlating data across multiple platforms (84%), followed by extracting insights from data (77%), tying performance data to goals (76%), organizational goal setting (70%), and lack of training (66%).
Regarding goals, 84% of B2B marketers say content marketing helped create brand awareness in the last 12 months. Seventy-six percent say it helped generate demand/leads; 63% say it helped nurture subscribers/audiences/leads, and 58% say it helped generate sales/revenue (up from 42% the previous year).
To separate top performers from the pack, we asked the B2B marketers to assess the success of their content marketing approach.
Twenty-eight percent rate the success of their organization’s content marketing approach as extremely or very successful. Another 57% report moderate success and 15% feel minimally or not at all successful.
The most popular factor for successful marketers is knowing their audience (79%).
This makes sense, considering that “creating the right content for our audience” is the top challenge. The logic? Top-performing content marketers prioritize knowing their audiences to create the right content for those audiences.
Top performers also set goals that align with their organization’s objectives (68%), effectively measure and demonstrate content performance (61%), and show thought leadership (60%). Collaboration with other teams (55%) and a documented strategy (53%) also help top performers reach high levels of content marketing success.
We looked at several other dimensions to identify how top performers differ from their peers. Of note, top performers:
Little difference exists between top performers and their less successful peers when it comes to the adoption of generative AI tools and related guidelines. It will be interesting to see if and how that changes next year.
To explore budget plans for 2024, we asked respondents if they have knowledge of their organization’s budget/budgeting process for content marketing. Then, we asked follow-up questions to the 55% who say they do have budget knowledge.
Here’s what they say about the total marketing budget (excluding salaries):
Next, we asked about their 2024 content marketing budget. Forty-five percent think their content marketing budget will increase compared with 2023, whereas 42% think it will stay the same. Only 6% think it will decrease.
We also asked where respondents plan to increase their spending.
Sixty-nine percent of B2B marketers say they would increase their investment in video, followed by thought leadership content (53%), in-person events (47%), paid advertising (43%), online community building (33%), webinars (33%), audio content (25%), digital events (21%), and hybrid events (11%).
The increased investment in video isn’t surprising. The focus on thought leadership content might surprise, but it shouldn’t, says Stephanie Losee , director of executive and ABM content at Autodesk.
“As measurement becomes more sophisticated, companies are finding they’re better able to quantify the return from upper-funnel activities like thought leadership content ,” she says. “At the same time, companies recognize the impact of shifting their status from vendor to true partner with their customers’ businesses.
“Autodesk recently launched its first global, longitudinal State of Design & Make report (registration required), and we’re finding that its insights are of such value to our customers that it’s enabling conversations we’ve never been able to have before. These conversations are worth gold to both sides, and I would imagine other B2B companies are finding the same thing,” Stephanie says.
We asked an open-ended question about marketers’ top three content-related priorities for 2024. The responses indicate marketers place an emphasis on thought leadership and becoming a trusted resource.
Other frequently mentioned priorities include:
In another open-ended question, we asked B2B marketers, “What content marketing trends do you predict for 2024?” You probably guessed the most popular trend: AI.
Here are some of the marketers’ comments about how AI will affect content marketing next year:
Other trends include:
Among the related comments:
What does this year’s research suggest B2B content marketers do to move forward?
I asked CMI’s Robert Rose for some insights. He says the steps are clear: Develop standards, guidelines, and playbooks for how to operate – just like every other function in business does.
“Imagine if everyone in your organization had a different idea of how to define ‘revenue’ or ‘profit margin,’” Robert says. “Imagine if each salesperson had their own version of your company’s customer agreements and tried to figure out how to write them for every new deal. The legal team would be apoplectic. You’d start to hear from sales how they were frustrated that they couldn’t figure out how to make the ‘right agreement,’ or how to create agreements ‘consistently,’ or that there was a complete ‘lack of resources’ for creating agreements.”
Just remember: Standards can change along with your team, audiences, and business priorities. “Setting standards doesn’t mean casting policies and templates in stone,” Robert says. “Standards only exist so that we can always question the standard and make sure that there’s improvement available to use in setting new standards.”
He offers these five steps to take to solidify your content marketing strategy and execution:
For their 14 th annual content marketing survey, CMI and MarketingProfs surveyed 1,080 recipients around the globe – representing a range of industries, functional areas, and company sizes — in July 2023. The online survey was emailed to a sample of marketers using lists from CMI and MarketingProfs.
This article presents the findings from the 894 respondents, mostly from North America, who indicated their organization is primarily B2B and that they are either content marketers or work in marketing, communications, or other roles involving content.
Thanks to the survey participants, who made this research possible, and to everyone who helps disseminate these findings throughout the content marketing industry.
Cover image by Joseph Kalinowski/Content Marketing Institute
Content Marketing Institute (CMI) exists to do one thing: advance the practice of content marketing through online education and in-person and digital events. We create and curate content experiences that teach marketers and creators from enterprise brands, small businesses, and agencies how to attract and retain customers through compelling, multichannel storytelling. Global brands turn to CMI for strategic consultation, training, and research. Organizations from around the world send teams to Content Marketing World, the largest content marketing-focused event, the Marketing Analytics & Data Science (MADS) conference, and CMI virtual events, including ContentTECH Summit. Our community of 215,000+ content marketers shares camaraderie and conversation. CMI is organized by Informa Connect. To learn more, visit www.contentmarketinginstitute.com .
Marketingprofs is your quickest path to b2b marketing mastery.
More than 600,000 marketing professionals worldwide rely on MarketingProfs for B2B Marketing training and education backed by data science, psychology, and real-world experience. Access free B2B marketing publications, virtual conferences, podcasts, daily newsletters (and more), and check out the MarketingProfs B2B Forum–the flagship in-person event for B2B Marketing training and education at MarketingProfs.com.
Brightspot , the content management system to boost your business.
Why Brightspot? Align your technology approach and content strategy with Brightspot, the leading Content Management System for delivering exceptional digital experiences. Brightspot helps global organizations meet the business needs of today and scale to capitalize on the opportunities of tomorrow. Our Enterprise CMS and world-class team solves your unique business challenges at scale. Fast, flexible, and fully customizable, Brightspot perfectly harmonizes your technology approach with your content strategy and grows with you as your business evolves. Our customer-obsessed teams walk with you every step of the way with an unwavering commitment to your long-term success. To learn more, visit www.brightspot.com .
IMAGES
VIDEO
COMMENTS
Reports may be published by governments, task groups, or other organizations. To reference a report with an individual author, include the author's name and initials, the report title (italicized), the report number, the organization that published it, and the URL (if accessed online, e.g. as a PDF ). APA format. Author last name, Initials.
To cite a report in APA style, you need to have basic information including the name of the author/organization, publication year, title of the report, publisher, and/or URL. The templates for in-text citations and reference list entries for a report, along with examples, are given below. Author or organization.
Whenever possible, give a citation for the measurements' supporting literature (e.g. manual, book, or journal article ). If the supporting literature is unavailable, cite the the test itself or database record using the following rule. General Rule: Author name. (year). Title of the test.
Parenthetical citations: (Grady et al., 2019; Jerrentrup et al., 2018) Narrative citations: Grady et al. (2019) and Jerrentrup et al. (2018) If a journal article has a DOI, include the DOI in the reference. If the journal article does not have a DOI and is from an academic research database, end the reference after the page range (for an explanation of why, see the database information page).
APA Style uses the author-date citation system, in which a brief in-text citation directs readers to a full reference list entry.The in-text citation appears within the body of the paper (or in a table, figure, footnote, or appendix) and briefly identifies the cited work by its author and date of publication.
Sources that support your ideas give your paper authority and credibility; Shows you have researched your topic thoroughly; Crediting sources protects you from plagiarism; A list of sources can be a useful record for further research; Different academic disciplines prefer different citation styles, most commonly APA and MLA styles.
It publishes original research articles, reviews and special reports on all aspects of flavor and fragrance. Another example is "Nordic Pulp and Paper Research," a style used by an international scientific magazine covering science and technology for the areas of wood or bio-mass constituents. 4.
Format: Author last name, first initial. (Date). Title of report (Publication No.).Publisher. DOI or URL. Elements: Author: List the last name, followed by the first initial (and second initial).See Authors for more information.; Date: List the date between parentheses, followed by a period Title of report: In italics.Capitalize the first word of the title, subtitle, and proper nouns.
More than 100 reference examples and their corresponding in-text citations are presented in the seventh edition Publication Manual.Examples of the most common works that writers cite are provided on this page; additional examples are available in the Publication Manual.. To find the reference example you need, first select a category (e.g., periodicals) and then choose the appropriate type of ...
Figure 8.1 in Chapter 8 of the Publication Manual provides an example of an appropriate level of citation. The number of sources you cite in your paper depends on the purpose of your work. For most papers, cite one or two of the most representative sources for each key point. Literature review papers typically include a more exhaustive list of ...
A citation identifies for the reader the original source for an idea, information, or image that is referred to in a work. In the body of a paper, the in-text citation acknowledges the source of information used.; At the end of a paper, the citations are compiled on a References or Works Cited list.A basic citation includes the author, title, and publication information of the source.
When using APA format, follow the author-date method of in-text citation. This means that the author's last name and the year of publication for the source should appear in the text, like, for example, (Jones, 1998). One complete reference for each source should appear in the reference list at the end of the paper.
Journal Citation Reports (JCR) is a comprehensive and authoritative source of data and analysis on the performance and impact of thousands of scholarly journals across various disciplines. JCR provides metrics such as Journal Impact Factor, Quartile and Percentile Rank, and ESI Total Citations to help researchers, publishers, librarians and funders evaluate and compare journals. JCR also ...
Don't let plagiarism errors spoil your paper. Scan your paper for plagiarism mistakes. Get help for 7,000+ citation styles including APA 7. Check for 400+ advanced grammar errors. Create in-text citations and save them. Free 3-day trial. Cancel anytime.*️. Try Citation Machine® Plus! *See Terms and Conditions.
Media Files: APA Sample Student Paper , APA Sample Professional Paper This resource is enhanced by Acrobat PDF files. Download the free Acrobat Reader. Note: The APA Publication Manual, 7 th Edition specifies different formatting conventions for student and professional papers (i.e., papers written for credit in a course and papers intended for scholarly publication).
APA Style (7th Edition) These OWL resources will help you learn how to use the American Psychological Association (APA) citation and format style. This section contains resources on in-text citation and the References page, as well as APA sample papers, slide presentations, and the APA classroom poster.
Narrative citations: Baral et al. (2019) and Stuster et al. (2018) If the report has a report number, include it in parentheses without italics after the report title. Provide the publisher of the report and its URL in the source element of the reference.
Article-level metrics. Four Scopus-specific metrics can be found on a document's metrics details page: total number of citations by a date range of the user's choosing, citations per year for a range, citation benchmarking (percentile) and Field-weighted Citation Impact. We've also recently added a new metric — views count — so users ...
RAG augments the prompt with the external data, while fine-Tuning incorporates the additional knowledge into the model itself. However, the pros and cons of both approaches are not well understood. In this paper, we propose a pipeline for fine-tuning and RAG, and present the tradeoffs of both for multiple popular LLMs, including Llama2-13B, GPT ...
If you need help with research and citation, Purdue OWL® is your go-to source for comprehensive and reliable guidance. You can find information on various citation styles, such as APA, MLA, Chicago, and more, as well as tips on how to conduct and evaluate research using different methods and sources. Purdue OWL® also offers examples and exercises to help you master the skills of academic ...
A few symptoms of that reality showed up in the research: Marketers cite a lack of resources as a top situational challenge, the same as they did the previous year. ... names thought leadership e-books or white papers, 47% short articles, and 43% research reports. Click the image to enlarge. Popular content distribution channels. Regarding the ...