AI Content study part II

Request free whitepaper

A lot has happened in the year since we published the first part of our AI content study. Download our free white paper now with the results of our “AI Content Study Part 2: AI Texts and Google Rankings: How well does AI content rank?” Download it now. In it, our eo AI task force evaluates the ranking ability of AI texts. You will also find instructions on how to optimise your AI-generated texts.

Table of Contents:

This whitepaper highlights the potential and limitations of AI-powered content in terms of SEO. You will learn how AI content ranks on Google, what challenges it poses, and what steps are necessary to make it rankable. We also discuss specific technical, strategic, and creative aspects that are crucial for creating high-quality content.

Dr. Beatrice
Eiring
, Head of Content Creation b.eiring@eology.de +49 9381 5829015

Sample chapter

Study description: What, When, How, Who? Procedure and more

During the test period from 1 May to 31 August 2024, the eo AI Task Force generated 118 website texts using the chatbots ChatGPT-4o (OpenAI) and Claude 3.5 Sonnet (Anthropic). The texts created by the chatbots were evaluated, assessed and compared with content written by experienced copywriters at eology GmbH:

Note

The term ‘human-created’ requires a definition that provides clarity. Not every person has the ability (knowledge of the German language, editorial training, etc.) and talent (affinity and aptitude for writing) to create high-quality texts. In the case of the eo AI content study, SEO knowledge is an additional factor.

For this reason, the AI texts in the eo AI study are compared with texts written by trained SEO editors and evaluated according to the quality standards that eology Content Creation follows for high-quality, value-added content with high ranking potential.

The primary goal of the eo AI Content Study Part II is to evaluate the ranking ability of AI texts. Google evaluates content according to various criteria to ensure that users receive the most relevant and high-quality results. A key benchmark is the so-called E-E-A-T model (Experience, Expertise, Authoritativeness, Trustworthiness). These criteria are used to evaluate the quality of content and the trustworthiness of sources. According to this model, website content must convey expertise, experience, authority and trustworthiness. If this is not the case, websites rank lower or are even penalised. This can affect the entire domain and not just individual pages with poor content.

It is particularly critical when E-E-A-T is not fulfilled in so-called Your Money Your Life content. These are pages that deal with topics such as health, finance and legal information. The topics for which texts were created using AI for the study range from soft topics such as ‘celebrating children’s birthdays’ to medical topics such as the disease scarlet fever or legal topics such as protection against dismissal during pregnancy.

The most important point of the eo AI Content Study Part II was to examine whether AI texts can meet Google’s E-E-A-T model. This examination was carried out in three steps:

  1. Evaluation of the degree to which the target group orientation criteria of the SEO quality standard were met by the experts of the eo AI task force
  2. Evaluation of E-E-A-T by experts from the fields of law, medicine and finance
  3. Evaluation of ranking ability via the test domain die-familie.org
It is important to note that:

As this is an empirical study based on a limited text corpus with the aim of assessing SEO performance potential, other methods, test scenarios and use cases may yield different results. The eo AI Task Force welcomes constructive feedback, professional exchange and discussion.

Contact
get in touch

  +49 9381 5829000