Why ChatGPT's Most Cited Pages Don't Rank on Google

The most interesting thing is Google has just made SEO a positioning game again. So if we look at what Lily Ray here said, so she says, Google just put out its first official article on optimizing for AI search, AEO, GEO. The TLDR, too long didn't read, is SEO still the foundation for AI search?

Wow, right? That's kind of a joke a little bit, but create non-commodity people-first content, right? Ignore most GEO, AEO hacks like chunking and LLMs.txt. So the first two here, when I say it's a joke, I'm not talking about literally right here.

I'm just saying that these things SEOs have known for a very long time that these SEO and AEO, GEO, they kind of go hand in hand. And when you're talking about creating non-commodity people-first content, That's ever since the very first day I started learning SEO, it's been like that. And then all these other hacks over here, they don't matter that much.

At least that's what Google is saying, right? With these llms.txt and chunking. That's the first piece. Do you have any reactions to this one before I move to the next one?

Yeah, and when Lily Ray's posting this, she's not saying this is how you win in this new AEO or GO world. She's just summarizing what Google puts out, right? So Google... will tell you what they want, their narrative.

It doesn't mean that they're going to tell you everything. It also doesn't mean that they're hiding anything either. Um, I do believe SEO is still the foundation. Uh, there are some nuances and some differences, but it still is a foundation and you had to create amazing content that people haven't seen before that they want to engage with.

And I think if you do that, it'll start doing really well in the LLMs as well. Um, people really struggle with number two. I don't think too many people have an issue with the fundamentals of SEO because it's been around for a long time, but they do struggle on the content side because content marketing has been around for so long.

It's more and more competitive and there's already a lot of information on the web. So you have an issue of regurgitation and people are tired of the same stuff over and over again. Cool. And so, by the way, Tim Solo shared this, and this happened June 2nd.

He got a million views on this. So in the last six months, Ahrefs, we analyzed over 1 billion data points across 14 studies. And here's what we learned about AI search optimization. Number one.

Best X blog listicles are the single most prominent content format cited by AI chatbots. They make up 44% of all pages cited by ChatGPT specifically. Number two, 67% of ChatGPT's top 1,000 citations come from sources marketers can't influence. Number one is Wikipedia, 30%.

Homepages, 24%. App stores, 6.6%. Only 32% are influenceable content like educational pages, reviews, news, and blog posts. I'm going to read one more here and then we can talk about this.

Read them all. Read them all. I'm going to read three. You can read the rest. Three. 28.3% of ChatGPT's most cited pages have zero Google organic visibility.

These pages get cited repeatedly by ChatGPT despite not ranking in Google at all. A completely separate discovery layer. Okay, that's interesting. Number four.

ChatGPT only cites about 50% of the URLs it retrieves. It fetches dozens of pages per query, but uses half as background context without attribution. This means that being retrieved and being cited are very different things. Number five, before I turn it over to Neil to read the next five.

Number five, adding schema markup had zero meaningful impact on AI citations. AI overviews actually dipped 4.6%, while AI mode 2.4% and ChatGPG 2.2% showed changes indistinguishable from zero. Okay, let's get to the next. Number six, YouTube mentions have the highest correlation, 0.737, with AI branded visibility out of all the factors we studied, including all the conventional SEO metrics like backlinks, page count, domain rating, etc.,

This held true for both Google-owned and OpenAI products. Number seven, AI overviews reduce clicks to the number one result by 58%. That's up from 34.5% just 10 months earlier. This trend is accelerated.

Number eight, 99% of AI overviews appear on informational intent queries. Transactional, navigational, and local searches are almost entirely AI overview free. Shopping triggers AI overviews just 3.2% of the time.

Number nine, for a given search query, Google's AI mode and AI overviews reach the same conclusions 86% of the time, but cite almost entirely different sources. Only 13.7 citation overlap, or 13.7% citation overlap.

Number 10, AA overviews change every 2.15 days on average, with 70% of the content differing between consecutive observations. But semantic similarity stays at 0.95. The words, the sources, the entities constantly shuffle. But the actual meaning barely moves.

By the way, for number eight, it's 99.9%. So basically 100% of AI overviews appear on informational intent queries. I think this is good data, by the way. This is really good.

So where do we want to start first? I think this is a surprise to me. Number five, adding schema markup had zero, zero meaningful impact on AI citation. So all the stuff like AEOs, SEOs like to talk about, that's a little surprising to me.

Well, here's clarification here, Eric. He's talking specifically about AI citations. He's not saying it doesn't impact them pulling your content. This is just something.

So that's why it was surprising. I didn't read it right. But we're all optimizing for citations. We're not optimizing for them pulling from you and not citing you.

Yep. Number six, YouTube mentions had the highest correlation with AI brand visibility out of all the factors we included. So, I mean, it depends. I mean, with Google-owned products, it's also true for open AI products.

And I think we revealed this in the last HubSpot that we talked about. I think we pointed out the graph where it's like the top three sources are, they're interchangeable, like the rankings shift, but Reddit, YouTube, and Wikipedia. So that makes a lot of sense. What else is interesting to you here?

Number eight is interesting for me because I think it's going to change. So this, Eric and I know, in which AI overviews really only appear on informational intent queries. It's the number one area where they appear.

You don't really see much on transactional navigation on local searches, which we've seen. But here's the kicker. Tim mentions shopping triggers AI overviews just 3.2% of the time.

I'm not saying AI overviews are going to appear more for shopping-related queries. I do believe shopping is going to change because of how Google released their new search features with agents. Eric, if you want to open up a new tab and we can show people on the screen here on what we're talking about. Which tab?

A new tab. You know, from the Google... io marketing live in which they talked about the new search tab and shopping features you see the article and they use the dresses example find me this dress but in this color and they uploaded two images and the agent just goes out and finds it find me a blue dress for a wedding you mean like dragging something in but it's okay so air so uh go back really quickly

Okay, so there's a plus button that's being highlighted, right? You saw the Google colors right there. You can actually upload images. So you can upload two images.

You would upload the first image. Eric's using a blue dress as an example. So you would upload the dress you're looking for, like the style. The second image that you could upload is maybe the color of the fabric.

And you can say, find me a dress that looks like this, but in the color red. Or you can upload a picture of the specific fabric you want, and Google will just go and find it. And you're seeing it right here on the screen. So Eric uploaded an image of a blue dress, and it's showing you all the places with a similar style that sell that dress.

Oh, that's pretty cool. You want me to buy you a dress? I think I'm good on the dress end, but I appreciate the offer. This is how I think shopping is going to be effective.

Not necessarily by AI overviews, but the 10 blue links are, and even the shopping category is going to be really effective by people just typing in exactly what they want. Not only can you describe it now in words, you can upload multiple images, not just one. You can say, I like this dress style in this color. but I wanted this dress length.

So three different images, one image with dress length, one image on the color, one image on the style, and it will go scour the web and find you all the ones for sale that might be right for you. And you can even tell the size you want and the price range, and it'll go figure it all out for you. That's going to change Shopee. It happened very quickly, too.

So that's awesome. Cool. A few seconds. It didn't take long at all. It was quick. Yeah, I think... So, by the way, I mean, I just want to call out the fact that this post... Because I think Tim does well on X.

But I think this is one of his... his better ones when you have when you're super data dense like this and you have a couple of interesting points here this is very shareable you got 7 000 bookmarks on it i just retweeted it myself a million views on it um i think that's great so yes quick break look i know what you're thinking another ai content tool great more garbage content on the internet And I thought the same thing. That's how we spent years building ClickFlow differently.

Here's actual feedback from a user. It's sophisticated, grounded in real language, authoritative, but not academic. You hit the sweet spot. That's not AI slop.

That's content that you would actually publish. ClickFlow also helps with things such as internal linking, building FAQs, and reporting on the content performance. If you're skeptical, you can just go to clickflow.com and try it for free for 14 days. And if it sucks, just cancel.

But I don't think you will. Back to the show. Cool. All right, let's move to the next topic here. So, Neil, let's just talk about your – every time you travel or I travel, we should talk about what we're doing.

So what are you doing in Jakarta right now? What are the lessons from this week? What are the conversations that are happening right now? Tell us to listen.

Sure. So a few things. um i left on sunday no monday yeah i think i left on monday left on monday for from london or la to london landed in london tuesday night uh spoke at south by southwest wednesday uh wednesday night i flew from london to jakarta i had to go through dubai so it was a

But Emirates is nice. And it was really cheap. Dude, how much do you think my round trip from London, going through Dubai to Jakarta first class and going first class from Jakarta to Dubai to Rio,

was in cost the dubai to rio jakarta to dubai i think is around eight hours dubai to rio is 15 so i got both those legs dubai rio uh i mean yeah jakarta to rio and london to jakarta right how much i'm gonna say the way you're saying it right now because it's a it's an emirates first class as well or you had pretty good first class i want to say seven thousand dollars close eight thousand dollars Yeah, that's a good deal.

Yeah, you're talking about normally a plane ticket that would have been 25, 30 grand. Exactly. So that's a good deal. It's a good deal. And sadly, I think it's because of war and not everyone wants to fly through some of these regions.

Nobody wants to go through Dubai right now. You crazy? Yeah. Yeah, and I think that's why it was so cheap for a first-class ticket. So why am I doing all this traveling?

London was South by Southwest. We tend to do it because of more branding for our European agencies. Indonesia, we have an APAC division, but we don't do tons of business in Indonesia.

The GDP per capita isn't too high. I'm not trying to talk trash. I'm just telling you the real reality. So we just don't see companies spending as much in marketing.

Yeah. And I haven't actually flown to Indonesia before, but my team's talked about buying an agency in Indonesia multiple times because they're like, oh, it's going to be the next big region in APAC. And agencies have been saying that for a long time. And I was like, you know what?

I have the opportunity to go. Let me just go. There's going to be 5,000 people at this conference. So I'll end up seeing what they're doing, seeing some of the companies.

I'll meet a lot of the sponsors. I'll get to know the lay of the land. Uh, and then from there, I'll head to real for web summit. Real for web summit is one of our better events of the year that we tend to speak at because when you look at most web summit events, they bring in massive crowds and they come from all parts of the world.

Um, The Portugal one's really good. The Canada one, it used to be called Collision. They changed it to Web Summit Vancouver. I used to prefer Collision Toronto.

It was still owned by them. It was bigger than Web Summit Vancouver, although they're probably working on building it up. Why are you going to Canton?

Cannes is more creative. We do creative stuff like we did stuff with Formula One, WNBA, Trojan condoms recently. The list goes on and on on the creative campaigns that we do. But just being very transparent in the agency world for anyone who has an agency or is looking to hire one,

There's not much money to be made on creative. It's not because of AI either. Even after AI and before AI, there still wasn't a lot of money to be made on creative. And the reason I say that is creative is in the eye of the beholder.

So if Eric hires NP Digital to do his creative, I can say we created something amazing. Eric has his own taste. He could say he dislikes it or likes it and wants another version or tweaks or whatever it may be. And because of that, because it's in the eye of the beholder, and when you work with large organizations that have tons of people who are meddling and getting involved in the creatives...

the margins just suck. And it's not just us. Most creative agencies don't have great margins, but you have to offer creative solutions to get the rest of the contract, which is why we acquired a creative agency years ago.

But the reason we're not at Cairns is it's a low margin, you know, side of the business for us. And most of the people who are at Cairns are going there to party and have fun. So you tend not to pick up a ton of business from what we've seen. Exactly.

So I was at an event last week and then a couple of entrepreneurs asked me, oh, you can't mix a lot of stuff. I'm like, no, no, it doesn't. I'm like, I'm not there. Like more power to you if you want to party.

I'm just not there to party. Like if I'm going to travel, I want to either it's for vacation. I'm there to like, you know, have good food or I'm there to do business and then meet with some people and then get out of there, which is what Neil does 99% of the time. Yeah.

Yeah, the flight attendants think I'm crazy because a lot of times, A, I think I fly more than most flight attendants. I'm pretty sure on that, the amount of hours that I clock. And B, I see a lot of the flight attendants like multiple times. Like even on my trip to Jakarta from London,

You know, the flight attendant said goodbye. And I was like, oh, I'll probably see you tomorrow. And they're like, you're leaving tomorrow? I was like, yeah.

Same with when I was in Hong Kong the other day. I left on a Monday afternoon. I think it was a United flight, like around 10, 11 a.m. Got there Tuesday sometime their time. Wednesday I spoke, did my meetings, and I flew right back.

And I was home Wednesday night because of the time change. And the flight attendant's like, you're on our flight again? But that's normal. And then I was home for a few days.

And then I was off on the road again. I'm surprised you don't get sick more because this stuff really screws with your immune system. Dude, you want to know the secret? It's changed everything in my immune system.

Vitamin D drops. I'm not trying to give health advice to anyone. But Jacob, you know Jacob who has the... Yeah, yeah, yeah. I talked to him earlier this week.

I'm getting some hookups on peptides. Shout out to Jacob and Abud. Abud just did the Andrew Huberman podcast. I'm getting some peptides, yeah. So Jacob ran some tests on me.

We've been paying him for many, many years. And he's just like, dude, you get sick a lot? And I was like, are you asking me a question? He's like, no, you get sick a lot.

And I'm like, how do you know? He's like, the vitamin, I think D level was really low in me. And he's just like, that's number one reason we know if people get sick a lot, especially when they're traveling. He's like, you need these vitamin D drops.

He doesn't sell them. He's like, just go on Amazon and buy them. Here's some few brands that you can pick from. I bought one and I've been using it for years.

And I take a lot of the drops, maybe more than I need to. Again, not medical advice here. And that stopped me from getting sick. I would probably say nine out of 10 times.

You got to be careful because I did the same. Like my vitamin D was really low, but you can also go too high on it too. Because you got to do your blood draws. But I will say to your point, Neal,

I was low on vitamin D maybe three, four years ago. I haven't really been sick for three, four years. So, you know, there's a trend there. Not health advice, guys, but it's just what worked for us.

Anyway, thank you all for listening. Hope you enjoyed it. Please don't forget to rate, subscribe, and we will see you tomorrow.