Last month Elias and his team implemented Omega Indexer into the SEO Autopilot platform.
The tricky topic of getting links crawled and indexed is one that has perplexed SEO link builders for a few years now.
Before we investigate that, let’s get some terms straight, so we all know what we are talking about.
Omega is an indexer. Its goal is to get your links indexed. That means the URL the link is on is worthy of a space somewhere in Google’s database. Either as a reference, or with the link the page is on having its own listing under one or more search terms.
This is not the same has making sure a link is crawled. Ensuring a link is crawled is a much simpler task. All crawling entails is a Google bot noticing the link and the URL that it is on. Crawling does not mean the link is indexed or listed. Just “seen”.
SEO Autopilot can create the links Omega Indexer can get them crawled. But that still might not get them indexed.
Read on to find out the secret sauce to get 99% of your links indexed quickly.
Ok, with that out of the way. What has been the problem and why have SEO Autopilot users been so vexed about the issue over the last year?
Crawling, Indexing and Search Engine Resources
It’s helpful here to see things from Google’s perspective and then ask “What criteria does Google use to decide whether to index a page or not?”
Google’s database of indexed sites and URL’s – and content within those URL’s grew exponentially for almost 20 years between 2000 and 2015.
- 17 million sites with 413 million pages in 2000
- 836 million sites with 3.1 billion pages in 2015
- In the 5 years between 2015 and 2020 – that number has more than doubled again. 1.7 billion websites and almost 6 billion URLs
Along with these astonishing numbers its worth noting what Google’s position is in this.
What the core aims of the search engines giant is.
That’s… to make money
Google doesn’t want to index everything. It was never set up to be an encyclopaedia of the entire web. That isn’t its purpose and isn’t what it sets out to do. It wouldn’t be cost effective and would add no value.
So, as the years have gone by Google has got more and more selective about what it adds to its search engine listings and what it even indexes.
It has developed ever more sophisticated algorithms to filter out new content, new links, new websites and new URL’s. It decides whether it is worth inclusion and is increasingly selective on what it decides to include.
Why would it want a page of over spun content that is roughly the same as millions of other pages in its index? What would it add?
In short this means – getting the URL with your new link crawled is easier than ever
Getting it indexed is getting harder by the year.
Enter Omega Indexer and SEO Autopilot
There are three main elements in getting a link indexed properly.
SEO Autopilot provides the first essential element. It creates the links. Either on existing URL’s or, often, creating new URL’s. It does this very well. Best in class.
Omega Indexer is one of the best tools around for getting that new link noticed. It has brute force and finesse combined. Send as many indexing prompts as you like, but drip feed them as slowly as you want. As the user you have a lot of control.
In practice Omega Indexer will get links crawled more often than any other tool we have used. It will get links indexed that other tools struggle with simply and consistently using its great mix of power and control.
But it isn’t perfect.
If Google really doesn’t see value in your URL or back-link, even as a pure none listed index – then there is nothing any indexing tool can do to force them to.
But there is a third element.
The Secret Sauce of Link Indexing
Content
There – that’s it.
Ok. That’s a bit unfair. Let’s look at what I mean. Look through the eyes of Google as they send a crawler to your newly created page and links.
What does it see?
What are the key factors it considers when deciding whether to index that page?
Sure – being prompted to crawl it regularly is important.
But the deciding factor is the content on that page.
Is there any shred of value in indexing it?
Could Google ever envisage making money from that or is it just a waste of server space?
Does it reinforce a message, iterate an important topic? Does it say something new and unique? Is it decently written? What’s the language use like? Does it even seem to make sense?
Side note. SEO Autopilot handles content very well. Take a look at the power of content on high authority sites right here. and our total SEO content guide for your own site here.
Now Google isn’t expecting Shakespeare here. Nothing like it. It sets the standards low. But the standards are not set to zero.
Remember we are talking about the content that surrounds your inbound links here. Not the content on your own website.
That’s the important value to take away here.
Google’s content standards that it uses to decide whether to index a page are not set to zero.
They are low, but not zero.
The Fix is Easy!
So make sure your content, the content that surrounds your links is above that bar. It isn’t hard to do. In fact we’ve got you covered using these resources below.
- We have a full guide to creating solid links here
- How a little bit of entity salience goes a long way in content
We have begun a test of Omega, but we like to give it 8 weeks, and preferably 12 weeks to get a full set of results out in one go. 12 weeks for a commercial site is a good yardstick. The test is currently 7 weeks in the making at the time of this post, so expect the results in 5- or 6-weeks time.
We will show how Omega Indexer and SEO Autopilot team up and compare against the alternatives.