Flying Spares, provider of spare parts for vintage cars and high quality marques, displaying a Rolls-Royce from their eCommerce Shopify development from magic42

Flying Spares

International B2B Magento with 240k catalogue, Khaos Control Integration and digital marketing.
See our work
Stone Computers Case Study by magic42

Stone Computers

Adobe Magento Commerce B2C, B2B portal and PunchOut sites and bespoke loan payment solution.
See our work
Alan Paine quality clothing retailer showing their brand, as featured in their case study for their eCommerce website with magic42

Alan Paine

Multisite, B2C migration from Magento to Shopify Plus with ERP integration.
See our work
Haws Watering Cans case study after eCommerce development agency, magic42, migrated their site to Shopify

Haws Watering Cans

B2C eCommerce strategy, UX improvements, AdWords and Klaviyo email marketing management.
See our work
Alan Paine quality clothing retailer showing their brand, as featured in their case study for their eCommerce website with magic42

Alan Paine

Multi-site, B2C migration from Magento to Shopify Plus with ERP integration.
Find out more
Roger Clark Motorsport automative eCommerce client case study from magic42, showing high quality silver cars in a slick garage

Roger Clark Motorsport

B2C and B2B migration of bespoke, global automotive parts website to Shopify.
Find out more

Call Us

Speak to a Shopify expert:

0121 663 6360

Get in touch 
magic42 - eCommerce development experts born from retail success

Born from a retailer

Read the full story of how our award-winning retail business developed into magic42.
Find out more
Envision Workshop documents as an outcome from our replatforming and migration meeting for your eCommerce website

How we'll work with you

Find out what it's like to partner with us and the steps involved for your eCommerce project.
Find out more
Alex Ashman, director of magic42, in a bumper car with a huge grin on his face as he mingles with his eCommerce development team at magic42

Looking to join us?

Take a look at what it's like to work at magic42 and the opportunities we offer.
Find out more

Call Us

Speak to our eCommerce experts:

0121 663 6360

Get in touch 

MaxMind’s GeoIP labels Googlebot as Russian

Author: 
Alex Ashman
Published: 
November 13, 2023
MaxMins GeoIP Googlebot Blog Image

MaxMind, which provides GeoIP info for global solution providers, is incorrectly identifying Googlebot. Websites worldwide depend on this data to restrict access from unwanted regions, such as Russia and Iran (in light of global political situations), meaning sites are unintentionally hampering their search engine presence.

MaxMind's GeoIP, GeoIP2, showing Google LLC (Googlebot) as coming from Iran and Russia.

What is MaxMind and how is it causing the issue?

MaxMind integrates with business websites to provide the IP locations of site visitors, alongside additional layers of security. 

MaxMind’s GeoIP database is used by Cloudflare and other content delivery networks and security services. Cloudflare is used by 7.59 million active websites, with 122,313 from the UK alone, making it an incredibly popular security tool. When you consider the enormity of those numbers, and that many businesses around the world block Russia in Cloudflare, it becomes increasingly apparent that many will be affected by MaxMind’s GeoIP problem.

Here’s an example of Cloudflare’s documentation outlining their use of MaxMind:

Documentation confirming Cloudflare's use of MaxMind's GeoIP database.

Google sends Googlebot to crawl websites and update its indexes. After crawling pages, websites can be found and matched to relevant Google search queries. 

MaxMind provides invaluable mapping information about visitors, including these regular Google crawlers, identifying their IP addresses to help you understand where they are visiting from.

However, MaxMind is registering these Googlebot IP addresses as from Russia and Iran. This is problematic, as recent hostile activity has resulted in governments across the world, including the UK and US, issuing sanctions against Russia. Many businesses have also therefore chosen to block traffic from these countries, simply done in a tool like Cloudflare.

So, by MaxMind’s GeoIP incorrectly recognising Google’s crawlers from Russia, your site could be actively and negatively impacted in Google search results.

Evidence that MaxMind labels Googlebot incorrectly

For one of our eCommerce clients at magic42, Google Search Console alerted us that it was being blocked from crawling both mobile and desktop versions of the website. This provided IP addresses for which Googlebots were being blocked.

MaxMind GeoIP2 matching the blocked IP addresses (including Googlebot's) to Russia and Iran locations.

Curious over the alert, we investigated the problem by looking at our integrated version of MaxMind’s GeoIP, GeoLite2. When inputting the IP addresses from Google Search Console, MaxMind revealed they were from Russia, Iran and further afield. Upon further investigation, it was clear that those IP addresses were actually Google’s crawlers, identifiable from their IPs. This meant that MaxMind’s GeoIP database had identified them incorrectly and therefore could be restricting access, in turn impacting search rankings.

A full list of Googlebot IPs, some being incorrectly identified as Iran.

How to fix MaxMind’s GeoIP

It is vital that MaxMind’s GeoIP shows the correct country of origin for Google’s crawlers, otherwise this will continue to hamper search engine performance.

At the moment, the best way to correct the IP issue is to inform MaxMind. You can do this and make sure MaxMind shows the correct Country Code if you submit a correction request. Alternatively, you can send a request to correct a GeoIP location in MaxMind.

You can also contact Cloudflare support when MaxMind is showing the correct country code, but not the CF-IPCountry request header.

Fingers crossed this can be resolved in the near future to increase site visibility.

magic42 is a UK-based eCommerce development agency, born from an award-winning retailer. Having grown with the industry since the year 2000, we provide our unique perspective to help clients get the best from their eCommerce platforms.
Company No. 11572347 VAT No. 310 2436 61
Shopify Partners Logo (as used by Shopify Development Partners)
© Copyright 2024 magic42 Limited - All Rights Reserved
linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram