At Crunchify we use MaxCDN as our Content Delivery Network partner. MaxCDN is one of the best Content Delivery Network (CDN) provider so far I came across. Last week I noticed some weird search result which shows
cdn.crunchify.com in search result page (
SERP) and immediately it catches my attention because this may cause my SEO index go down.
In this tutorial will show quick tip on how to avoid this situation and fix it completely. If you have similar questions like this then you are at right place.
- How do I avoid creating duplicate content using a CDN
- CDNs and Duplicate Content
- Prevent CDN from caching webpages to avoid duplicate contents
- Duplicate content issues using CDN. How to fix?
- CDN using CNAME causing duplicate content
Other must read: Step by Step Guide to Setup MaxCDN
Let’s get started
Often times a blog is only hosting or caching resources like
video files on the content delivery network. How to fix this?
rel="canonical". Check this out.
Before enabling Canonical Header option setting under MaxCDN panel
After enabling Canonical Header option
This setting will tell
Bing the original version of the page and it
should take note of this
hint. However according this is only a hint and not 100% to be relied upon.
Robots.txt is a file that restricts access to your site by web crawlers, stopping pages from being indexed on search engine results. Add a
robots.txt file to your
CDN's root directory to disallow page crawl by search engines like Google. In the case of a CDN, assets are mirrored, so content is duplicated and then listed by crawlers on search engines, which is bad as pages rank lower.
User-agent: * Disallow: /
NOTE: do NOT put under your blog’s root directory