• majorAlexa

        See all notifications

        Skip to content
        Moz logo Menu open Menu close
        • Products
          • Moz Pro
          • Moz Pro Home
          • Moz Local
          • Moz Local Home
          • STAT
          • Moz API
          • Moz API Home
          • Compare SEO Products
          • Moz Data
        • Free SEO Tools
          • Domain Analysis
          • Keyword Explorer
          • Link Explorer
          • Competitive Research
          • MozBar
          • More Free SEO Tools
        • Learn SEO
          • Beginner's Guide to SEO
          • SEO Learning Center
          • Moz Academy
          • MozCon
          • Webinars, Whitepapers, & Guides
        • Blog
        • Why Moz
          • Digital Marketers
          • Agency Solutions
          • Enterprise Solutions
          • Small Business Solutions
          • The Moz Story
          • New Releases
        • Log in
        • Log out
        • Products
          • Moz Pro

            Your all-in-one suite of SEO essentials.

          • Moz Local

            Raise your local SEO visibility with complete local SEO management.

          • STAT

            SERP tracking and analytics for enterprise SEO experts.

          • Moz API

            Power your SEO with our index of over 44 trillion links.

          • Compare SEO Products

            See which Moz SEO solution best meets your business needs.

          • Moz Data

            Power your SEO strategy & AI models with custom data solutions.

          Let your business shine with Listings AI
          Moz Local

          Let your business shine with Listings AI

          Learn more
        • Free SEO Tools
          • Domain Analysis

            Get top competitive SEO metrics like DA, top pages and more.

          • Keyword Explorer

            Find traffic-driving keywords with our 1.25 billion+ keyword index.

          • Link Explorer

            Explore over 40 trillion links for powerful backlink data.

          • Competitive Research

            Uncover valuable insights on your organic search competitors.

          • MozBar

            See top SEO metrics for free as you browse the web.

          • More Free SEO Tools

            Explore all the free SEO tools Moz has to offer.

          NEW Keyword Suggestions by Topic
          Moz Pro

          NEW Keyword Suggestions by Topic

          Learn more
        • Learn SEO
          • Beginner's Guide to SEO

            The #1 most popular introduction to SEO, trusted by millions.

          • SEO Learning Center

            Broaden your knowledge with SEO resources for all skill levels.

          • On-Demand Webinars

            Learn modern SEO best practices from industry experts.

          • How-To Guides

            Step-by-step guides to search success from the authority on SEO.

          • Moz Academy

            Upskill and get certified with on-demand courses & certifications.

          • MozCon

            Save on Early Bird tickets and join us in London or New York City

          Unlock flexible pricing & new endpoints
          Moz API

          Unlock flexible pricing & new endpoints

          Find your plan
        • Blog
        • Why Moz
          • Digital Marketers

            Simplify SEO tasks to save time and grow your traffic.

          • Small Business Solutions

            Uncover insights to make smarter marketing decisions in less time.

          • Agency Solutions

            Earn & keep valuable clients with unparalleled data & insights.

          • Enterprise Solutions

            Gain a competitive edge in the ever-changing world of search.

          • The Moz Story

            Moz was the first & remains the most trusted SEO company.

          • New Releases

            Get the scoop on the latest and greatest from Moz.

          Surface actionable competitive intel
          New Feature

          Surface actionable competitive intel

          Learn More
        • Log in
          • Moz Pro
          • Moz Local
          • Moz Local Dashboard
          • Moz API
          • Moz API Dashboard
          • Moz Academy
        • Avatar
          • Moz Home
          • Notifications
          • Account & Billing
          • Manage Users
          • Community Profile
          • My Q&A
          • My Videos
          • Log Out

        The Moz Q&A Forum

        • Forum
        • Questions
        • My Q&A
        • Users
        • Ask the Community

        Welcome to the Q&A Forum

        Browse the forum for helpful insights and fresh discussions about all things SEO.

        1. Home
        2. SEO Tactics
        3. Intermediate & Advanced SEO
        4. Forwarded vanity domains, suddenly resolving to 404 with appended URL's ending in random 5 characters

        Moz Q&A is closed.

        After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

        Forwarded vanity domains, suddenly resolving to 404 with appended URL's ending in random 5 characters

        Intermediate & Advanced SEO
        2
        4
        1063
        Loading More Posts
        • Watching

          Notify me of new replies.
          Show question in unread.

        • Not Watching

          Do not notify me of new replies.
          Show question in unread if category is not ignored.

        • Ignoring

          Do not notify me of new replies.
          Do not show question in unread.

        • Oldest to Newest
        • Newest to Oldest
        • Most Votes
        Reply
        • Reply as question
        Locked
        This topic has been deleted. Only users with question management privileges can see it.
        • SS.Digital
          SS.Digital last edited by

          We have several vanity domains that forward to various pages on our primary domain.
          e.g. www.vanity.com (301)--> www.mydomain.com/sub-page (200)

          These forwards have been in place for months or even years and have worked fine.  As of yesterday, we have seen the following problem.  We have made no changes in the forwarding settings.

          Now, inconsistently, they sometimes resolve and sometimes they do not.  When we load the vanity URL with Chrome Dev Tools (Network Pane) open, it shows the following redirect chains, where xxxxx represents a random 5 character string of lower and upper case letters.  (e.g. VGuTD)

          EXAMPLE:
          www.vanity.com                                  (302, Found) -->
          www.vanity.com/xxxxx                        (302, Found) -->
          www.vanity.com/xxxxx                        (302, Found) -->
          www.vanity.com/xxxxx/xxxxx               (302, Found) -->
          www.mydomain.com/sub-page/xxxxx (404, Not Found)

          This is just one example, the amount of redirects, vary wildly.  Sometimes there is only 1 redirect, sometimes there are as many as 5.

          Sometimes the request will ultimately resolve on the correct mydomain.com/sub-page, but usually it does not (as in the example above).

          We have cross-checked across every browser, device, private/non-private, cookies cleared, on and off of our network etc...   This leads us to believe that it is not at the device or host level.

          Our Registrar is Godaddy.  They have not encountered this issue before, and have no idea what this 5 character string is from.  I tend to believe them because per our analytics, we have determined that this problem only started yesterday.

          Our primary question is, has anybody else encountered this problem either in the last couple days, or at any time in the past?  We have come up with a solution that works to alleviate the problem, but to implement it across hundreds of vanity domains will take us an inordinate amount of time.  Really hoping to fix the cause of the problem instead of just treating the symptom.

          1 Reply Last reply Reply Quote 0
          • SS.Digital
            SS.Digital @MikeTek last edited by

            Yes, we have contacted GoDaddy several times.

            GoDaddy has insisted it is not their problem and they do not have any advice to resolve this issue. GoDaddy support said there can be strange behavior when forward and masking. We tested removing the masking, but it did not make a difference. Nor does 301 vs. 302 redirecting. I understand the latter should not be used as a workaround as these responses have different meanings, but we did test (which also made no difference).

            Check this link for more details:

            https://www.godaddy.com/community/Managing-Domains/My-domain-name-not-resolving-correctly-6-random-characters-are/m-p/64440#M16148

            Others are experiencing the same issue and somewhere in the thread it was stated that GoDaddy recently rolled out a new system which likely created this issue. We can trace the issue beginning in late August 2017 via Google Analytics, Search Console 404s and testing via Chrome Dev Tools (Network pane with Preserve log checked).

            We would also like to understand why in order to address the root cause, instead of using a workaround. This is significant issue. Unfortunately, GoDaddy is not handling the issue professionally and will impact our future business decisions involving GoDaddy.

            1 Reply Last reply Reply Quote 0
            • MikeTek
              MikeTek last edited by

              That's a very strange behavior I have not seen before (and I've had plenty of experience with GoDaddy and their domain forwarding).

              The query workaround is interesting/clever - but I'd also be inclined to want to sort out why this is happening at all and stop it vs reworking all the domain forwards around this symptom.

              Have you contacted GoDaddy's shared hosting support? I'm not the biggest GoDaddy fan overall, but their tech support team can be quite helpful in tracking issues like this down.

              SS.Digital 1 Reply Last reply Reply Quote 0
              • SS.Digital
                SS.Digital last edited by

                It looks like this is a GoDaddy specific issue that many others are experiencing:

                https://www.godaddy.com/community/Managing-Domains/My-domain-name-not-resolving-correctly-6-random-characters-are/td-p/60782

                Although, at the time of this writing GoDaddy has not offered an explanation nor resolution. However, a workaround may be forwarding the domain with a query string appended, which in turn, appends the random six characters to the query string, instead of creating a url segment that the CMS interprets as a non-existent page and throws a 404.

                For example, consider:

                www.vanity.com -> www.primary.com?utm_source=forward

                The GoDaddy issue should then resolve with via:

                www.primary.com?utm_source=forwardxxxxxx

                Alternatively, the fowarding can be accomplished from the reverse angle, if you have access to the hosting account of the primary domain by adding a forwarded domain from something like cPanel or Plesk that points the primary domain name and then updating the GoDaddy A record to point to the primary domain's IP Address (and remove any GoDaddy forwarding).

                Or migrate from GoDaddy!

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post

                Browse Questions

                Explore more categories

                • Moz Tools

                  Chat with the community about the Moz tools.

                • SEO Tactics

                  Discuss the SEO process with fellow marketers

                • Community

                  Discuss industry events, jobs, and news!

                • Digital Marketing

                  Chat about tactics outside of SEO

                • Research & Trends

                  Dive into research and trends in the search industry.

                • Support

                  Connect on product support and feature requests.

                • See all categories

                Related Questions

                • rickyporco

                  After hack and remediation, thousands of URL's still appearing as 'Valid' in google search console. How to remedy?

                  I'm working on a site that was hacked in March 2019 and in the process, nearly 900,000 spam links were generated and indexed. After remediation of the hack in April 2019, the spammy URLs began dropping out of the index until last week, when Search Console showed around 8,000 as "Indexed, not submitted in sitemap" but listed as "Valid" in the coverage report and many of them are still hack-related URLs that are listed as being indexed in March 2019, despite the fact that clicking on them leads to a 404. As of this Saturday, the number jumped up to 18,000, but I have no way of finding out using the search console reports why the jump happened or what are the new URLs that were added, the only sort mechanism is last crawled and they don't show up there. How long can I expect it to take for these remaining urls to also be removed from the index? Is there any way to expedite the process? I've submitted a 'new' sitemap several times, which (so far) has not helped. Is there any way to see inside the new GSC view why/how the number of valid URLs in the indexed doubled over one weekend?

                  Intermediate & Advanced SEO | | rickyporco
                  0
                • 94501

                  How can I get a list of every url of a site in Google's index?

                  I work on a site that has almost 20,000 urls in its site map. Google WMT claims 28,000 indexed and a search on Google shows 33,000. I'd like to find what the difference is. Is there a way to get an excel sheet with every url Google has indexed for a site? Thanks... Mike

                  Intermediate & Advanced SEO | | 94501
                  0
                • webbmason

                  Domain Forwarding - SEO Impacts?

                  I have a site that has been active for years - thinkbiglearnsmart.com. Awhile ago I had purchased about 50 domain names that were relevant to my company. I still have those urls and would like to use them to point to different pages on my site - just because they have good key words in the URLs. For example - one is dreamweavertrainingclassesonlinelive.com.  Currently they are all redirecting to my homepage. A. is that hurting me? B. I would like to redirect to the more relevant page. ie the page dedicated to Dreamweaver training (http://thinkbiglearnsmart.com/dreamweaver-creative-cloud-training-course/ ) Will this hurt my Dreamweaver keyword for example because there is already a 301 redirect on that page from a very old Dreamweaver link which was something like thinkbiglearnsmart.com/dreamweaver C. On my hosting account where I can select where the URL forwards to - it has an option for "Location forwarding" and "Frame forwarding" - currently they are set to Frame forwarding - which one is best? Any help is much appreciated!!! Thank you!

                  Intermediate & Advanced SEO | | webbmason
                  0
                • mark_baird

                  Do Q&A 's work for SEO

                  If I create a good community in my particular field on my SEO site and have a quality Q&A section like this etc (ripping of MOZ's idea here sorry, I hope it's ok) will the long term returns be worth the effort of creating and man ageing this. Is the user created content of as much use as I think it will be?

                  Intermediate & Advanced SEO | | mark_baird
                  0
                • esiow2013

                  May know what's the meaning of these parameters in .htaccess?

                  Begin HackRepair.com Blacklist RewriteEngine on Abuse Agent Blocking RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Bolt\ 0 [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:[email protected] [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} CazoodleBot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Custo [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Default\ Browser\ 0 [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^DIIbot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^DISCo [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} discobot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^eCatch [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ecxi [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^EmailCollector [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^FlashGet [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^GetRight [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^GrabNet [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Grafula [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} GT::WWW [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} heritrix [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^HMView [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} HTTP::Lite [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ia_archiver [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} IDBot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} id-search [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} id-search.org [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^InterGET [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^InternetSeer.com [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} IRLbot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ISC\ Systems\ iRc\ Search\ 2.1 [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Java [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^JetCar [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^larbin [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} libwww [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} libwww-perl [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Link [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} LinksManager.com_bot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} linkwalker [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} lwp-trivial [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Maxthon$ [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} MFC_Tear_Sample [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^microsoft.url [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} Microsoft\ URL\ Control [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} Missigua\ Locator [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Mozilla.*Indy [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Mozilla.NEWT [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^MSFrontPage [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Navroad [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^NearSite [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^NetAnts [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^NetSpider [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^NetZIP [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Nutch [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Octopus [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} panscient.com [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^pavuk [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} PECL::HTTP [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^PeoplePal [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} PHPCrawl [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} PleaseCrawl [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^psbot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^RealDownload [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^ReGet [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Rippers\ 0 [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} SBIder [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^SeaMonkey$ [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^sitecheck.internetseer.com [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} Snoopy [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} Steeler [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^SuperBot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Surfbot [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Toata\ dragostea\ mea\ pentru\ diavola [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} URI::Fetch [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} urllib [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} User-Agent [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} Web\ Sucker [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} webalta [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebAuto [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^[Ww]eb[Bb]andit [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} WebCollage [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebCopier [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebFetch [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebReaper [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebSauger [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebStripper [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WebZIP [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} Wells\ Search\ II [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} WEP\ Search [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Wget [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Widow [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WWW-Mechanize [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} zermelo [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^Zeus [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ^(.)Zeus.Webster [NC,OR]
                  RewriteCond %{HTTP_USER_AGENT} ZyBorg [NC]
                  RewriteRule ^. - [F,L] Abuse bot blocking rule end End HackRepair.com Blacklist

                  Intermediate & Advanced SEO | | esiow2013
                  1
                • PottyScotty

                  Creating 100,000's of pages, good or bad idea

                  Hi Folks, Over the last 10 months we have focused on quality pages but have been frustrated with competition websites out ranking us because they have bigger sites.  Should we focus on the long tail again? One option for us is to take every town across the UK and create pages using our activities.  e.g. Stirling
                  Stirling paintball
                  Stirling Go Karting
                  Stirling Clay shooting We are not going to link to these pages directly from our main menus but from the site map. These pages would then show activities that were in a 50 mile radius of the towns.  At the moment we have have focused our efforts on Regions, e.g. Paintball Scotland, Paintball Yorkshire focusing all the internal link juice to these regional pages, but we don't rank high for towns that the activity sites are close to. With 45,000 towns and 250 activities we could create over a million pages which seems very excessive!  Would creating 500,000 of these types of pages damage our site? This is my main worry, or would it make our site rank even higher for the tougher keywords and also get lots of traffic from the long tail like we used to get. Is there a limit to how big a site should be? edit

                  Intermediate & Advanced SEO | | PottyScotty
                  0
                • Omnipress

                  Do I need to use canonicals if I will be using 301's?

                  I just took a job about three months and one of the first things I wanted to do was restructure the site. The current structure is solution based but I am moving it toward a product focus. The problem I'm having is the CMS I'm using isn't the greatest (and yes I've brought this up to my CMS provider). It creates multiple URL's for the same page. For example, these two urls are the same page: (note: these aren't the actual urls, I just made them up for demonstration purposes) http://www.website.com/home/meet-us/team-leaders/boss-man/
                  http://www.website.com/home/meet-us/team-leaders/boss-man/bossman.cmsx (I know this is terrible, and once our contract is up we'll be looking at a different provider) So clearly I need to set up canonical tags for the last two pages that look like this: http://www.omnipress.com/boss-man" /> With the new site restructure, do I need to put a canonical tag on the second page to tell the search engine that it's the same as the first, since I'll be changing the category it's in? For Example: http://www.website.com/home/meet-us/team-leaders/boss-man/ will become http://www.website.com/home/MEET-OUR-TEAM/team-leaders/boss-man My overall question is, do I need to spend the time to run through our entire site and do canonical tags AND 301 redirects to the new page, or can I just simply redirect both of them to the new page? I hope this makes sense. Your help is greatly appreciated!!

                  Intermediate & Advanced SEO | | Omnipress
                  0
                • nicole.healthline

                  Soft 404's from pages blocked by robots.txt -- cause for concern?

                  We're seeing soft 404 errors appear in our google webmaster tools section on pages that are blocked by robots.txt (our search result pages). Should we be concerned? Is there anything we can do about this?

                  Intermediate & Advanced SEO | | nicole.healthline
                  4

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy

                Looks like your connection to Moz was lost, please wait while we try to reconnect.