• seohunters9

        See all notifications

        Skip to content
        Moz logo Menu open Menu close
        • Products
          • Moz Pro
          • Moz Pro Home
          • Moz Local
          • Moz Local Home
          • STAT
          • Moz API
          • Moz API Home
          • Compare SEO Products
          • Moz Data
        • Free SEO Tools
          • Domain Analysis
          • Keyword Explorer
          • Link Explorer
          • Competitive Research
          • MozBar
          • More Free SEO Tools
        • Learn SEO
          • Beginner's Guide to SEO
          • SEO Learning Center
          • Moz Academy
          • MozCon
          • Webinars, Whitepapers, & Guides
        • Blog
        • Why Moz
          • Digital Marketers
          • Agency Solutions
          • Enterprise Solutions
          • Small Business Solutions
          • The Moz Story
          • New Releases
        • Log in
        • Log out
        • Products
          • Moz Pro

            Your all-in-one suite of SEO essentials.

          • Moz Local

            Raise your local SEO visibility with complete local SEO management.

          • STAT

            SERP tracking and analytics for enterprise SEO experts.

          • Moz API

            Power your SEO with our index of over 44 trillion links.

          • Compare SEO Products

            See which Moz SEO solution best meets your business needs.

          • Moz Data

            Power your SEO strategy & AI models with custom data solutions.

          Let your business shine with Listings AI
          Moz Local

          Let your business shine with Listings AI

          Learn more
        • Free SEO Tools
          • Domain Analysis

            Get top competitive SEO metrics like DA, top pages and more.

          • Keyword Explorer

            Find traffic-driving keywords with our 1.25 billion+ keyword index.

          • Link Explorer

            Explore over 40 trillion links for powerful backlink data.

          • Competitive Research

            Uncover valuable insights on your organic search competitors.

          • MozBar

            See top SEO metrics for free as you browse the web.

          • More Free SEO Tools

            Explore all the free SEO tools Moz has to offer.

          NEW Keyword Suggestions by Topic
          Moz Pro

          NEW Keyword Suggestions by Topic

          Learn more
        • Learn SEO
          • Beginner's Guide to SEO

            The #1 most popular introduction to SEO, trusted by millions.

          • SEO Learning Center

            Broaden your knowledge with SEO resources for all skill levels.

          • On-Demand Webinars

            Learn modern SEO best practices from industry experts.

          • How-To Guides

            Step-by-step guides to search success from the authority on SEO.

          • Moz Academy

            Upskill and get certified with on-demand courses & certifications.

          • MozCon

            Save on Early Bird tickets and join us in London or New York City

          Unlock flexible pricing & new endpoints
          Moz API

          Unlock flexible pricing & new endpoints

          Find your plan
        • Blog
        • Why Moz
          • Digital Marketers

            Simplify SEO tasks to save time and grow your traffic.

          • Small Business Solutions

            Uncover insights to make smarter marketing decisions in less time.

          • Agency Solutions

            Earn & keep valuable clients with unparalleled data & insights.

          • Enterprise Solutions

            Gain a competitive edge in the ever-changing world of search.

          • The Moz Story

            Moz was the first & remains the most trusted SEO company.

          • New Releases

            Get the scoop on the latest and greatest from Moz.

          Surface actionable competitive intel
          New Feature

          Surface actionable competitive intel

          Learn More
        • Log in
          • Moz Pro
          • Moz Local
          • Moz Local Dashboard
          • Moz API
          • Moz API Dashboard
          • Moz Academy
        • Avatar
          • Moz Home
          • Notifications
          • Account & Billing
          • Manage Users
          • Community Profile
          • My Q&A
          • My Videos
          • Log Out

        The Moz Q&A Forum

        • Forum
        • Questions
        • My Q&A
        • Users
        • Ask the Community

        Welcome to the Q&A Forum

        Browse the forum for helpful insights and fresh discussions about all things SEO.

        1. Home
        2. SEO Tactics
        3. Intermediate & Advanced SEO
        4. Generating 404 Errors but the Pages Exist

        Moz Q&A is closed.

        After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

        Generating 404 Errors but the Pages Exist

        Intermediate & Advanced SEO
        6
        15
        9860
        Loading More Posts
        • Watching

          Notify me of new replies.
          Show question in unread.

        • Not Watching

          Do not notify me of new replies.
          Show question in unread if category is not ignored.

        • Ignoring

          Do not notify me of new replies.
          Do not show question in unread.

        • Oldest to Newest
        • Newest to Oldest
        • Most Votes
        Reply
        • Reply as question
        Locked
        This topic has been deleted. Only users with question management privileges can see it.
        • Found
          Found last edited by

          Hey

          I have recently come across an issue with several of a sites urls being seen as a 404 by bots such as Xenu, SEOMoz, Google Web Tools etc. The funny thing is, the pages exist and display fine.

          This happens on many of the pages which use the Modx CMS, but the index is fine. The wordpress blog in /blog/ all works fine.

          The only thing I can think of is that I have a conflict in the htaccess, but troubleshooting this is difficult, any tool I have found online seem useless.

          Have tried to rollback to previous versions but still does not work.

          Anyone had any experience of similar issues?

          Many thanks

          K.

          1 Reply Last reply Reply Quote 0
          • OptimaD
            OptimaD @RyanKent last edited by

            FYI, we finally found our error. The short URL turned out to be the same name as the folder (photo-gallery) so once this was changed, wordpress was able to access the correct path. A bit of custom javascript had to be amended as well, but that was limited to our custom code. Using your web-sniffer.net link we were able to test immediately and fix it fairly quickly. Thank you for your help!

            1 Reply Last reply Reply Quote 1
            • seo-wanna-bs
              seo-wanna-bs @RyanKent last edited by

              That's true Ryan I guess it is coding related really.

              Issues like this are a real pain in the ass. And most people don't even check WMT to realise the issues exist. TBH, I don't check as often as I should.

              1 Reply Last reply Reply Quote 1
              • RyanKent
                RyanKent @seo-wanna-bs last edited by

                I agree with you Paul.

                As you pointed out one possible cause is a CMS-related issue which I would refer to as "coding" meaning something in the code which was used to present the website. Perhaps there is a better way to phrase it but nothing comes to mind at the moment.

                Another possibility you mentioned is Litespeed which would be a server-side issue directly. Either way, it is a legitimate issue which should be addressed.

                seo-wanna-bs 1 Reply Last reply Reply Quote 0
                • seo-wanna-bs
                  seo-wanna-bs last edited by

                  FWIW, I don't think it's a coding issue. If it were coding, it would either show a 200OK or it would show a 404. It wouldn't sometimes serve a 404.

                  If you're using Litespeed, I'd guarantee that is the issue and if you're using Joomla, it's another prime culprit.

                  RyanKent 1 Reply Last reply Reply Quote 0
                  • seo-wanna-bs
                    seo-wanna-bs last edited by

                    Please keep in mind, that 404 error does not mean the page doesn't exist. It means your server, is sending a response code to indicate that it doesn't exist.

                    When I installed Litespeed on my server, this issue happened over and over again.

                    I believe Joomla for example, has some kind of security module that serves a 404 if a single IP requests a page too many times. I remember running SEOFrog on a friends Joomla site and tons of 404's were showing up.

                    1 Reply Last reply Reply Quote 0
                    • Found
                      Found @RyanKent last edited by

                      Dev team are looking into it, must be quite a complex htaccess issue. Will get to the bottom of it this week and post any findings.

                      1 Reply Last reply Reply Quote 0
                      • OptimaD
                        OptimaD @RyanKent last edited by

                        Thanks Ryan! I will get it looked at...Sue

                        1 Reply Last reply Reply Quote 0
                        • RyanKent
                          RyanKent @OptimaD last edited by

                          @DentalID, the same reply I offered to Guy applies for you as well. This is an SEO issue which does need to be fixed. Something on your end is causing the page to show with a 403 response code. You really need a programmer to get in there and determine the root cause of the issue. You could try asking your web host if you have managed hosting, but this level of assistance would normally be outside the support of managed hosting.

                          OptimaD Found 3 Replies Last reply Reply Quote 0
                          • RyanKent
                            RyanKent last edited by

                            Guy,

                            In looking at the page this appears to be a legitimate problem. Your server settings allow you to present a page with any header code you wish. You can 301 a page but still present the page with a 200 code if you want. Presently it appears the page is being presented fine but your server is offering a 404 header code.

                            I can't tell the actual source of the problem other then to say it appears to be on your end and should be fixed. I originally looked at the code with the MOZbar but then checked independently with another tool as well. http://web-sniffer.net/

                            All tools show a 404 header code for the page. This response code is generated by your web server.

                            1 Reply Last reply Reply Quote 2
                            • OptimaD
                              OptimaD last edited by

                              We are having a similar problem with this URL:  http://dentalimplantsportland.com/photo-gallery/  and also the following locations:

                              http://cosmeticdentistportland.net/photo-gallery/

                              http://dentalveneersportland.com/photo-gallery/

                              SEO Moz  and Google webmaster tools show it as a 403 error but the pages display fine. I am not able to tell if this is really a problem for SEO or if we should reconstruct this gallery system and would really love your input.

                              This is Wordpress with a Spry gallery...

                              Thanks so much!

                              RyanKent 1 Reply Last reply Reply Quote 0
                              • Found
                                Found @RyanKent last edited by

                                It is just a small affiliate site I am looking at - this page creates a 404.

                                http://www.insure-uk.com/post-office-car-insurance.html

                                Currently testing on some beta servers. Hopefully should fix soon as otherwise it will lose indexation.

                                1 Reply Last reply Reply Quote 0
                                • AlanMosley
                                  AlanMosley last edited by

                                  I also see this now and again, but next crawl they fix themselfs. i assume robots can not always reach page for a number of reasons

                                  1 Reply Last reply Reply Quote 0
                                  • RyanKent
                                    RyanKent last edited by

                                    Can you offer an example of a URL which is causing this problem?

                                    Found 1 Reply Last reply Reply Quote 0
                                    • Netboost
                                      Netboost last edited by

                                      I have had the same issues, I think it is often the bot's problem

                                      Just to be certain check your links are correct and manually test them. Also ensure your sitemap is up to date and that you are not blocking the crawlers with metarobots, robots.txt, or some weird stuff in htaccess.

                                      I have found that renaming pages or moving them will often cause 404 issues with crawlers

                                      1 Reply Last reply Reply Quote 0
                                      • 1 / 1
                                      • First post
                                        Last post

                                      Browse Questions

                                      Explore more categories

                                      • Moz Tools

                                        Chat with the community about the Moz tools.

                                      • SEO Tactics

                                        Discuss the SEO process with fellow marketers

                                      • Community

                                        Discuss industry events, jobs, and news!

                                      • Digital Marketing

                                        Chat about tactics outside of SEO

                                      • Research & Trends

                                        Dive into research and trends in the search industry.

                                      • Support

                                        Connect on product support and feature requests.

                                      • See all categories

                                      Related Questions

                                      • Online-Marketing-Guy

                                        Substantial difference between Number of Indexed Pages and Sitemap Pages

                                        Hey there, I am doing a website audit at the moment. I've notices substantial differences in the number of pages indexed (search console), the number of pages in the sitemap and the number I am getting when I crawl the page with screamingfrog (see below). Would those discrepancies concern you? The website and its rankings seems fine otherwise. Total indexed: 2,360 (Search Consule)
                                        About 2,920 results (Google search "site:example.com")
                                        Sitemap: 1,229 URLs
                                        Screemingfrog Spider: 1,352 URLs Cheers,
                                        Jochen

                                        Intermediate & Advanced SEO | | Online-Marketing-Guy
                                        0
                                      • monicapopa

                                        Not found errors (404) due to being hacked

                                        Hi Moz Guru's Our website was hacked a few months ago, since then we have taken various measures, last one being redesigning the website all together and removing it from a WordPress platform. So far all is going well, except that the 404 not found errors keeps coming up in Google Webmaster tools. The URLs are spam pages that were created by the virus. And these spam pages have been indexed by Google, and now we are struggling to get rid of them. Is there any way we can deal with these 404 spam pages links? Is marking all of them as fixed in the webmaster tools - search console- crawl errors helpful in any way? Can this have a negative impact on the SEO ? Looking forward to your answers. Many thanks.

                                        Intermediate & Advanced SEO | | monicapopa
                                        0
                                      • TjeerdvZ

                                        Hreflang and paginated page

                                        Hi, I can not seem to find good documentation about the use of hreflang and paginated page when using rel=next , rel=prev
                                        Does any know where to find decent documentatio?, I could only find documentation about pagination and hreflang when using canonicals on the paginated page. I have doubts on what is the best option: The way tripadvisor does it:
                                        http://www.tripadvisor.nl/Hotels-g187139-oa390-Corsica-Hotels.html
                                        Each paginated page is referring to it's hreflang paginated page, for example: So should the hreflang refer to the pagined specific page or should it refer to the "1st" page? in this case:
                                        http://www.tripadvisor.nl/Hotels-g187139-Corsica-Hotels.html Looking foward to your suggestions.

                                        Intermediate & Advanced SEO | | TjeerdvZ
                                        0
                                      • Chammy

                                        Is a 404, then a meta refresh 301 to the home page OK for SEO?

                                        Hi Mozzers I have a client that had a lot of soft 404s that we wanted to tidy up. Basically everything was going to the homepage. I recommended they implement proper 404s with a custom 404 page, and 301 any that really should be redirected to another page. What they have actually done is implemented a 404 (without the custom 404 page) and then after a short delay 301 redirected to the homepage. I understand why they want to do this as they don't want to lose the traffic, but is this a problem with SEO and the index? Or will Google treat as a hard 404 anyway? Many thanks

                                        Intermediate & Advanced SEO | | Chammy
                                        0
                                      • lcourse

                                        Is it a problem to use a 301 redirect to a 404 error page, instead of serving directly a 404 page?

                                        We are building URLs dynamically with apache rewrite.
                                        When we detect that an URL is matching some valid patterns, we serve a script which then may detect that the combination of parameters in the URL does not exist. If this happens we produce a 301 redirect to another URL which serves a 404 error page, So my doubt is the following: Do I have to worry about not serving directly an 404, but redirecting (301) to a 404 page? Will this lead to the erroneous original URL staying longer in the google index than if I would serve directly a 404? Some context. It is a site with about 200.000 web pages and we have currently 90.000 404 errors reported in webmaster tools (even though only 600 detected last month).

                                        Intermediate & Advanced SEO | | lcourse
                                        0
                                      • AshShep1

                                        Should my back links go to home page or internal pages

                                        Right now we rank on page 2 for many KWs, so should i now focus my attention on getting links to my home page to build domain authority or continue to direct links to the internal pages for specific KWs? I am about to write some articles for several good ranking sites and want to know whether to link my company name (same as domain name) or KW to the home page or use individual KWs to the internal pages - I am only allowed one link per article to my site. Thanks Ash

                                        Intermediate & Advanced SEO | | AshShep1
                                        0
                                      • PottyScotty

                                        Does an H1 have to be at the top of a page?

                                        Because H1 "may" carry some  weight with Google does it have to be placed at the top of the page?  Can I place it towards the bottom of the page instead in normal body size?  My goal is to keep the main keywords in the H1 but create a much friendlier title for the customer to read at the top of the page.

                                        Intermediate & Advanced SEO | | PottyScotty
                                        0
                                      • Grenadi

                                        301 - should I redirect entire domain or page for page?

                                        Hi, We recently enabled a 301 on our domain from our old website to our new website. On the advice of fellow mozzer's we copied the old site exactly to the new domain, then did the 301 so that the sites are identical. Question is, should we be doing the 301 as a whole domain redirect, i.e. www.oldsite.com is now > www.newsite.com, or individually setting each page, i.e. www.oldsite.com/page1 is now www.newsite.com/page1 etc for each page in our site? Remembering that both old and new sites (for now) are identical copies. Also we set the 301 about 5 days ago and have verified its working but haven't seen a single change in rank either from the old site or new - is this because Google hasn't likely re-indexed yet? Thanks, Anthony

                                        Intermediate & Advanced SEO | | Grenadi
                                        0

                                      Get started with Moz Pro!

                                      Unlock the power of advanced SEO tools and data-driven insights.

                                      Start my free trial
                                      Products
                                      • Moz Pro
                                      • Moz Local
                                      • Moz API
                                      • Moz Data
                                      • STAT
                                      • Product Updates
                                      Moz Solutions
                                      • SMB Solutions
                                      • Agency Solutions
                                      • Enterprise Solutions
                                      • Digital Marketers
                                      Free SEO Tools
                                      • Domain Authority Checker
                                      • Link Explorer
                                      • Keyword Explorer
                                      • Competitive Research
                                      • Brand Authority Checker
                                      • Local Citation Checker
                                      • MozBar Extension
                                      • MozCast
                                      Resources
                                      • Blog
                                      • SEO Learning Center
                                      • Help Hub
                                      • Beginner's Guide to SEO
                                      • How-to Guides
                                      • Moz Academy
                                      • API Docs
                                      About Moz
                                      • About
                                      • Team
                                      • Careers
                                      • Contact
                                      Why Moz
                                      • Case Studies
                                      • Testimonials
                                      Get Involved
                                      • Become an Affiliate
                                      • MozCon
                                      • Webinars
                                      • Practical Marketer Series
                                      • MozPod
                                      Connect with us

                                      Contact the Help team

                                      Join our newsletter
                                      Moz logo
                                      © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                      • Accessibility
                                      • Terms of Use
                                      • Privacy

                                      Looks like your connection to Moz was lost, please wait while we try to reconnect.