• majorAlexa

        See all notifications

        Skip to content
        Moz logo Menu open Menu close
        • Products
          • Moz Pro
          • Moz Pro Home
          • Moz Local
          • Moz Local Home
          • STAT
          • Moz API
          • Moz API Home
          • Compare SEO Products
          • Moz Data
        • Free SEO Tools
          • Domain Analysis
          • Keyword Explorer
          • Link Explorer
          • Competitive Research
          • MozBar
          • More Free SEO Tools
        • Learn SEO
          • Beginner's Guide to SEO
          • SEO Learning Center
          • Moz Academy
          • MozCon
          • Webinars, Whitepapers, & Guides
        • Blog
        • Why Moz
          • Digital Marketers
          • Agency Solutions
          • Enterprise Solutions
          • Small Business Solutions
          • The Moz Story
          • New Releases
        • Log in
        • Log out
        • Products
          • Moz Pro

            Your all-in-one suite of SEO essentials.

          • Moz Local

            Raise your local SEO visibility with complete local SEO management.

          • STAT

            SERP tracking and analytics for enterprise SEO experts.

          • Moz API

            Power your SEO with our index of over 44 trillion links.

          • Compare SEO Products

            See which Moz SEO solution best meets your business needs.

          • Moz Data

            Power your SEO strategy & AI models with custom data solutions.

          Let your business shine with Listings AI
          Moz Local

          Let your business shine with Listings AI

          Learn more
        • Free SEO Tools
          • Domain Analysis

            Get top competitive SEO metrics like DA, top pages and more.

          • Keyword Explorer

            Find traffic-driving keywords with our 1.25 billion+ keyword index.

          • Link Explorer

            Explore over 40 trillion links for powerful backlink data.

          • Competitive Research

            Uncover valuable insights on your organic search competitors.

          • MozBar

            See top SEO metrics for free as you browse the web.

          • More Free SEO Tools

            Explore all the free SEO tools Moz has to offer.

          NEW Keyword Suggestions by Topic
          Moz Pro

          NEW Keyword Suggestions by Topic

          Learn more
        • Learn SEO
          • Beginner's Guide to SEO

            The #1 most popular introduction to SEO, trusted by millions.

          • SEO Learning Center

            Broaden your knowledge with SEO resources for all skill levels.

          • On-Demand Webinars

            Learn modern SEO best practices from industry experts.

          • How-To Guides

            Step-by-step guides to search success from the authority on SEO.

          • Moz Academy

            Upskill and get certified with on-demand courses & certifications.

          • MozCon

            Save on Early Bird tickets and join us in London or New York City

          Unlock flexible pricing & new endpoints
          Moz API

          Unlock flexible pricing & new endpoints

          Find your plan
        • Blog
        • Why Moz
          • Digital Marketers

            Simplify SEO tasks to save time and grow your traffic.

          • Small Business Solutions

            Uncover insights to make smarter marketing decisions in less time.

          • Agency Solutions

            Earn & keep valuable clients with unparalleled data & insights.

          • Enterprise Solutions

            Gain a competitive edge in the ever-changing world of search.

          • The Moz Story

            Moz was the first & remains the most trusted SEO company.

          • New Releases

            Get the scoop on the latest and greatest from Moz.

          Surface actionable competitive intel
          New Feature

          Surface actionable competitive intel

          Learn More
        • Log in
          • Moz Pro
          • Moz Local
          • Moz Local Dashboard
          • Moz API
          • Moz API Dashboard
          • Moz Academy
        • Avatar
          • Moz Home
          • Notifications
          • Account & Billing
          • Manage Users
          • Community Profile
          • My Q&A
          • My Videos
          • Log Out

        The Moz Q&A Forum

        • Forum
        • Questions
        • My Q&A
        • Users
        • Ask the Community

        Welcome to the Q&A Forum

        Browse the forum for helpful insights and fresh discussions about all things SEO.

        1. Home
        2. Moz Tools
        3. Moz Pro
        4. Domain.com and domain.com/index.html duplicate content in reports even with rewrite on

        Moz Q&A is closed.

        After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

        Domain.com and domain.com/index.html duplicate content in reports even with rewrite on

        Moz Pro
        5
        8
        2030
        Loading More Posts
        • Watching

          Notify me of new replies.
          Show question in unread.

        • Not Watching

          Do not notify me of new replies.
          Show question in unread if category is not ignored.

        • Ignoring

          Do not notify me of new replies.
          Do not show question in unread.

        • Oldest to Newest
        • Newest to Oldest
        • Most Votes
        Reply
        • Reply as question
        Locked
        This topic has been deleted. Only users with question management privileges can see it.
        • anthonytjm
          anthonytjm last edited by

          I have a site that was recently hit by the Google penguin update and dropped a page back. When running the site through seomoz tools, I keep getting duplicate content in the reports for domain.com and domain.com/index.html, even though I have a 301 rewrite condition. When I test the site, domain.com/index.html redirects to domain.com for all directories and root. I don't understand how my index page can still get flagged as duplicate content.

          I also have a redirect from domain.com to www.domain.com.

          Is there anything else I need to do or add to my htaccess file?

          Appreciate any clarification on this.

          1 Reply Last reply Reply Quote 0
          • SeanKoenig
            SeanKoenig last edited by

            Hello Anthony,

            Saw this still open.

            If your index.html "Rewrite" code is accurate, could the issue be WWW, i.e. http://www.domain.com vs. http://domain.com?

            RewriteCond %{HTTP_HOST} ^domain.com
            RewriteRule ^(.*)$ http://www.domain.com/$1 [R=permanent,L]

            1 Reply Last reply Reply Quote 0
            • Dr-Pete
              Dr-Pete Staff last edited by

              I checked one of your campaigns, and it does seem like the 301-redirect is working properly. I'm also not seeing any evidence of links to the "index.htm" version or other issues. I don't see evidence of both version sin Google's index. Not sure exactly what's going on here, but I'll run it by the support team. I don't think you have cause for concern.

              1 Reply Last reply Reply Quote 1
              • anthonytjm
                anthonytjm @irvingw last edited by

                Thank you for the feedback and help.

                I have looked up url removal in webmaster tools and it states that the page must be removed from the site. If I remove index.html I wont have a home page. Am I understanding you correctly? Heres what google states on url removal.

                To remove a page or image, you must do one of the following:

                • Make sure the content is no longer live on the web. Requests for the page must return an HTTP 404 (not found) or 410 status code.
                • Block the content using a robots.txt file.
                • Block the content using a meta noindex tag.

                Please clarify when you get a moment.

                I would have thought the htaccess 301 redirects from www.domain.com/index.html to www.domain.com would be enough.

                Thank you in advance.

                1 Reply Last reply Reply Quote 0
                • irvingw
                  irvingw last edited by

                  a) request removal of the /index.html URL in webmaster tools and it will go away in Google's index quickly.

                  b) make sure that when you link to your homepage on your site you are not linking to the /index.html URL -  I bet you are somewhere  😉  do a sitewide search in dreamweaver to find all instances and do a global replace.

                  anthonytjm 1 Reply Last reply Reply Quote 0
                  • AJPro
                    AJPro @anthonytjm last edited by

                    It could take a little time. I did some redirects myself earlier this year, but the old pages are still in Google's index.

                    Maybe someone else can confirm that it can take a little time before the old pages are dropped from Google's index?

                    1 Reply Last reply Reply Quote 0
                    • anthonytjm
                      anthonytjm @AJPro last edited by

                      HTTP/1.1 301 Moved Permanently => Date => Tue, 08 May 2012 13:44:26 GMT Server => Apache/2.0.52 (CentOS) Location => http://www.domain.com/ Content-Length => 330 Connection => close Content-Type => text/html; charset=iso-8859-1

                      AJPro 1 Reply Last reply Reply Quote 0
                      • AJPro
                        AJPro last edited by

                        Did you verify with a tool like http://www.webconfs.com/http-header-check.php that you get a 301 redirect?

                        anthonytjm 1 Reply Last reply Reply Quote 0
                        • 1 / 1
                        • First post
                          Last post

                        Browse Questions

                        Explore more categories

                        • Moz Tools

                          Chat with the community about the Moz tools.

                        • SEO Tactics

                          Discuss the SEO process with fellow marketers

                        • Community

                          Discuss industry events, jobs, and news!

                        • Digital Marketing

                          Chat about tactics outside of SEO

                        • Research & Trends

                          Dive into research and trends in the search industry.

                        • Support

                          Connect on product support and feature requests.

                        • See all categories

                        Related Questions

                        • chachakhota

                          What are Keywordbasket.com & Keyword-suggest-tool.com. Competitors have Tons of these

                          My client is in the Custom Scale Model industry.  They build Custom Aircraft Models, Custom Ship Models and more. Their competitor's Backlinks reports have a Ton of metrics coming from: http://www.keywordbasket.com  and https://www.keyword-suggest-tool.com There is line after line of these entries in the backlink report.  As much as 50 line entries.  what exactly is happening here?  Are they manually using these tools to generate search entries and caching this data in the form of Backlinks?  Please explain.   is this a Gray Hat Tactic?

                          Moz Pro | | chachakhota
                          0
                        • mlb7

                          Removing Domains From Disavow File

                          We may have accidentally included the wrong domains in our Disavow file and have since removed most domains leaving the only very highly rated spammy links (using moz's new spam score)in the file. How long can it take for to google to recognise this change?ThanksMike

                          Moz Pro | | mlb7
                          0
                        • dlmilli

                          My "tag" pages are showing up as duplicate content. Is this harmful?

                          Hi. I ran a Moz sitecrawl. I see "Yes" under "Duplicate Page Content" for each of my tag pages. Is this harmful? If so, how do I fix it? This is a Wordpress site. Tags are used in both the blog and ecommerce sections of the site. Ecommerce is a very small portion. Thank you. |   |

                          Moz Pro | | dlmilli
                          1
                        • GBCweb

                          Dynamic contents causes duplicate pages

                          Technical help required - please!
                          In our Duplicate Content Pages Report I see a lot of duplicate pages that are created by one URL plus several versions of the same page with the dynamic content, for example,
                          http://www.georgebrown.ca/immigranteducation/programs
                          http://www.georgebrown.ca/school-program.aspx?id=1909&Sortid=Study
                          http://www.georgebrown.ca/school-program.aspx?id=1909&Sortid=Term
                          http://www.georgebrown.ca/school-program.aspx?id=1909&Sortid=Certification
                          http://www.georgebrown.ca/school-program.aspx?id=1909&Sortid=Title How do we solve it?

                          Moz Pro | | GBCweb
                          0
                        • Esaky

                          In alt tag of a image can we use #hashtag or domain.com ? Is that good SEO or not allowed ?

                          Some of the Google Search shows a title has a hashtag of an article, which contain keyword and while tweeting them, the title which has a hashtag automatically very good used for getting traffic to the blog. And other one, can we use the hash tag inside the alt attribute ? Or our domain name with .com in it. Like Google.com or #Google ?

                          Moz Pro | | Esaky
                          0
                        • Rokas

                          How to track all domain keywords?

                          Hello, lets say I have domain www.example.com I want to track rankings of www.example.com/product and www.example.com/anotherproduct with different keywords, so do I have to set up 2 different campaigns? Or is it possilble to track whole root domain with paths? Thanks!

                          Moz Pro | | Rokas
                          0
                        • eatyourveggies

                          Domain / Page Authority - logarithmic

                          SEOmoz says their Domain / Page Authority is logarithmic, meaning that lower rankings are easier to get, higher rankings harder to get. Makes sense. But does anyone know what logarithmic equation they use? I'm using the domain and page authority as one metric in amongst other metrics in my keyword analysis. I can't have some metrics linear, others exponential and the SEOmoz one logarithmic.

                          Moz Pro | | eatyourveggies
                          0
                        • kdl0

                          How to resolve Duplicate Content crawl errors for Magento Login Page

                          I am using the Magento shopping cart, and 99% of my duplicate content errors come from the login page.  The URL looks like: http://www.site.com/customer/account/login/referer/aHR0cDovL3d3dy5tbW1zcGVjaW9zYS5jb20vcmV2aWV3L3Byb2R1Y3QvbGlzdC9pZC8xOTYvY2F0ZWdvcnkvNC8jcmV2aWV3LWZvcm0%2C/ Or, the same url but with the long string different from the one above.  This link is available at the top of every page in my site, but I have made sure to add "rel=nofollow" as an attribute to the link in every case (it is done easily by modifying the header links template). Is there something else I should be doing?  Do I need to try to add canonical to the login page?  If so, does anyone know how to do it using XML?

                          Moz Pro | | kdl0
                          1

                        Get started with Moz Pro!

                        Unlock the power of advanced SEO tools and data-driven insights.

                        Start my free trial
                        Products
                        • Moz Pro
                        • Moz Local
                        • Moz API
                        • Moz Data
                        • STAT
                        • Product Updates
                        Moz Solutions
                        • SMB Solutions
                        • Agency Solutions
                        • Enterprise Solutions
                        • Digital Marketers
                        Free SEO Tools
                        • Domain Authority Checker
                        • Link Explorer
                        • Keyword Explorer
                        • Competitive Research
                        • Brand Authority Checker
                        • Local Citation Checker
                        • MozBar Extension
                        • MozCast
                        Resources
                        • Blog
                        • SEO Learning Center
                        • Help Hub
                        • Beginner's Guide to SEO
                        • How-to Guides
                        • Moz Academy
                        • API Docs
                        About Moz
                        • About
                        • Team
                        • Careers
                        • Contact
                        Why Moz
                        • Case Studies
                        • Testimonials
                        Get Involved
                        • Become an Affiliate
                        • MozCon
                        • Webinars
                        • Practical Marketer Series
                        • MozPod
                        Connect with us

                        Contact the Help team

                        Join our newsletter
                        Moz logo
                        © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                        • Accessibility
                        • Terms of Use
                        • Privacy

                        Looks like your connection to Moz was lost, please wait while we try to reconnect.