• esmeralda-LT82Li
        All notifications
        Skip to content
        Moz logo Menu open Menu close
        • Products
          • Moz Pro
          • Moz Pro Home
          • Moz Local
          • Moz Local Home
          • STAT
          • Moz API
          • Moz API Home
          • Compare SEO Products
          • Moz Data
        • Free SEO Tools
          • Domain Analysis
          • Keyword Explorer
          • Link Explorer
          • Competitive Research
          • MozBar
          • More Free SEO Tools
        • Learn SEO
          • Beginner's Guide to SEO
          • SEO Learning Center
          • Moz Academy
          • MozCon
          • Webinars, Whitepapers, & Guides
        • Blog
        • Why Moz
          • Digital Marketers
          • Agency Solutions
          • Enterprise Solutions
          • Small Business Solutions
          • The Moz Story
          • New Releases
        • Log in
        • Log out
        • Products
          • Moz Pro

            Your all-in-one suite of SEO essentials.

          • Moz Local

            Raise your local SEO visibility with complete local SEO management.

          • STAT

            SERP tracking and analytics for enterprise SEO experts.

          • Moz API

            Power your SEO with our index of over 44 trillion links.

          • Compare SEO Products

            See which Moz SEO solution best meets your business needs.

          • Moz Data

            Power your SEO strategy & AI models with custom data solutions.

          Track your brand’s footprint in AI search
          Moz Pro

          Track your brand’s footprint in AI search

          Learn more
        • Free SEO Tools
          • Domain Analysis

            Get top competitive SEO metrics like DA, top pages and more.

          • Keyword Explorer

            Find traffic-driving keywords with our 1.25 billion+ keyword index.

          • Link Explorer

            Explore over 40 trillion links for powerful backlink data.

          • Competitive Research

            Uncover valuable insights on your organic search competitors.

          • MozBar

            See top SEO metrics for free as you browse the web.

          • More Free SEO Tools

            Explore all the free SEO tools Moz has to offer.

          Let your business shine with Listings AI

          Let your business shine with Listings AI

          Get found
        • Learn SEO
          • Beginner's Guide to SEO

            The #1 most popular introduction to SEO, trusted by millions.

          • SEO Learning Center

            Broaden your knowledge with SEO resources for all skill levels.

          • On-Demand Webinars

            Learn modern SEO best practices from industry experts.

          • How-To Guides

            Step-by-step guides to search success from the authority on SEO.

          • Moz Academy

            Upskill and get certified with on-demand courses & certifications.

          • MozCon

            Save on Early Bird tickets and join us in London or New York City

          Access 20 years of data with flexible pricing
          Moz API

          Access 20 years of data with flexible pricing

          Find your plan
        • Blog
        • Why Moz
          • Digital Marketers

            Simplify SEO tasks to save time and grow your traffic.

          • Small Business Solutions

            Uncover insights to make smarter marketing decisions in less time.

          • Agency Solutions

            Earn & keep valuable clients with unparalleled data & insights.

          • Enterprise Solutions

            Gain a competitive edge in the ever-changing world of search.

          • The Moz Story

            Moz was the first & remains the most trusted SEO company.

          • New Releases

            Get the scoop on the latest and greatest from Moz.

          Surface actionable competitive intel
          New Feature

          Surface actionable competitive intel

          Learn More
        • Log in
          • Moz Pro
          • Moz Local
          • Moz Local Dashboard
          • Moz API
          • Moz API Dashboard
          • Moz Academy
        • Avatar
          • Moz Home
          • Notifications
          • Account & Billing
          • Manage Users
          • Community Profile
          • My Q&A
          • My Videos
          • Log Out

        The Moz Q&A Forum

        • Forum
        • Questions
        • My Q&A
        • Users
        • Ask the Community

        Welcome to the Q&A Forum

        Browse the forum for helpful insights and fresh discussions about all things SEO.

        1. SEO and Digital Marketing Forum
        2. Categories
        3. SEO Tactics
        4. Intermediate & Advanced SEO
        5. Robots.txt is blocking Wordpress Pages from Googlebot?
        Moz Q&A is closed.

        After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

        Robots.txt is blocking Wordpress Pages from Googlebot?

        Intermediate & Advanced SEO
        4 2 12.3k
        • Watching
          Notify me of new replies.
          Show question in unread.
        • Not Watching
          Do not notify me of new replies.
          Show question in unread if category is not ignored.
        • Ignoring
          Do not notify me of new replies.
          Do not show question in unread.
        • Oldest to Newest
        • Newest to Oldest
        • Most Votes
        Reply
        • Reply as question
        Locked
        This topic has been deleted. Only users with topic management privileges can see it.
        • ENSO
          ENSO last edited by

          I have a robots.txt file on my server, which I did not develop, it was done by the web designer at the company before me. Then there is a word press plugin that generates a robots.txt file. How Do I unblock all the wordpress pages from googlebot?

          1 Reply Last reply Reply Quote 0
          • Desiree-CP
            Desiree-CP @ENSO last edited by

            Delete everything under the following directives and you should be good.

            User-agent: Googlebot

            Disallow: /*/trackback

            Disallow: /*/feed

            Disallow: /*/comments

            Disallow: /?

            Disallow: /*?

            Disallow: /page/

            As a rule of thumb, it's not a good idea to use wild cards in your robots.txt file - you may be excluding an entire folder inadvertently.

            1 Reply Last reply Reply Quote 0
            • ENSO
              ENSO @Desiree-CP last edited by

              Here is my robots.txt from google webmaster tools. These are the pages that are being blocked and I am not sure which of these to get rid of in order to unblock blog posts from being searched.

              http://ensoplastics.com/theblog/?cat=743

              http://ensoplastics.com/theblog/?p=240

              These category pages and blog posts are blocked so do I delete the /? ...I am new to SEO and web development so I am not sure why the developer of this robots.txt file would block pages and posts in wordpress. It seems to me like that is the reason why someone has a blog so it can be searched and get more exposure for SEO purposes.

              Sitemap: http://www.ensobottles.com/blog/sitemap.xml

              User-agent: Googlebot

              Disallow: /*/trackback

              Disallow: /*/feed

              Disallow: /*/comments

              Disallow: /?

              Disallow: /*?

              Disallow: /page/
              User-agent: *

              Disallow: /cgi-bin/

              Disallow: /wp-admin/

              Disallow: /wp-includes/

              Disallow: /wp-content/plugins/

              Disallow: /wp-content/themes/

              Disallow: /trackback

              Disallow: /commentsDisallow: /feed

              Desiree-CP 1 Reply Last reply Reply Quote 0
              • Desiree-CP
                Desiree-CP last edited by

                I'm not sure to what extent your website is being blocked with the robots.txt file but it's pretty easy to diagnose.  You'll first need to identify and confirm that googlebot is being blocked by typing in your web browser ~> www.mywebsite.com/robots.txt

                If you see an entry such as "User-agent: *" or "User-agent: googlebot" being used in conjunction with "Disallow" then you know your website is being blocked with the robots.txt file.  Given your situation you'll need to go through a two step process.

                First, go into your wordpress plugin page and deactivate the plugin which generates your robots.txt file.  Second, login to the root folder of your server and look for the robots.txt file.  Lastly, change "Disallow" to "Allow" and that should work but you'll need to confirm by typing in the robots URL again.

                Given the limited information in your question I hope that helps.  If you run into any more issues don't hesitate to post them here.

                ENSO 1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post

                Explore more categories

                • Moz Tools

                  Chat with the community about the Moz tools.

                  Getting Started
                  Moz Pro
                  Moz Local
                  Moz Bar
                  API
                  What's New

                • SEO Tactics

                  Discuss the SEO process with fellow marketers

                  Content Development
                  Competitive Research
                  Keyword Research
                  Link Building
                  On-Page Optimization
                  Technical SEO
                  Reporting & Analytics
                  Intermediate & Advanced SEO
                  Image & Video Optimization
                  International SEO
                  Local SEO

                • Community

                  Discuss industry events, jobs, and news!

                  Moz Blog
                  Moz News
                  Industry News
                  Jobs and Opportunities
                  SEO Learn Center
                  Whiteboard Friday

                • Digital Marketing

                  Chat about tactics outside of SEO

                  Affiliate Marketing
                  Branding
                  Conversion Rate Optimization
                  Web Design
                  Paid Search Marketing
                  Social Media

                • Research & Trends

                  Dive into research and trends in the search industry.

                  SERP Trends
                  Search Behavior
                  Algorithm Updates
                  White Hat / Black Hat SEO
                  Other SEO Tools

                • Support

                  Connect on product support and feature requests.

                  Product Support
                  Feature Requests
                  Participate in User Research

                • See all categories

                • Robots.txt blocked internal resources Wordpress
                  Mat_C
                  Mat_C
                  2
                  5
                  3.6k

                • If Robots.txt have blocked an Image (Image URL) but the other page which can be indexed has this image, how is the image treated?
                  Malika1
                  Malika1
                  1
                  4
                  2.7k

                • Soft 404's from pages blocked by robots.txt -- cause for concern?
                  nicole.healthline
                  nicole.healthline
                  4
                  6
                  3.1k

                • Blocking Pages Via Robots, Can Images On Those Pages Be Included In Image Search
                  HD_Leona
                  HD_Leona
                  0
                  6
                  1.7k

                • Blocking Dynamic URLs with Robots.txt
                  AndrewY
                  AndrewY
                  1
                  4
                  6.9k

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy

                Looks like your connection to Moz was lost, please wait while we try to reconnect.