Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Right way to block google robots from ppc landing pages
-
What is the right way to completely block seo robots from my adword landing pages? Robots.txt does not work really good for that, as far I know.
Adding metatags noindex nofollow on the other side will block adwords robot as well. right?
Thank you very much,
Serge
-
Thank you very much
-
Gotcha. I did some searching around and you will not block the AdWords bot unless you explicitly block AdsBot-Google. A wildcard user agent disallow will not block the AdsBot-Google. Hope that helps!
-
Thanks guys. AdWords robots scans the page to determine it's relevancy to your ad group.
When you block it in robots.txt ONLY, the link to this page will be indexed and show up in your serp results site:example.com
I wondered if you add meta tags noindex nofollow you also blocking all robots to scan the page, adwords as well
-
If you have a specific directory for PPC pages then you can follow these steps that have worked for us wonderfully:
Block the directory /ppc to the robots.txt file for all user agents. This can even be live before the /ppc directory even exists.
User-agent: *
Disallow: /ppc
Add noindex, nofollow in the meta tags for all pages in /ppc
I'm not sure what you are referring to when you mention an AdWords robot?
-
Dear Serge,
Your question is difficulty to answer, because you have several possibilities. If you use the noindex, will stop all the robots.
There is a post at SEOMoz blog writed by Lindsay that i think will answer your question. You will find it here: http://www.seomoz.org/blog/robot-access-indexation-restriction-techniques-avoiding-conflicts
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should we rename and update a page or create a new page entirely?
Hi Moz Peoples! We have a small site with a simple site navigation, with only a few links on the nav bar. We have been doing some work to create a new page, which will eventually replace one of the links on the nav bar. The question we are having is, is it better to rename the existing page and replace its content and then wait for the great indexer to do its thing, or perm delete the page and replace it with the new page and content? Or is this a case where it really makes no difference as long as the redirects are set up correctly?
On-Page Optimization | | Parker8180 -
Getting the Titles and Headings Right on Product Pages. Userbility vs SEO
Hey Mozzers, I am optimising a chaotic section of the site including many similar products. Writing unique content etc. The titles and urls were all over the place so my first job was to tidy them up so I could make some sense of the situation, especially as sometimes they didn't even match! I should point out were on Magento, so product name = Both the Heading and Title of the page, the meta title can be set separately. When i refer to title I mean both <title>and <h1></strong><br /><br />Before they existed as such<br />URL: domain.com/200-x-0-5-g-rs-232-balance.html<br />TItle: PC-1234 200 x 0.5g x 0.3 RS-232 Balance<br /><br />This format was (Product Code, Capacities, Resolutions, Accuracy, Product Title)<br /><br />The issue was all 60 products in a page followed this format. Navigating through the page was a nightmare and was just a jumble of numbers and highly confusing even to me who learnt what they all mean, especially when you had 8 products from the same range you got presented with<br /><br />APC-1234 200 x 0.5g x 0.3 RS-232 Balance<br />APC-1235 500 x 1g x 0.3 RS-232 Balance<br />APC-1236 1000 x 2g x 0.3 RS-232 Balance<br />APC-1238 5000 x 10g x 0.3 RS-232 Balance<br />APC-1239 10000 x 15g x 0.3 RS-232 Balance<br />APC-1210 20000 x 25g x 0.3 RS-232 Balance<br />APC-1211 50000 x 50g x 0.3 RS-232 Balance</p> <p>I changed them to something more user friendly.<br /><br />URL: domain.com/200g-precision-balance.html<br />Title: 200g Precision Balance<br /><br />This has seen the following benefits<br />- URL is now clear and means something to the user<br />- Product titles are easy to navigate and the page is more pleasing to the eye<br />- The jumble of numbers in the title are now all labelled and shown below each product listing in bullet point so the user can see the basic spec of a product without having to decipher any titles<br /><br />Upon reflection I has a couple of concerns I was hoping you could discuss, I am wondering if I have made the titles too simple.<br />1) I have no product code in the title<br />We have our own products manufactured and sell existing brands with their own product codes. Some of these can be lengthy. Adding them makes them hard to the eye and the page looked cramped.<br /><br />The codes are listed beneath each product title on category pages and on a list on the actual product page, but no where in the titles. <br /><br />2)None of our products have a brand listed in the title<br />None of the products on the site had brand names in anything but the images when i started and as such it snuck under my radar. But should i pre-fix all titles with a brand name?<br /><br />Should </p> <p>URL: domain.com/200g-precision-balance.html<br />Title: 200g Precision Balance</p> <p>become</p> <p>URL: domain.com/BRAND1-200g-precision-balance.html<br />Title: BRAND1 200g Precision Balance<br /><br />My instinct tells me to change things to include brands as its useful to the customer and should have an SEO benefit, but to leave out product codes as they are accessible to the customer where they are now and dont make things messy and unreadable.<br /><br />As always, thanks for the input!</p></title>
On-Page Optimization | | ATP0 -
Why does Google pick a low priority page on my site?
Hi Guys. One of my pages ranks quite well for "mid year diaries 14-15" on Google. The problem is it's a really specific product page (A4, Hardback, day-to-a-page diary I think). It would be much better for the user to land on our mid-year diaries category, not really deep into the site. Why is Google prioritizing this product page over our general 'mid year diaries' category? Especially when the category would relate to the search more accurately? I work for TOAD diaries and I think our page rank is 10 for this search. Eagerly awaiting some insight 🙂 Thanks in advance everyone! Isaac.
On-Page Optimization | | isaac6630 -
Home page and category page target same keyword
Hi there, Several of our websites have a common problem - our main target keyword for the homepage is also the name of a product category we have within the website. There are seemingly two solutions to this problem, both of which not ideal: Do not target the keyword with the homepage. However, the homepage has the most authority and is our best shot at getting ranked for the main keyword. Reword and "de-optimise" the category page, so it doesn't target the keyword. This doesn't work well from UX point of view as the category needs to describe what it is and enable visitors to navigate to it. Anybody else gone through a similar conundrum? How did you end up going about it? Thanks Julian
On-Page Optimization | | tprg0 -
How to find google indexed pages
I can't find where the # of indexed pages are on my google analytics. I tried the instructions below, but the index status was not an option on my dashboard. View the Index Status page: On the Webmaster Tools home page, click the site you want. On the Dashboard, click Google Index, and then click Index Status.
On-Page Optimization | | SoftwareMarketing0 -
Is there a way to prevent Google Alerts from picking up old press releases?
I have a client that wants a lot of old press releases (pdfs) added to their news page, but they don't want these to show up in Google Alerts. Is there a way for me to prevent this?
On-Page Optimization | | IdeaGarden0 -
How to properly remove pages and a category from Google's index
I want to remove this category http://www.webdesign.org/web-design-news-all/ and all the pages in that category (e.g. http://www.webdesign.org/web-design-news-all/7386.html ) from Google's index. I used the following string in the "Reomval URS" section in Google Webmaster Tools: http://www.webdesign.org/web-design-news-all/* is that correct or I better use http://www.webdesign.org/web-design-news-all/ ? Thanks in advance.
On-Page Optimization | | VinceWicks0 -
Does a page's url have any weight in Google rankings?
I'm sure this question must have been asked before but I can't find it. I'm assuming that the title tag is far more important than the page's url. Is that correct? Does the url have any relevance to Google?
On-Page Optimization | | rdreich490