Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website is flagged as Compromised Site by Google
Hi everyone, We have been running Google Ads for a while now and last week all of our Google Ads were paused with reason Compromised Site. We reached out to Google and they identify this page as one of the affected page: https://manpower.com.vn/vi/dich-vu-san-dau-nguoi-and-tu-van-nhan-su-cap-cao? The malicious links they found are:
Paid Search Marketing | | ManpowerVietnam
• googie-anaiytics[.]com
• vty68[.]net We have asked our Website vendor to scan and they found nothing. We would be greatly appreciated if you could help. I tried Google Search Console and even the tool Google Safe Browsing that Google itself suggested but both the tools showed that our website does not have any malicious links at all. And yet Google Ads support team keeps telling us our page contains these links. I am wondering if anyone in the community has experienced this before and how did you address this issue. Or could you guys please help to share any tools that you know can do a deep scan on this page and if possible our entire website to help us identify where the links are located? Please let me know if you need any additional information from us and I would be happy to provide it.3 -
304 "If Modified Header" Triggers Error in Google Ads?
We have a client who is launch some Google Ads campaigns, and they recently asked us to fix 304 "Errors" on their website as per this feedback: "When we inspected the website we came across a number of 304 status errors. In order to get the ads running, we will need all of the website domain status codes converted to 200. “ Of course, all of their website pages return a 200 Status, it's just the HTTP headers that additionally clarify with a 304 Response (not an error). Has anyone else ever run into this issue with Google Ads? IMHO it makes no sense to remove this functionality. Google has even recommended in the past to use this it: https://webmasters.googleblog.com/2008/11/date-with-googlebot-part-ii-http-status.html Thanks for any tips or feedback!
Paid Search Marketing | | mirabile0 -
301 Redirects and Google Shopping Feeds
I am moving my site from Volusion to Shopify. The domain remains the same but the URL paths are different. With respect to my Google Shopping feed, is it best to send old URLs (with 301 redirects) or to send the new URLs?
Paid Search Marketing | | vgusvg0 -
How to deal with the InCorrect Price Issue for the Google Shopping Product Listing Ads?
Hello All, Yesterday when i was checking with the one of the search term for "canvas prints"..i come to know that one of the advertiser EasyCanvasPrints.com is showing Incorrect price. On Search result they guys are showing $7.46 incorrect price for the PLA - Product listing ads. Go to below links: https://www.google.com/search?hl=en&site=webhp&tbs=vw:l,mr:1,seller:8521978&tbm=shop&q=canvas+prints&sa=X&ved=0CJkGELMrahUKEwjmj-PSgfzIAhUHBY4KHc0VBBQ https://www.google.com/?gws_rd=ssl#q=canvas+prints&tbm=shop https://www.google.com/?gws_rd=ssl#q=canvas+prints&start=0 But when we click on it then i can not this price $7.46 http://www.easycanvasprints.com/single-canvas?singlecanvas=1&height=19&width=14&pcode=5345334C6B74647246774137536C786768544B5458776C35644F747855796D39&utm_source=google_base&utm_medium=data_feed I have done various claim and send to Google support about this misguiding price for the Easy Canvas Prints but they not taking any actions on it. Guy Can u please help me how can i pass this message to Google to take actions for this advertiser? Waiting for your reply Regards Dinesh
Paid Search Marketing | | CommercePundit0 -
How to track in Google Analytics 2 different subdomains (one for website, the other for PPC landing pages)
Hello Mozers! I have a website with organic visits/goals on www.site.com and a few AdWords Campaign landing pages on lp.site.com whose goals are tracked with both adwords conversion monitoring AND analytics (not imported from analytics into Adword). The landing pages of the campaign have nothing to do with the web site (different cms, they don't link each other, totally isolated) and viceversa. Given that, what would it be the best practice to configure Google Analytics to track the website (www.site.com) AND a PPC campagin (lp.site.com)? I have been told to set up different views of the same property, but do I really need that? Please let me know what are you thinking. Thank you very much. DoMiSoL Rossini
Paid Search Marketing | | DoMiSoL0 -
Why does my google analytics show a massive discrepancy from facebook's reported website clicks?
We're running a Facebook news feed ad that is pointing at our homepage. Facebook says that for yesterday there were 47 website clicks. Google analytics shows 15 total visitors from facebook with 3 of them landing on the homepage. I understand that there is likely going to be some discrepancy with users accidentally clicking and clicking back before the page loads, but this seems a little insane. I tested the ad using a page that pulls the Analytics cookie data using php and it is working properly so I don't understand what's happening. The url isn't tagged with utm parameters, which is going to be fixed. Anyone experience this or have any insight as to what could be this issue? Is this click fraud? Edit: For more clarification I was checking on my completely unfiltered google analytics profile/view.
Paid Search Marketing | | spencerhjustice0 -
Paid Search Visits Not Showing Up in Google Analytics
Hey all, Just took over SEM for my company, and noticed a bit of a problem with GA. Whereas Adwords has registered 141 clicks on paid campaigns that go to the site, GA has tracked only 5 vists in that time. Two things of note: The GA account was not linked to the Adwords account until today, and also, auto-tagging was not turned on. I understand these two things are important to having proper GA tracking, but I just want to make sure that there aren't any other things I should check right now to make sure I start to see tracked paid visits again. Is there anything else I should try? Cheers.
Paid Search Marketing | | danny.wood0 -
Google Analytics CPC and PPC not Matching
Hi Why do our CPC in Google Analytic not match our PPC in Adword, surely they should be identical? We have Auto-tagging switched on and data in our history is wrong so it is not a timing issue. Thanks
Paid Search Marketing | | Studio330