Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google Ads Subdomain in sitelinks & Composition Change for Strategy Status
I have a basic query but could not find a definite answer on the internet. I am currently running a campaign for the main website of a big education brand and they also have a secondary learning website on subdomain, and I want to add sitelinks of subdomain to the campaign, but I am not sure whether it is allowed or not. The brand I am running ads for is https://www.rauias.com/ and the secondary website is https://compass.rauias.com/ branded slightly different in a subdomain, so should I add the sitelinks of Compass to the main campaign? Also one more silly question My Max Conversion search campaign gave me this status today. "Learning (composition change): Campaigns have been added to or removed from the bid strategy. Google Ads is now adjusting to optimize bids. 5 days left for learning" What does this mean exactly? And Why does it reenter the learning phase whenever I make a small change?
Paid Search Marketing | | rauoff0 -
304 "If Modified Header" Triggers Error in Google Ads?
We have a client who is launch some Google Ads campaigns, and they recently asked us to fix 304 "Errors" on their website as per this feedback: "When we inspected the website we came across a number of 304 status errors. In order to get the ads running, we will need all of the website domain status codes converted to 200. “ Of course, all of their website pages return a 200 Status, it's just the HTTP headers that additionally clarify with a 304 Response (not an error). Has anyone else ever run into this issue with Google Ads? IMHO it makes no sense to remove this functionality. Google has even recommended in the past to use this it: https://webmasters.googleblog.com/2008/11/date-with-googlebot-part-ii-http-status.html Thanks for any tips or feedback!
Paid Search Marketing | | mirabile0 -
Looking at google shopping results from other country
Hi, I run shops in several languages out of London. One of our key revenue drivers is google shopping. It is important for me to look the the shopping search results for example in germany. Recently Google changed something so when I want to look at the german shopping results from here, eg. http://www.google.de/shopping it always shows me the english ones with prices in pounds. Is there a trick to still get the foreign results? Thanks in advance Dieter
Paid Search Marketing | | Storesco1 -
How to track in Google Analytics 2 different subdomains (one for website, the other for PPC landing pages)
Hello Mozers! I have a website with organic visits/goals on www.site.com and a few AdWords Campaign landing pages on lp.site.com whose goals are tracked with both adwords conversion monitoring AND analytics (not imported from analytics into Adword). The landing pages of the campaign have nothing to do with the web site (different cms, they don't link each other, totally isolated) and viceversa. Given that, what would it be the best practice to configure Google Analytics to track the website (www.site.com) AND a PPC campagin (lp.site.com)? I have been told to set up different views of the same property, but do I really need that? Please let me know what are you thinking. Thank you very much. DoMiSoL Rossini
Paid Search Marketing | | DoMiSoL0 -
Google Analytics showing my Adwords campaign bounce rate at 0%
I am relatively new to Adwords, and I can't figure out why the Adwords section of Analytics is showing all my site visitors at 0% bounce rate. Does that mean the account connection is not done right? Obviously Google ads are not a 0% bounce rate. If I can't get that to work, does anyone know how Google ads appear in Traffic? Is it Direct or Referral? I'm sure there's some simple answer I'm just not aware of, I would appreciate anyone's help. Thanks!
Paid Search Marketing | | Crystalline_150 -
Hire Products on Google Shopping
Has anyone got any experience with advertising products for hire rather than for sale on Google Shopping? Is it allowed? How does it perform?
Paid Search Marketing | | ese0 -
Google URL Builder / Campaign Tracking on two Different Domain using the Same Analytics Code
Hey Everyone, I think I know the answer to this but I'd like to get some confirmation. I currently have a landing page at "www.xyz.com", it's a separate domain in which only the landing page exists and not a vanity URL which redirects. However, the navigation and all the links on "www.xyz.com" actually link out to "www.abc.com". The domain / landing page "xyz" has the same analytics tracking code as domain "www.abc.com". My question is this, if I use Google URL builder to create custom URL's to track for each ad that I'm running in Adwords, will this data show up in the analytics of "abc" even though it's a separate domain because it has the same analytics code? In other words, does campaign data show only if the domain and the google analytics code line up, or does the domain not matter and as long as you have the same analytics code (despite two separate domains) that campaign data (built through Google URL builder) will show? My hunch and best guess it that as long as the analytics code is the same (regardless of a separate domain) that the data in campaign will show with the custom URL's I build. I'm aware that I can test this and I will but I'd like to get an idea from the community first to make things easier. Anybody have experience with this? Answers greatly appreciated! Thanks!
Paid Search Marketing | | EvansHunt0 -
CPC or CPM for Google Display Network?
HI all I'm setting up my first Remarketing campaign on the display network. I'm targeting those that have visited a specific product page at the moment and therefore there won't be a massive amount of traffic to remarket to - roughly no more than 50 clicks/day. My question is - what is the best bidding option for a campaign like this? Not sure whether to go for CPM or traditional CPC. I have previously found CPM much better for Facebook but obviously thats very different to Google. All help appreciated!
Paid Search Marketing | | SamMaley0