Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Do YouTube videos in iFrames get crawled?
- 
					
					
					
					
 There seems to be quite a few articles out there that say iframes cause problems with organic search and that the various bots can't/won't crawl them. Most of the articles are a few years old (including Moz's video sitemap article). I'm wondering if this is still the case with YouTube/Vimeo/etc videos, all of which only offer iFrames as an embed option. I have a hard time believing that a Google property (YT) would offer an embed option that it's own bot couldn't crawl. However, let me know if that is in fact the case. Thanks! Jim 
- 
					
					
					
					
 Hi Joricia, What do you use for transcribing? I've tried Dragon but it's video transcription function is useless. Don't really have the money to get everything manually transcribed. Thanks, Jim 
- 
					
					
					
					
 If you do not want to take the gamble with I-frames and want to be certain that your content is found by Google I would use Wistia it comes with everything that you need in order to have a video indexed the proper embed code, video site map and schema you can use third-party companies like "speechpad" to transcribe what is being spoken. Wistia also offers A similar service. If you do choose to use YouTube I would reembed the video with embedly rember you will have to create your own video XML sitemap, add your own schema you may use to YouTube content to a website without having to worry about Google not being able to index because the I-frame is converted into a readable code. This is a great resource on video SEO. Because I can tell you using Frist hand by using this method it will work. https://www.distilled.net/blog/video/video-seo-tactics-to-get-ranked/ Sorry I did not explain more in my first response. Tom 
- 
					
					
					
					
 They all sort of help, but basically just reconfirms what's out there... nobody seems to know for sure. It seems iframes sometimes get crawled but sometimes not. For Mobile, Google recommends iframes but doesn't say specifically that they get crawled and then elsewhere they say there's limited support for them. It's frustrating Google can't just provide clear guidance on the subject. While the answer might be Vzaar or Wistia, they have drawbacks and there are times where YouTube is the better choice even if you use one of the other services. So understanding the best way to embed them seems important. 
- 
					
					
					
					
 Hi Jim! Do any of these responses help?  
- 
					
					
					
					
 Google actually can crawl iframes, but the support is limited. Try indexing it with robots.txt or add the URL of the frame you'd like to have crawled in Google Webmaster Tools. Since an iframe is basically an HTML document inside an HTML document, it's not going to crawl the whole page together with the iframe, making its SEO value lower than if it were outside the iframe. A good tactic is to also have content surrounding the iframe on page that describes what is inside the iframe. And since we're on the topic of videos inside iframes, make sure you have transcripts for it. Google does use those as well as deaf users, so you're doing a good turn for your client and for those with disabilities. But to answer the root of your question, you're right we don't actually know if Google has a system setup to specifically make it easier to crawl Youtube videos inside iframes. As transparent as Google has been this past year they're still pretty mysterious overall. 
- 
					
					
					
					
 iframes do not get crawled but there are other ways or Google to see videos that link back to your site Moz uses Wistia.com they are spectacular and their embed code and site map make them easily findable 
Browse Questions
Explore more categories
- 
		
		Moz ToolsChat with the community about the Moz tools. 
- 
		
		SEO TacticsDiscuss the SEO process with fellow marketers 
- 
		
		CommunityDiscuss industry events, jobs, and news! 
- 
		
		Digital MarketingChat about tactics outside of SEO 
- 
		
		Research & TrendsDive into research and trends in the search industry. 
- 
		
		SupportConnect on product support and feature requests. 
Related Questions
- 
		
		
		
		
		
		Moz crawler is not able to crawl my website
 Hi, i need help regarding Moz Can't Crawl Your Site i also share screenshot that Moz was unable to crawl your site on Mar 26, 2022. Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. Technical SEO | | JasonTorney
 my robts.txt also ok i checked it
 Here is my website https://whiskcreative.com.au
 just check it please as soon as possibe0
- 
		
		
		
		
		
		How to allow bots to crawl all but WP-content
 Hello, I would like my website to remain crawlable to bots, but to block my wp content and media. Does the following robots.txt work? I worry that the * user agent may conflict with the others. User-agent: * Technical SEO | | Tom3_15
 Disallow: /wp-admin/
 Disallow: /wp-includes/
 Disallow: /wp-content/ User-agent: GoogleBot
 Allow: / User-agent: GoogleBot-Mobile
 Allow: / User-agent: GoogleBot-Image
 Allow: / User-agent: Bingbot
 Allow: / User-agent: Slurp
 Allow: /0
- 
		
		
		
		
		
		CDN Being Crawled and Indexed by Google
 I'm doing a SEO site audit, and I've discovered that the site uses a Content Delivery Network (CDN) that's being crawled and indexed by Google. There are two sub-domains from the CDN that are being crawled and indexed. A small number of organic search visitors have come through these two sub domains. So the CDN based content is out-ranking the root domain, in a small number of cases. It's a huge duplicate content issue (tens of thousands of URLs being crawled) - what's the best way to prevent the crawling and indexing of a CDN like this? Exclude via robots.txt? Additionally, the use of relative canonical tags (instead of absolute) appear to be contributing to this problem as well. As I understand it, these canonical tags are telling the SEs that each sub domain is the "home" of the content/URL. Thanks! Scott Technical SEO | | Scott-Thomas0
- 
		
		
		
		
		
		Getting Pages Indexed That Are Not In The Main Navigation
 Hi All, Hoping you can help me out with a couple of questions I have. I am looking to create SEO friendly landing pages optimized for long tail keywords to increase site traffic and conversions. These pages will not live on the main navigation. I am wondering what the best way to get these pages indexed is? Internal text linking, adding to the sitemap? What have you done in this situation? I know that these pages cannot be orphaned pages and they need to be linked to somewhere. Looking for some tips to do this properly and to ensure that they can become indexed. Thanks! Pat Technical SEO | | PatBausemer0
- 
		
		
		
		
		
		How to get Google to index another page
 Hi, I will try to make my question clear, although it is a bit complex. For my site the most important keyword is "Insurance" or at least the danish variation of this. My problem is that Google are'nt indexing my frontpage on this, but are indexing a subpage - www.mydomain.dk/insurance instead of www.mydomain.dk. My link bulding will be to subpages and to my main domain, but i wont be able to get that many links to www.mydomain.dk/insurance. So im interested in making my frontpage the page that is my main page for the keyword insurance, but without just blowing the traffic im getting from the subpage at the moment. Is there any solutions to do this? Thanks in advance. Technical SEO | | Petersen110
- 
		
		
		
		
		
		How do I get rid of rogue listings?
 Unfortunately, Google has taken bits and pieces of my business and combined it with non-existent businesses and other rogue information. So now my business has 3 locations. One proper listing that I created and manage. One that uses my website address but nothing else is correct in the listing. One that contains my name(incorrectly), but the address and everything else about it is incorrect. I have reported these places many times but they continue to hang around and I am lost/confused on what to do next. Please advise. Technical SEO | | dignan990
- 
		
		
		
		
		
		Robots.txt file getting a 500 error - is this a problem?
 Hello all! While doing some routine health checks on a few of our client sites, I spotted that a new client of ours - who's website was not designed built by us - is returning a 500 internal server error when I try to look at the robots.txt file. As we don't host / maintain their site, I would have to go through their head office to get this changed, which isn't a problem but I just wanted to check whether this error will actually be having a negative effect on their site / whether there's a benefit to getting this changed? Thanks in advance! Technical SEO | | themegroup0
- 
		
		
		
		
		
		Crawling image folders / crawl allowance
 We recently removed /img and /imgp from our robots.txt file thus allowing googlebot to crawl our image folders. Not sure why we had these blocked in the first place, but we opened them up in response to an email from Google Product Search about not being able to crawl images - which can/has hurt our traffic from Google Shopping. My question is: will allowing Google to crawl our image files eat up our 'crawl allowance'? We wouldn't want Google to not crawl/index certain pages, and ding our organic traffic, because more of our allotted crawl bandwidth is getting chewed up crawling image files. Outside of the non-detailed crawl stat graphs from Webmaster Tools, what's the best way to check how frequently/ deeply our site is getting crawled? Thanks all! Technical SEO | | evoNick0
 
			
		 
			
		 
			
		 
			
		 
					
				 
					
				 
					
				 
					
				 
					
				 
					
				 
					
				