Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Do YouTube videos in iFrames get crawled?
- 
					
					
					
					
 There seems to be quite a few articles out there that say iframes cause problems with organic search and that the various bots can't/won't crawl them. Most of the articles are a few years old (including Moz's video sitemap article). I'm wondering if this is still the case with YouTube/Vimeo/etc videos, all of which only offer iFrames as an embed option. I have a hard time believing that a Google property (YT) would offer an embed option that it's own bot couldn't crawl. However, let me know if that is in fact the case. Thanks! Jim 
- 
					
					
					
					
 Hi Joricia, What do you use for transcribing? I've tried Dragon but it's video transcription function is useless. Don't really have the money to get everything manually transcribed. Thanks, Jim 
- 
					
					
					
					
 If you do not want to take the gamble with I-frames and want to be certain that your content is found by Google I would use Wistia it comes with everything that you need in order to have a video indexed the proper embed code, video site map and schema you can use third-party companies like "speechpad" to transcribe what is being spoken. Wistia also offers A similar service. If you do choose to use YouTube I would reembed the video with embedly rember you will have to create your own video XML sitemap, add your own schema you may use to YouTube content to a website without having to worry about Google not being able to index because the I-frame is converted into a readable code. This is a great resource on video SEO. Because I can tell you using Frist hand by using this method it will work. https://www.distilled.net/blog/video/video-seo-tactics-to-get-ranked/ Sorry I did not explain more in my first response. Tom 
- 
					
					
					
					
 They all sort of help, but basically just reconfirms what's out there... nobody seems to know for sure. It seems iframes sometimes get crawled but sometimes not. For Mobile, Google recommends iframes but doesn't say specifically that they get crawled and then elsewhere they say there's limited support for them. It's frustrating Google can't just provide clear guidance on the subject. While the answer might be Vzaar or Wistia, they have drawbacks and there are times where YouTube is the better choice even if you use one of the other services. So understanding the best way to embed them seems important. 
- 
					
					
					
					
 Hi Jim! Do any of these responses help?  
- 
					
					
					
					
 Google actually can crawl iframes, but the support is limited. Try indexing it with robots.txt or add the URL of the frame you'd like to have crawled in Google Webmaster Tools. Since an iframe is basically an HTML document inside an HTML document, it's not going to crawl the whole page together with the iframe, making its SEO value lower than if it were outside the iframe. A good tactic is to also have content surrounding the iframe on page that describes what is inside the iframe. And since we're on the topic of videos inside iframes, make sure you have transcripts for it. Google does use those as well as deaf users, so you're doing a good turn for your client and for those with disabilities. But to answer the root of your question, you're right we don't actually know if Google has a system setup to specifically make it easier to crawl Youtube videos inside iframes. As transparent as Google has been this past year they're still pretty mysterious overall. 
- 
					
					
					
					
 iframes do not get crawled but there are other ways or Google to see videos that link back to your site Moz uses Wistia.com they are spectacular and their embed code and site map make them easily findable 
Browse Questions
Explore more categories
- 
		
		Moz ToolsChat with the community about the Moz tools. 
- 
		
		SEO TacticsDiscuss the SEO process with fellow marketers 
- 
		
		CommunityDiscuss industry events, jobs, and news! 
- 
		
		Digital MarketingChat about tactics outside of SEO 
- 
		
		Research & TrendsDive into research and trends in the search industry. 
- 
		
		SupportConnect on product support and feature requests. 
Related Questions
- 
		
		
		
		
		
		Unsolved Question about a Screaming Frog crawling issue
 Hello, I have a very peculiar question about an issue I'm having when working on a website. It's a WordPress site and I'm using a generic plug in for title and meta updates. When I go to crawl the site through screaming frog, however, there seems to be a hard coded title tag that I can't find anywhere and the plug in updates don't get crawled. If anyone has any suggestions, thatd be great. Thanks! Technical SEO | | KyleSennikoff0
- 
		
		
		
		
		
		Moz crawler is not able to crawl my website
 Hi, i need help regarding Moz Can't Crawl Your Site i also share screenshot that Moz was unable to crawl your site on Mar 26, 2022. Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. Technical SEO | | JasonTorney
 my robts.txt also ok i checked it
 Here is my website https://whiskcreative.com.au
 just check it please as soon as possibe0
- 
		
		
		
		
		
		If I get spammy backlinks removed is it still necessary to disavow?
 Now there is some conflicting beliefs here and I want to know what you think. If I got a high spam website to remove my backlink, is a disavow through search console still necessary ? Keep in mind if it helps even in the slightest to improve rankings im for it! Technical SEO | | Colemckeon1
- 
		
		
		
		
		
		How to allow bots to crawl all but WP-content
 Hello, I would like my website to remain crawlable to bots, but to block my wp content and media. Does the following robots.txt work? I worry that the * user agent may conflict with the others. User-agent: * Technical SEO | | Tom3_15
 Disallow: /wp-admin/
 Disallow: /wp-includes/
 Disallow: /wp-content/ User-agent: GoogleBot
 Allow: / User-agent: GoogleBot-Mobile
 Allow: / User-agent: GoogleBot-Image
 Allow: / User-agent: Bingbot
 Allow: / User-agent: Slurp
 Allow: /0
- 
		
		
		
		
		
		CDN Being Crawled and Indexed by Google
 I'm doing a SEO site audit, and I've discovered that the site uses a Content Delivery Network (CDN) that's being crawled and indexed by Google. There are two sub-domains from the CDN that are being crawled and indexed. A small number of organic search visitors have come through these two sub domains. So the CDN based content is out-ranking the root domain, in a small number of cases. It's a huge duplicate content issue (tens of thousands of URLs being crawled) - what's the best way to prevent the crawling and indexing of a CDN like this? Exclude via robots.txt? Additionally, the use of relative canonical tags (instead of absolute) appear to be contributing to this problem as well. As I understand it, these canonical tags are telling the SEs that each sub domain is the "home" of the content/URL. Thanks! Scott Technical SEO | | Scott-Thomas0
- 
		
		
		
		
		
		Getting a video displaying a lightbox indexed
 We have created a video for a category page with the goal of building links to the page and improving the conversion rate of visitors to the page. This category is Christmas oriented so we want to get the video dropped in ASAP. Unfortunately there was a mixup with our developer and he created a lightbox pop-up to display the video on the category page. I'm concerned this will hurt our ability to get the video indexed in Google. Here was his response. Is what he says here true? "With the video originally being in lightbox the iFrame Embed was enough since the video can't be on the page, it would have to be hidden on the page which is ignored by Google. The SEO would be derived from modifying the video sitemap to define the category page as the HTML page for the Wistia video and Google will make the association. The sitemap did all the heavy lifting, the schema markup did not come till later so it had no additional affect on Google other then to re-enforce the sitemap." Thanks for your help! Technical SEO | | GManSEO0
- 
		
		
		
		
		
		Getting Pages Indexed That Are Not In The Main Navigation
 Hi All, Hoping you can help me out with a couple of questions I have. I am looking to create SEO friendly landing pages optimized for long tail keywords to increase site traffic and conversions. These pages will not live on the main navigation. I am wondering what the best way to get these pages indexed is? Internal text linking, adding to the sitemap? What have you done in this situation? I know that these pages cannot be orphaned pages and they need to be linked to somewhere. Looking for some tips to do this properly and to ensure that they can become indexed. Thanks! Pat Technical SEO | | PatBausemer0
- 
		
		
		
		
		
		MozBar picking up iFrame source as URL
 Running a WordPress site with a custom theme. Using a standard wp_head or wp_footer hook to insert the standard code for a Facebook Like, Twitter count / Google Plus count into the site - basically that hook just places the code, programmatically, into the HEAD (where applicable) or right before the BODY closes. For some reason, MozBar is picking up the URL of the iFrame that gets inserted with this code as the URL of the site. I don't have it live right now due to the issues, but I can turn it "on" for anyone who wants a look. Anyone else have this issue? I'm using the code directly from developers.facebook.com for the Like box, and the Google Plus button, Twitter too. Nothing fancy here. Technical SEO | | joechicago0
 
			
		 
			
		 
			
		 
			
		 
					
				 
					
				 
					
				 
					
				 
					
				 
					
				 
					
				