Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
GOOGLE ANALYTIC SKEWED DATA BECAUSE OF GHOST REFERRAL SPAM ND CRAWL BOTS
- 
					
					
					
					
 Hi Guys, We are having some major problems with our Google Analytics and MOz account. Due to the large number of ghost/referral spam and crawler bots we have added some heavy filtering to GA. This seems to be working protecting the data from all these problems but also filtering out much needed data that is not coming through. In example, we used to get a hundred visitors a day at the least and now we are down to under ten. ANYBODY PLEASE HELP. HAVE READ THROUGH MANY ARTICLES WITH NO FIND TO PERMANENT SOLID SOLUTION (even willing to go with paid service instead of GA) Thank You so Much, S.M. 
- 
					
					
					
					
 As I understand, you get referral traffic from websites like; traffic-cash and those with .xyz extension. There is a great article on how to filter those: https://www.ohow.co/what-is-referrer-spam-how-stop-it-guide/ 
- 
					
					
					
					
 I wonder what kind of bots or crawlers you were seeing before because we have millions of visitors in our analytics set-ups, no filters to filter them out and we barely see any traffic coming from browsers or hostnames that may be identified as such. 
- 
					
					
					
					
 You may have already tried this (https://megalytic.com/blog/how-to-filter-out-fake-referrals-and-other-google-analytics-spam) as I believe it is one of the more common articles, but it suggests setting up a filter to use hostnames and testing it with a segment. This has worked well for us. You have to be careful and make sure you use ALL the relevant hostnames and that your expression doesn't contain errors. 
- 
					
					
					
					
 What filters do you have setup? Generally, I prefer to set up two views on an Analytics property, one containing all of the data, and one with filters. This way if the filtered data is looking lower than expected, there's still the complete view to compare against. It also makes it easy to test the efficacy of the filters that were created. 
Browse Questions
Explore more categories
- 
		
		Moz ToolsChat with the community about the Moz tools. 
- 
		
		SEO TacticsDiscuss the SEO process with fellow marketers 
- 
		
		CommunityDiscuss industry events, jobs, and news! 
- 
		
		Digital MarketingChat about tactics outside of SEO 
- 
		
		Research & TrendsDive into research and trends in the search industry. 
- 
		
		SupportConnect on product support and feature requests. 
Related Questions
- 
		
		
		
		
		
		Unsolved The Moz.com bot is overloading my server
 0
- 
		
		
		
		
		
		How Can I Solve a Spam Score Of 33% On A Site
 Goof Day pls Am having S Spam Score Of 33% On my Blog Naijazeal.Com And I Check In my Google webmaster and i analyze all the link i see and i see little with high spam Score But Checking My Spam Score on Moz, It showi Extermal link below but most of the link showing below is not in my Seach console Pls help Moz Pro | | DAMIDEZ0
- 
		
		
		
		
		
		WEbsite cannot be crawled
 I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is? Moz Pro | | threecounties0
- 
		
		
		
		
		
		Crawlers crawl weird long urls
 I did a crawl start for the first time and i get many errors, but the weird fact is that the crawler tracks duplicate long, not existing urls. For example (to be clear): there is a page: www.website.com/dogs/dog.html but then it is continuing crawling: Moz Pro | | r.nijkamp
 www.website.com/dogs/dog.html
 www.website.com/dogs/dogs/dog.html
 www.website.com/dogs/dogs/dogs/dog.html
 www.website.com/dogs/dogs/dogs/dogs/dog.html
 www.website.com/dogs/dogs/dogs/dogs/dogs/dog.html what can I do about this? Screaming Frog gave me the same issue, so I know it's something with my website0
- 
		
		
		
		
		
		Problem crawling a website with age verification page.
 Hy every1, Need your help very urgent. I need to crawl a website that first has a page where you need to put your age for verification and after that you are redirected to the website. My problem is that SEOmoz, crawls only that first page, not the whole website. How can I crawl the whole website?, do you need me to upload a link to the website? Thank you very much Catalin Moz Pro | | catalinmoraru0
- 
		
		
		
		
		
		How to force SeoMoz to re-crawl my website?
 Hi, I have done a lot of changes on my website to comply with SeoMoz advices, now I would like to see if I have better feedback from the tool, how can I force it to re-crawl a specific campaign? (waiting another week is too long :-)) Moz Pro | | oumma0
- 
		
		
		
		
		
		How long does a crawl take?
 A crawl of my site started on the 8th July & is still going on - is there something wrong??? Moz Pro | | Brian_Worger1
- 
		
		
		
		
		
		Seomoz Spider/Bot Details
 Hi All Our website identifies a list of search engine spiders so that it does not show them the session ID's when they come to crawl, preventing the search engines thinking there is duplicate content all over the place. The Seomoz has bought a over 20k crawl errors on the dashboard due to session ID's. Could someone please give the details for the Seomoz bot so that we can add it to the list on the website so when it does come to crawl it won't show it session ID's and give all these crawl errors. Thanks Moz Pro | | blagger1
 
			
		 
			
		 
			
		 
			
		 
			
		 
					
				 
					
				 
					
				 
					
				 
					
				 
					
				 
					
				