Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Find Pages with 0 traffic
-
Hi,
We are trying to consolidate the amount of landing pages on our site, is there any way to find landing pages with a particular URL substring which have had 0 traffic?
The minimum which appears in google analytics is 1 visit.
-
This is a really nice solution! Thanks for sharing. It's super quick as well, so a GA export and a few VLOOKUPs/pivots later and you're sorted - nice one!
-
No problem my friend : -))
-
My bad. I misunderstood and misread. Thanks for the update.
-
He is trying to consolidate or find the total number of landing pages that do not have any traffic at all. So, screaming frog seo spider can be used to crawl the entire website (with the substring in the URLs) and substitute the URLs that have driven at least 1 visitor. He is not trying to get a hold of his historic or old analytics data. The question is pretty straight forward unless I missed something.
-
Yes, but how does that help him get the old data he needs? Crawlers shouldn't know your traffic unless you install the code they give you or verify some other way. Find it to be a crawler causing the problem unlikely unless I misunderstood the problem/question. I sure hope they have a Linux host (most are) and can just check the apache logs while Google Analytics takes a few days to update.
-
What webhost are you using? Most keep analytics software enabled by default or at least lets you turn it on. (While you wait for Google.) Analytics are a key part to SEO so I use awstats (free), and webalizer. With most hosts if not enabled its as easy as clicking a button.
Depending on your host, you might be able to get the raw log info, but most hosts don't have this option unless you paid for a fancy account which allows root shell access, but maybe not it differs from site to site.
Google Analytics will only show 1 visit if you are the only visitor even if you refresh the page or come pack. It saves your IP address and hardware profile most likely is the method they use. Make sure you change Google Analytics to display as far back as possible.
-
Hi, you can use a crawler like Screaming Frog SEO Spider to come up with total number of pages with some unique string in the URLs, substitute the URLs that have traffic from these and the rest will be ones with no traffic.
You will have to use the paid version of Screaming Frog SEO Spider if you want to crawl more than 500 pages and here is the section of the user guide that tells you how to do a regex crawl:
http://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/#9
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
50% Drop in ALL Traffic Post June Update
We've had 50% drop in Google and Direct traffic post June Google update. Why would direct suddenly plummet as well? Could it be something with Google tag manager or our new cookie policy and cookie management system? Any help would be greatly appreciated as I am a disabled person and trying to figure out what is going on with our site
Reporting & Analytics | | inhouseninja0 -
Dark Traffic Mystery!
Hey everyone, My team and I have been digging into this problem and can't find an answer - and it turns out this has been an issue for over year. I'll try to explain the best I can, but let me know if you have any questions. My predecessor noticed a non-existent page URL getting traffic in GA. He had the web dev team create a page so he could see where the traffic is coming from. The page has every directive under the sun on it; noindex, nofollow, noarchive, nosnippet, noodp, noydir, noimageindex, notranslate All of the traffic is (direct) / (none). It gets about 300 visits per day. Avg. time on page is 15:40, bounce rate is 99.6% and it doesn't show up in the funnel. Previous page path is 92% entrance; 8% homepage. Geo is 92% US; then diversified across countries. Browser is predominately Chrome. OS is only Windows, and device is only desktop. I've run this page through a backlink checker, and we get nothing. I've run it through Screaming Frog and it has no internal links pointing to it. I've tried putting quotes around the URL and googling it and we get a few websites, but they're very low authority and it isn't likely that they're sending 300+ visits per day. Also, since all of the traffic is direct, I don't think it's coming from a backlink anyway. This has become a personal quest for several of us, as we really want to figure out where that traffic is coming from. Any thoughts? What am I missing? It's kind of driving me crazy because I can't figure out what I've missed, so if anyone figures this out and is coming to Pubcon in November, I'll buy you a beer!! 🙂
Reporting & Analytics | | rachelmeyer0 -
Help Blocking Crawlers. Huge Spike in "Direct Visits" with 96% Bounce Rate & Low Pages/Visit.
Hello, I'm hoping one of you search geniuses can help me. We have a successful client who started seeing a HUGE spike in direct visits as reported by Google Analytics. This traffic now represents approximately 70% of all website traffic. These "direct visits" have a bounce rate of 96%+ and only 1-2 pages/visit. This is skewing our analytics in a big way and rendering them pretty much useless. I suspect this is some sort of crawler activity but we have no access to the server log files to verify this or identify the culprit. The client's site is on a GoDaddy Managed WordPress hosting account. The way I see it, there are a couple of possibilities.
Reporting & Analytics | | EricFish
1.) Our client's competitors are scraping the site on a regular basis to stay on top of site modifications, keyword emphasis, etc. It seems like whenever we make meaningful changes to the site, one of their competitors does a knock-off a few days later. Hmmm. 2.) Our client's competitors have this crawler hitting the site thousands of times a day to raise bounce rates and decrease the average time on site, which could like have an negative impact on SEO. Correct me if I'm wrong but I don't believe Google is going to reward sites with 90% bounce rates, 1-2 pages/visit and an 18 second average time on site. The bottom line is that we need to identify these bogus "direct visits" and find a way to block them. I've seen several WordPress plugins that claim to help with this but I certainly don't want to block valid crawlers, especially Google, from accessing the site. If someone out there could please weigh in on this and help us resolve the issue, I'd really appreciate it. Heck, I'll even name my third-born after you. Thanks for your help. Eric0 -
How to safely exclude search result pages from Google's index?
Hello everyone,
Reporting & Analytics | | llamb
I'm wondering what's the best way to prevent/block search result pages from being indexed by Google. The way search works on my site is that search form generates URLs like:
/index.php?blah-blah-search-results-blah I wanted to block everything of that sort, but how do I do it without blocking /index.php ? Thanks in advance and have a great day everyone!0 -
Will 301 redirects (Same Domain) show as referral traffic in Analytics?
For an eCommerce site we have 301'd legacy product pages to new product pages. Is all that traffic going to show up as referral traffic from our own domain in Google Analytics? If so, is there any way to preserve original source/medium info or will all the source/medium info be our own domain since there is a 301 redirect?
Reporting & Analytics | | bozzie3111 -
Has Anyone Else Noticed A Jump In Google Analytics Traffic Since Session Parameters Were Changed?
Ever since Google Analytics changed their session parameters August 12th I have seen a 20% jump in organic traffic & bounce rates along with a decline in pages/visit and conversion rate. To be clear, I don't put a whole heck of a lot of stock in these metrics as stand-alone indications of how my site is performing. I'm just trying to get to the bottom of this blip. I noticed some other people mentioned a similar phenomenon in other SEO forums and blog comments, but nobody seems to be talking about this here at SEOMoz (unless I just haven't looked in the right place). I'm not saying the change I noticed has anything to do with the session update, I'm just wondering if anyone else has experienced something similar so that I can either cross it off the list of possible causes or explore further.
Reporting & Analytics | | eTundra0 -
Abnormal Spike in Traffic- Ddos or what?
We've noticed a 100% increase in our traffic over the last three days. However, the page views have not increased proportionately. The traffic sources seemed to be dispersed naturally. Could this be a Ddos in the making or some other type of attack as it seems unlikely that we suddenly started receiving thousands of extra visitors. Its a leading news website with a consistent heavy traffic daily which just doubled over the last three days. What should we be looking at?
Reporting & Analytics | | RishadShaikh590 -
Why does Google Analytics think PPC traffic is organic?
I have a bastard of a problem... Google Analytics is incorrectly tracking PPC traffic as SEO which is screwing up all my reporting . I don't care for rankings, I care for actual SEO traffic and I can't be sure that what i am seeing is correct which is driving me nuts. Any ideas?
Reporting & Analytics | | Red_Mud_Rookie1