Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Is there a way to get a list of urls on the website?
-
For example, www.laskeimages.com
Outside of Google Search Console, is there another way?
-
You can run a "site:yourwebsite.com" search on google and see what is returned. Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.
A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.
-
slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc
-
If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.
The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.
Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should you set an hreflang if the website is only in one language
We have a website, which is written in British English. There are no other versions of the site in different languages and the website only serves a UK audience. We have not set an hreflang tag up. Is this something we would still need to do and what would the benefits (if any) be?
Local SEO | | HubMDP0 -
Should I Split Into Two Websites?
I'm creating a website for a new company that offers several related services. They want to have a main corporate website that has pages for all their services. However, they want to have a second website that only features a subset of those services. So they would have the same company name, same website template, but the smaller site would have a different domain name, different text/photos on the home page and be missing some pages from the main corporate site so that site would make them look more specialized. They would have separate marketing materials (brochures, business cards) that would have the website address and email address using the different domain name. They also want the smaller second site to come up on search results related to the services for that site and not the main site. Can this be pulled off without having a significant negative effect on ranking potential for either of the two site and also not risk a duplicate content penalty? It would seem you would have to add a robots.txt file that excludes indexing of the pages on the main site that are duplicating on the smaller site. However there is a potential big issue. The company is a local business. Nowadays the local results (Map + 3-pack) are as important if not more important, than the traditional organic results below the 3-pack (although I acknowledge they are related). For their Google Business Places, since they have two websites for the same company, they can only list one of the website. So if they list the corporate site, their not going to get in the local 3-pack for their specialized site for search terms. They may be able to live with this though since the main site will show ALL services. Comments? Ideas? Issues? Strategies?
Local SEO | | DJ10270 -
Best way to advertise cosmetic dermatologist on Facebook in the UK?
I have a client who owns a cosmetic dermatology clinic. Recently he's been trying to work more on his Facebook page, and has been attempting to boost his posts but they keep getting declined for this, that and the other. "No before and after photos", "Ad is sensitive in nature", etc. Nothing shady, he's a registered doctor and a member of the Royal College of Physicians in London and the Royal College of General Practitioners. Main treatments offered are things like Botox (which I know he can't legally advertise due to strict advertising standards in the UK), dermal fillers, lip fillers, non-surgical lifts. Just general non-surgical prescription-level cosmetic treatments. I don't have much experience in Facebook advertising, but this line of work seems particularly challenging to advertise on Facebook. Does anyone who has experience in advertising this type of business on Facebook have any general advice on what sorts of posts/ads have worked with them before?
Local SEO | | Ria_2 -
Local SEO Website Structure.
Hi everyone, This might be quite a long post so please bear with me. I am currently rebuilding my website. My previous website was built by a web designer and was very basic. 5 page html site consisting of home, services, gallery, testimonials, contact pages. None of them were great - thin content, not optimised as well as could be - no h1's etc. To be fair I knew nothing about websites and didn't bother much with the site. As a new business I used it simply as a place for people to visit for more information after receiving a leaflet and never bothered much about driving traffic to the site. A few years down the line and I have realised I need the website to be working for me as opposed to alongside me. I am building it myself via wordpress as web designer didn't want to work in wordpress. I have done my keyword research and I'm working on pages as we speak. Previously my homepage - around 80% of visitors landed here for my main keyword (driveway cleaning glasgow) as it was number 6 in the organic listing. With my services page appearing directly underneath in 7 for the same keyword. I have starting building a new page for that keyword which contains (driveway-cleaning-glasgow) in the url. I have 301'd my previous services page to this url. Now for my questions...
Local SEO | | sfrediktru8
My 2nd keyword based on volume is driveway cleaning. How do I optimise for this or will the (driveway-cleaning-glasgow) page rank for this also as the words are contained within this page? I plan on having the same structure for the remaining services - pressure-washing-glasgow, monoblock-cleaning-glasgow etc, etc. As I am building new pages for each service with location built in, where does this leave my homepage? Should I be targeting keywords for this page? It is still my strongest page and apart from the (driveway-cleaning-glasgow) page which will get some help from the 301 these are all new pages so I would expect perhaps initially to lose some traffic. But as I am not ranking well for anything other than the main 2 keywords mentioned above it can only be beneficial long term when google recognises the specific pages for each service. And when I start using Adwords I will have a specific landing page for each service. Any advice would be appreciated. Thanks0 -
Google cache is showing the wrong URL with CCTLD's
Hi Folks, At Lightspeed we decided to setup local websites with CCtld's. Momentarily we have issues with the Google cache. I'm not sure what's going wrong. For example if I check the Google cache of www.lightspeedhq.be in the Belgium Google it refers to www.lightspeedhq.nl. See link: https://webcache.googleusercontent.com/search?q=cache:fm0XIZ8sEe8J:https://www.lightspeedhq.be/+&cd=2&hl=nl&ct=clnk&gl=be We have the same problem for our www.lightspeedhq.co.uk website, which is referring to www.lightspeedhq.com: https://webcache.googleusercontent.com/search?q=cache:OXdAIIFa7AYJ:https://www.lightspeedhq.co.uk/+&cd=1&hl=en&ct=clnk&gl=uk Does Google sees it as duplicate content? Or don't we have to use 'Alternative Hreflang'? A week ago we changed our canonical links which were actually randomly referring from .be > .nl and .co.uk to .com. What can we do now to make sure all is properly indexed? Best, Ruud
Local SEO | | Ruudst0 -
How to find best local websites?
For example, I'd like to type in a zipcode and get the highest ranking websites by DA/whatever metric the software uses, within a 25 mile radius? Does that type of service exist? I'm looking to build up our local links, but most of the websites have extremely low authority. I'm trying to find some good ones without having to manually check each one. Thanks, Ruben
Local SEO | | KempRugeLawGroup1 -
Two websites, same business name, same NAP
Hi, A client of mine offers loft conversions and wants to make a go of it. So he has a website dedicated to loft conversions. He is also a joiner/carpenter and has another old website which offers general joinery work and insurance work. Both websites have the same business name and same address and phone number. There is only one Google place page for the loft conversions website. The loft conversions website is not ranking as well as we would like locally. Could it be due to the same NAP? What are the best options? Redirect the old website to the loft conversions one (he might not like that idea) Change the address and phone number on one website?(and all subsequent citations?) Would love some help on this!
Local SEO | | AL123al0 -
How to remove countries viewing my website
Hi All, I operate from the UK only. How can I exclude select countries from viewing both my organic website and Google Adwords listing. Organic Website
Local SEO | | Mark_Ch
Are the any free online services that give you a simple click + download/view script to cut & paste into a .htaccess file. Google Adwords
Ditto as above with the exception to paste the IP list into Campaign | Setting Tab | Advanced settings - IP exclusions Thanks Mark0