Clicky

X

Subscribe to our newsletter

Get the State of Digital Newsletter
Join an elite group of marketers receiving the best content in their mailbox
* = required field
Daily Updates

How to Check if Google Analytics Is Installed On Every Page using Screaming Frog

6 December 2011 BY

44 Flares Twitter 2 Facebook 0 Google+ 42 LinkedIn 0 Buffer 0 Email -- StumbleUpon 0 Pin It Share 0 Filament.io 44 Flares ×

Working with clients with hundreds of thousands of pages on their website is a cumbersome task to keep on top of; Ensuring that your analytics code, be it Google Analytics, CoreMetrics or any other analytics package, is present on on every page is another thing entirely.

During a project I encountered the possibility that Google Analytics was not installed on every page of a client’s website. Unfortunately, the solution I previously relied on (SiteScanGA) is no longer available and whilst there are great tools out there for checking if GA is installed on an individual page (e.g. GA? For Firefox) there is not an easy, non-enterprise way to check if Google Analytics is installed on every page.

Thankfully there is a solution to this problem by using Screaming Frog’s SEO Spider, Excel and a little jiggery-pokery.

Setting up Screaming Frog

By default, Screaming Frog allows you to search for custom variables and you can easily check if a page does not contain your analytics code.

Before you start a crawl with Screaming Frog, you’ll need to add a custom filter.

  1. Go to Configuration -> Custom
  2. In the box for Filter 1 paste your UA code and select Does Not Contain
  3. In the box for Filter 2 paste your UA code and select Contains

NB. Filter 2 is required for Excel filtering method later in this article.)

Now you are free to start the crawl on the domain name you want to check. For the purposes of this How-To, I’ve used my own website as an example.

Exporting the Data

Once the scan is finished, you can now click on the Custom tab on the right hand side and you should be able to see a list of pages that do not contain your Google Analytics code.

To export your data, ensure the export filter is set to Filter 1, export and save the custom_filter_1.csv file.

And that’s it; you now have all the data you need to check if Google Analytics is installed on every page of your website.

Checking Which Pages Are Missing Google Analytics with Excel

If you want to create a list of all pages on your website and filter them accordingly depending on whether Google Analytics is installed or not, I have created a custom Excel document that should make it easier for you to analyse the information from Screaming Frog. Download the Pages Missing Google Analytics Excel workbook, and using the following instructions you should be able to create an actionable list of all pages to send to your web developers to rectify the problem of pages missing Google Analytics.

Exporting Your Data

If you had setup Screaming Frog with both filters in place, then you already have your data. If that is not the case, you will have to add the second filter and run the scan again (sorry).

Once you have your data, you will need to export the right data. This is achieved in two stages within Screaming Frog.

Firstly, whilst in the internal tab, change the export filter to HTML, export and save internal_html.csv file.

Secondly, go to the Custom Tab and whilst ensuring the export filter is set to Filter 2, export and save the custom_filter_2.csv file

Importing Your Data

Using both of the files exported from Screaming Frog, we can start to import the data. The instructions make the process seem quite lengthy, but trust me, it’s not. In less than a minute you will have a fully functioning filtered list of pages with Google Analytics status.

Internal HTML

Firstly open internal_html.csv. We need to copy & paste the data from this file into our workbook. To do this simply:

  1. Click in the first cell A1 in your internal_html.csv file
  2. Either Press CTRL + A to select all.
  3. Then press CTRL + C to copy.
  4. Go to the Pages Missing Google Analytics Excel workbook and click on the “Internal HTML” tab.
  5. Click in cell A1
  6. Press CTRL + V to paste.

Pages Containing Analytics

Secondly open custom_filter_2.csv. Again, we need to copy & paste the data from this file into our workbook.  To do this simply:

  1. Click in the first cell A1 in your custom_filter_2.csv file.
  2. Either Press CTRL + A to select all.
  3. Then press CTRL + C to copy.
  4. Go to the Pages Missing Google Analytics Excel workbook and click on the “Pages Containing Analytics” tab.
  5. Click in cell A1
  6. Press CTRL + V to paste.

Sorting Your Data

Now we have the data in place, click on the “Pages with No GA” tab and press F9. This calculates formulas just in case Microsoft Excel has them turned off by default.

Now, you should have a list of pages in a filtered list allowing you to sort by whether Google Analytics is in fact installed or not.

Click the Drop down arrow on GA installed and select/deselect what you want to filter by.

As a side note, this workbook checks a minimum of 2,959 pages (random number ftw!).  I recommend disabling “(Blanks)” in the GA Installed column to make viewing easier.  Also, if you want to expand how many pages the filter contains, simply select the bottom-right corner of the table (currently cell C2965) and drag down however many more rows you need.

And that’s it; you can now take a look through the pages that are missing Google Analytics easily and on a large scale level.  If you need any help with the tutorial, please feel free to contact me.

kevin-strongAbout the Author, Kevin Strong

Kev Strong is an online marketing consultant at Newcastle Upon Tyne based digital marketing agency, Mediaworks. A lover of all things search and an ex-web developer, Kev Strong (a.k.a Goosh) is a specialist in advanced search engine optimisation.

AUTHORED BY:
h

This post was written by an author who is not a regular contributor to State of Digital. See all the other regular State of Digital authors here. Opinions expressed in the article are those of the contributor and not necessarily those of State of Digital.
  • http://www.jackiehole.com Jackie Hole

    Now there’s a tech post and a half! Thanks for the info – cracking! :-)

  • http://www.lonestarseodirect.com Mike Wear

    Thank so for sharing information about easiest way to implement Google Analytic s code in each page , i will try to implement this technique using screaming frog

  • http://www.koozai.com Sam Noble

    Excellent post, thanks Kev!! Something that will help all SEO’s, one to share :)

  • http://www.seerinteractive.com Rachael

    I have to laugh – I’ve been working on the same post after sharing this with our team a few weeks ago! Guess great minds think alike? :)

    I’ve also been using the tool to see if any custom GA code is included or missing. Your post was very well put together, thanks for sharing!

    • http://www.kevstrong.com Kev Strong

      Rachael, that is indeed spooky. Glad people are already using Screaming Frog for things like this, and thanks for the kind words.

      • http://www.seerinteractive.com Rachael

        No problem, thanks for putting together such a great resource! I’ve already pointed a few people here.

  • Jackson Gilbert

    Thanks.. Thats a great information ..
    Tried to do the same… But sad to note that this option is is not available in the free version…

  • http://sjoerd.jongmans.info Sjoerd Jongmans

    I like this method very much, thank you.

    The only thing to keep in mind: it probably won’t check for GA-code on pages which aren’t crawlable by Screaming Frog, like success pages linked to with JavaScript / forms / user logins etc.

  • Pingback: Web Site Migration Guide – Tips For SEOs()

  • Pingback: Web Site Migration Guide – Tips For SEOs | Entrepreneurs ToolBox()

  • Pingback: Web Site Migration Guide – Tips For SEOs | Montachusett Internet Marketing()

  • Pingback: Web Site Migration Guide – Tips For SEOs « Webmaster Tools Selection()

  • Pingback: Web Site Migration Guide – Tips For SEOs | |()

  • Pingback: Web Site Migration Guide – Tips For SEOs | CS5 Design()

  • Pingback: Web Site Migration Guide()

  • Pingback: SEO Site Migration Guidelines - A to Z Guide on SEO Best Practice()

  • http://www.oneresult.co.uk/ lizstraws

    This a great post – have been trying to find an alternative to SiteScan GA for a while. Looking forward to finding out what other tips and tricks Screaming Frog can be used for.

  • http://twitter.com/martijnbeijk martijn beijk

    Hi Kev, 

    Working with clients that have hundreds of thousands of pages, how do you think this tool compares in terms of performance? How long would it run to crawl hundreds of thousands of pages (before it runs out of memory? is that possible?). 

    • http://www.goosh.co.uk/ Goosh

      Hi Martijn, 

      I’ve seen some problems with crawling E-commerce sites – particularly those with faceted navigation implemented incorrectly.  One bug I know of is that Screaming Frog will simply crash and close if it gets too memory intensive.

      What I tend to do is to crawl folders or departments using the regex include/exclude options from Screaming Frog and narrow it down that way.
      http://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/

  • Peter

    CompeteMonkey follows javascripts of Google Analytics, but also of other tools. It’s free.

    http://competemonkey.com

  • Pingback: Filtering out the noisy robots – Google Analytics()

  • http://www.getdiscountcoupon.com/ Kathy J. Lowrey

    Hi

    Very nice article shared.

    I have a question about Google Analytics Content Experiments.

    My goal type is currently URL Destination.
    And we push conversions manually to analytics after phone call matching, normally it takes one day.

    We use this code for pushing conversions.

    var _gaq = _gaq || [];
    _gaq.push([‘_setAccount’, ‘XX-XXXXXXXX-X’]);
    _gaq.push([‘_setAllowAnchor’, true]);
    _gaq.push([‘_trackPageview’,’/www.getdiscountcoupon.com/stores/’]);

    What I want to know is how do I push a conversion manually for a specific variation.

    Thanks in advance for help.

  • Pingback: Guida Google Analytics Per Web Marketer()

  • http://www.thetwopercent.co.uk Jim

    Unfortunately it doesn’t look like Screaming Frog allows you to do this custom search type in the free version of the software any more. Any other suggestions?

  • Pingback: Inaccurate Google Analytics: Traffic Sources, Setup Mistakes and Fixes | Orbit Media()

  • http://www.kwentology.com Michael

    A really helpful and informative post. This could be a good reference.

  • Kash

    May be for checking multiple pages containing Google analytics… “Checklytics” seems to be the solution… http://crinz.com/checklytics/

  • Josh Kellett

    This is a great option, and one I use all the time. For those of you who don’t have a Screaming Frog subscription, I made a free tool that does essentially the same thing: http://www.gachecker.com
    Thanks for the post Kev!

  • Pingback: Fast is Fine but Accuracy is Everything | SEO HUB()

  • Pingback: Stop Believing Data You See in Your Google Analytics: Here is Why? | Search Engine Lead()

44 Flares Twitter 2 Facebook 0 Google+ 42 LinkedIn 0 Buffer 0 Email -- StumbleUpon 0 Pin It Share 0 Filament.io 44 Flares ×