How To Automate Screaming Frog Crawl Reports In Data Studio

screaming frog data studio
Isaac Adams-Hands · How To Automate Screaming Frog Crawl Reports In Data Studio

Would you like to automate your Screaming Frog crawl reports in Data Studio? This blog post will show you how to do just that! We will walk you through the steps needed to connect your Screaming Frog account with Data Studio and create a report that will automatically update every time a new crawl is completed. Let’s get started!

How To Automate Crawl Reports In Data Studio

  1. Schedule a Crawl

    Schedule a Crawl

    With Screaming Frog open, go to File >> Scheduling.

  2. Name & Set a Date

    create a task

    Under General Settings of Create Task, enter a Task Name, Project Name, and a Date/Time you’d like the crawl to run.

    The Date/Time is when the crawl will run. Task Name will be used for the file name, and Project Name will be used for the Folder in G-Drive.

  3. Crawl Seed

    start options

    Enter the domain name you want crawled in the Crawl Seed settings under the Start Options tab.

  4. Export Crawl

    Select the headless option under the Export Tab.

    Pick a folder you’d like the file saved under

    If you haven’t already, add your Google Drive Account. When you click on the Manage button, a modal window will pop up and ask you to sign into your Google Account. After which it will ask you to allow Screaming Frog to make changes.

    sign-in with Google

    Allow all access and press continue.

  5. Selected Crawl Options

    selected

    The last setting is Export for Data Studio (Custom Crawl Overview) >> Configure.

    To keep this tutorial simple, select all (>>) settings.

  6. Crawl History

    After clicking Ok on the Create Task. Next, you will want to ensure your crawl has run before proceeding. You can find this under History. It’s important you see an End date and Duration, if that part is empty, the scan has not started or maybe it hasn’t completed yet.

  7. Check G-Drive File

    g-drive

    Once the crawl has run, check your G-Drive for the file. It will be saved under a Screaming Frog Folder. Then check the G-Sheet to ensure the data has been populated.

  8. Connecting to Google Data Studio

    data studio template

    You will need to make a copy of the Screaming Frog’s Google Data Studio template

    The Copy function is located in the top right corner of the template.

  9. Create Data Source

    create data source

    From the dropdown, select “Create Data Source”

  10. Google Sheets

    google sheets

    Select the Google Sheets Option.

  11. Connector Settings

    connector

    Select your Screaming Frog File saved in Google Drive as seen in the screen grab above.

  12. Date

    date

    Every Type should be set as a Number, EXCEPT Date, the Date row needs to set as Date.

  13. Chrome UX report

    chrome UX report

    Now that you have the first source set, leave the Chrome UX Report as is, Screaming Frog will prompt you after you click Copy Report.

  14. Authorize Chrome UX Report

    Authorize Chrome UX Report

    As the template copies, a modal window will pop up. Click Authorize Chrome UX Report.

  15. View Crawl Overview Report

    Report

    Now the Screaming Frog template has copied over, you can view your scan results in data studio.

Conclusion

We hope you found this tutorial helpful. If you have any questions, please don’t hesitate to reach out to us. And be sure to check back often for more tutorials and tips on how to get the most out of your Data Studio account.

FAQ

  • What is Screaming Frog used for?
  • How does Screaming Frog improve SEO?

Published on: 2022-09-16
Updated on: 2024-09-16

Avatar for Isaac Adams-Hands

Isaac Adams-Hands

Isaac Adams-Hands is the SEO Director at SEO North, a company that provides Search Engine Optimization services. As an SEO Professional, Isaac has considerable expertise in On-page SEO, Off-page SEO, and Technical SEO, which gives him a leg up against the competition.
en_CAEnglish