Clay Icon

Troubleshooting Low Count for Number of Blog Posts Field in Sitemap Scraper

·
·

so, I used the sitemap scraper to identify the number of links and then in another column asked for an enrichment to ID how many of those links included “blog,” but the numbers in that field are very low. I manually checked a few of those sitemaps and the links with “blog” in the link path are much, much higher. Can someone tell me what I messed up (field is [Number of Blog Posts])? https://app.clay.com/workspaces/183442/tables/t_bv0SFLZYxfhb/views/gv_tREnTcHMZS4a

  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·
  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·

    We cap results to 300

  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·

    as it’s just way to much data to load if you’re searching broad

  • Avatar of Matthew Q.
    Matthew Q.
    ·
    ·

    If you’re looking for a specific keyword though I’d run the sitemap again like this:

  • Avatar of Nick Z.
    Nick Z.
    ·
    ·

    Yeah, that’s how I have it setup. It’s the cap I didn’t know about, but understood.