Claygent vs. GPT API: Which is Best for Web Scraping?

·Sep 28, 2024 09:27 AM·

Thanks John yes i am using as much as possible, but was advised to use Claygent for web scraping instead of GPT api key. Is it worth the Clay credits or do you think i should use GPT Api instead of Claygent Almost all my other enrichments are via APi

4 comments

· Sorted by Oldest

Andreas W.
·
·
Hey Carl W., let me unpack a bit: Claygent NEON uses a proprietary model, and you are correct in that you must use Clay credits to use that model. BUT, at the scale you’re doing this, it may be worth experimenting with and comparing NEON results to, let’s say, GPT 4o mini, which will be an order or magnitude (or two) cheaper. You may have to adapt some of the workflow logic, but it can absolutely pay off.
kunal g.
·
·
For at scale scraping, nothing beats zenrow For contextual scraping neon is good For basic regular scraping, 4omini is fine and good enough
➕1
1
Elias S.
·
·
Carl W. if costs is an issue then using either e.g. Apify or scraping tools like Octoparse or Zenrows like Kunal said may be interesting!
Wasif A.
·
·
Or still if you want one time custom solutions, I'll build for you using python.

Andreas W.
·
·
Hey Carl W., let me unpack a bit: Claygent NEON uses a proprietary model, and you are correct in that you must use Clay credits to use that model. BUT, at the scale you’re doing this, it may be worth experimenting with and comparing NEON results to, let’s say, GPT 4o mini, which will be an order or magnitude (or two) cheaper. You may have to adapt some of the workflow logic, but it can absolutely pay off.
kunal g.
·
·
For at scale scraping, nothing beats zenrow For contextual scraping neon is good For basic regular scraping, 4omini is fine and good enough
➕1
1
Elias S.
·
·
Carl W. if costs is an issue then using either e.g. Apify or scraping tools like Octoparse or Zenrows like Kunal said may be interesting!
Wasif A.
·
·
Or still if you want one time custom solutions, I'll build for you using python.