Using Clay to Scrape App Reviews on Playstore & iOS: Is it Possible?

Ruann v.

Is there a way to use clay to scrape reviews of apps in Playstore or iOS?

37 comments

Clay Team
APP
·
·
Hi Ruann, thanks for getting in touch!
Clay Team
APP
·
·
You can do that through twith a web search + scraping + AI
b097d0e7-e5a7-47b3-8889-bc8627d4d338.png(24 kB)
Clay Team
APP
·
·
This are the steps: 1. web search
60f34aa5-73d4-445d-8fae-461092f44485.png(26 kB)
Clay Team
APP
·
·
2. scrape the web
b593310b-0aac-4dfe-9ab8-34ced5d43bf6.png(51 kB)
Clay Team
APP
·
·
3. use AI to get a valuable output
5f3e1cf5-da50-46cd-905b-b8ba5d23a6a6.png(82 kB)
Ruann v.
·
·
This is great!
Ruann v.
·
·
Would I be able to pull the actual review?
Clay Team
APP
·
·
Yes, just adjust the prompt, as long as its in the body of the text the AI can summarize it
Ruann v.
·
·
Awesome thanks!
Ruann v.
·
·
Hey Juan P. can you take a look and see what I did wrong with this table?
Ruann v.
·
·
https://app.clay.com/workspaces/206692/tables/t_KiyuYkX5UQH1/views/gv_RQweKFDbbLs7
Clay Team
APP
·
·
Hey Ruann! jumping in here to check on this
Ruann v.
·
·
Thanks Arturo
Clay Team
APP
·
·
We can also try with Claygent, what type of reviews were you looking to extract? Maybe we can prompt it to check the first link Google returned and return 1-3 reviews or a summary of them
Ruann v.
·
·
I'm just looking to extract the 4 stars
Ruann v.
·
·
Sorry the Star number
Ruann v.
·
·
and the number of reviews
Ruann v.
·
·
Any app that has less than 4 stars is basically what I'm looking for
Clay Team
APP
·
·
got it! Let me try with a formula instead of chatGPT
Ruann v.
·
·
ok sounds good
Clay Team
APP
·
·
Looks like chatGPT was easier because the structure of the data was a bit more complex for the other scraper to predict. The outputs look a lot better now, you can check the prompt :) I also added those credits back into the account
Ruann v.
·
·
Thanks Arturo. Can you share the prompt here as well?
Ruann v.
·
·
For the rows where the error is popping up is that because the data is incorrect?
Ruann v.
·
·
If I click on the cell details and click on the link it actually does provide a review but from a different source
Ruann v.
·
·
Same goes for Caradvise row 11
Clay Team
APP
·
·
Yeah, the prompt is actually in your chatGPT column, you can check it by clicking on the column header -> Edit Column and it should come up
Clay Team
APP
·
·
Oh, odd, I thought I also replied about the rest but apparently it didn't save... It appears some of those first links that google returns aren't valid and since the scraping tool can only scrape one URL at a time, we'd have to either set a second scrape with the next link to see if it returns more info
Ruann v.
·
·
Gotcha. Ok How would I do it to set up a second scrape?
Clay Team
APP
·
·
You need to set different columns scraping links 0,1,2...
0caf04e9-23ef-4754-8c87-a260eadbd2ff.png(19 kB)
6dbe2a59-bab2-430d-a552-79a72be5995c.png(19 kB)
🔥1
Clay Team
APP
·
·
Yep! Adding another scraping column and selecting the next link from the source would be it... it can be given conditional formulas to check if the previous one didn't return enough information. Otherwise, we could still try with Claygent and a similar prompt from chatGPTLet us know if you need help there!
Ruann v.
·
·
Cool thanks guys!
Ruann v.
·
·
There isn't a way to scrape all search results?
Clay Team
APP
·
·
In a single column, no. Most tools only take 1 input at a time, but Claygent uses AI and may be the exception, but the prompt would have to be very clear to achieve consistency
Ruann v.
·
·
Ok how would I do that with Claygent?
Clay Team
APP
·
·
Same process like with AI:
30173b0c-a52e-4c2c-8569-9d95d91b0be2.png(26 kB)
Clay Team
APP
·
·
At the end Claygent is a combination of web scraping+AI so you will save credits
Clay Team
APP
·
·
Its worth reading this guide in order to refine your prompts: https://clayrun.notion.site/AI-for-Sales-Prospecting-A-Complete-Guide-d05d8335bdd4402f8e8a4771f83ec166