Looking for some prompt assistance/suggestions. I have a list of business directory listing url's, each containing company information. I'm trying to use claygent to visit each url, find the domain on the listing, and return it. For example: https://www.houzz.com/professionals/general-contractors/tg-construction-and-design-inc-pfvwus-pf~2084298713 Unfortunately, I keep getting 'No data found', even though the website is clearly listed on the url's webpage. Could this be an issue because the website is hyperlinked and not plain text? Any other suggestions as to why this may not be working? Here is my prompt:
{listing url} is a business listing that contains information on {company name}
Your job is to analyze the listing's entire webpage to find a website for the company. It is usually present in the business details section and could be hyperlinked text. If it helps, look for text that contains .com, .net, or other possible website domain suffixes. Additionally, do not return any domains that contain houzz.com
👋 Hey there! Our support team has got your message - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in this thread so that we can help you as quickly as possible!
Hey Charlie, thanks for the message and reaching out! Great use case, and makes sense! Different AI tools have a way of running searches themselves and how much data they can scrape given how they iterate for data, which we know can be complicated to predict. For OpenAI and Claude models, I often like to add a Google search request as a fallback. I tested and modified your prompt in my workspace using 4o-mini and got more results, but Claygent Neon was able to 100% scrape the sample with it's own method and correct outputs. chatGPT Prompt: Visit {Company Domain} and only return the Website for the company mentioned in that profile. The Website field is present in the 'Business Details' section of the page next to Business Name, Phone Number, or Address. You can also try Googling for that value if you can't see it in the page. For example, the company's name + address + website, return the closest match, especially if the address/location is probably the same. Don't return anything else other than the exact domain or website mentioned in that section, otherwise say "Not found" if it's not available. https://downloads.intercomcdn.com/i/o/1174510231/af900c60965d7dba23204116/image.png?expires=1725929100&signature=844513d6dfe41952cbbc3c37fadea0a53808d7f81c9af8e1f3e07bc624280a9d&req=dSEgEsx%2FnYNcWPMW1HO4zQI7RwCxKmWRSiDUfkSlHPawQ3O2ah3phETJXdQz%0AzWzz%0A Hope that helps!
Thanks for the prompt and explanation! This makes sense now. There seems to be a lot of nuance with writing prompts, which was frustrating last night. I really appreciate you guiding this in the right direction!
Hey there - just wanted to check in here to see if you needed anything else! Feel free to reply back here if you do.
We haven't heard back from you in a bit, so we're going to go ahead and close things out here - feel free to let us know if you still need something!
Hi Charlie S.! This thread was recently closed by our Support team. If you have a moment, please share your feedback:
Thank you so much for sharing your feedback Charlie S.!