Requesting Assistance with an HTTP Request Issue

💤 You've caught us outside of our support hours (9am-9pm EST), but don't worry - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in the thread below so that we can help you as quickly as possible!

Hey hey, thanks for reaching out! Of course, How can we help you out today? P.S. When you reach out to us, it's more efficient if you say the entire issue upfront because sometimes it can take us some time to see the message. This way, you will be able to get help more quickly.

yeah my bad, so its about getting a specific piece of code from the site

for exampel:

Right now I tested it like this but this also didnt give me any hits

I'm trying to find if they're using google cloud, azure or aws for their cloud hostings

right now it gives me this for every row

Can you send me the table url please? :)

Here it is https://app.clay.com/workspaces/238722/tables/t_Bj9caHxrRmAt/views/gv_aZojaD5YrZXC

happy to make a loom if that's easier 🙂

Ok, so I see you’re trying to call the website directly with a GET request. What’s your goal here? Typically, for an HTTP API, you’d use a specific endpoint (e.g., api.website.com) instead of calling the website directly. Could you clarify what you’re aiming to do? Here’s a helpful format: • Goal: What you’re trying to achieve. • Expected Results: What outcome you’re hoping for. Once I know more, I can guide you better! 😊

You're right haha that sounded vague

brb

Goal: find out if a company website had a specific piece of code, which would indicate they're using a specific cloud provider. Expected results: Help me setup the http request so that this is possible https://www.loom.com/share/5e8a2652299442e29ee0409a04e31a03

Got it! So, it sounds like you’re leaning away from using our Tech Stack app to save credits, right? Thanks for the Loom video—it was super helpful! I’d actually recommend sharing that from the start for clarity. The HTTP API approach you mentioned could definitely work, but it would need to run from your local machine, not from Clay. Since we don’t support Python, Node, etc. directly on the platform, here’s a possible workaround: 1. Set up the script on your computer. 2. Use Ngrok to expose your local server. 3. Call the Ngrok endpoint with the necessary info. 4. Have Ngrok return the response in JSON format. Keep in mind, though, if you make a lot of calls, it could burn your IP. There are also some other cheap API providers out there, but honestly, nothing beats the accuracy and cost-efficiency of our Tech Stack. Let me know what you think or if you need more details! 😊 https://downloads.intercomcdn.com/i/o/1188184542/54b9b1434c0ec997f7d87db8/CleanShot+2024-09-21+at+_5481kjdhkn%402x.png?expires=1726930800&signature=88a0cea2c43a40ec5ca794122e0e3e262910c155d88ada6fc4c632fc9be1e0d2&req=dSEvHsh2mYRbW%2FMW1HO4zXc4dFrTHM8ON5poOQnHALK4XNYnmEE3Hrdflvnl%0A33yR%0A

Yeah 100% tech stack is the best way to go, however, not every tech is listed on builtwith, and a lot of companies I'm reaching out to have that specific cloud provider code mentioned in the header. Do you happen to have the names of those alternative tools you mentioned? (besides Ngrok) Happy to check those out to see if it would allign with my needs.

Have you also tested PredictLead? As for cloud providers, I’ve seen a few APIs like Wappalyzer, WhatRuns, Netcraft, Spyse, and IpInfo that could be useful. You could also consider using Puppeteer to automate the same steps you showed me in the Loom video. It’s a powerful tool for scraping and interacting with websites. Let me know how that sounds or if you need help setting it up! 😊

Legendd thanks man!

Might circle back aroudn when I run into problems 🫣

Don’t worry, we’re here to help! 😊 Cheers!

Bo (. regarding puppeteer, can this be connected to clay? From what I could see this can only run locally?

Hi Hugo, thanks for reaching out! Just following up on Bo's message here, sorry about the delay. You can send data to a Clay webhook table directly from your Puppeteer script by making an HTTP request. After automating the desired actions with Puppeteer, you can gather the data and send it to your webhook using libraries like fetch or axios. Please note that implementing this solution will require proficiency in JavaScript to effectively code and customize your Puppeteer script. I hope this was helpful. If there's anything else I can assist you with, please let me know!

We haven't heard back from you in a bit, so we're going to go ahead and close things out here - feel free to let us know if you still need something!