Does anyone know how to get around Serper.dev status 400 error. It's saying i have the wrong URL parameters but it works in Serper.dev but not clay. I'm trying to do a linkedin webpage scrape.
To resolve the status 400 error when scraping LinkedIn webpages in Clay, ensure you're using the correct URL format and method. For LinkedIn profile scraping, use our integration with Sales Navigator: 1. Go to Method Filter > Select External List 2. Paste your Sales Navigator search URL in the Query section 3. Use full URLs, including https:// (e.g., https://www.linkedin.com/in/username/) Note: LinkedIn Sales Navigator links aren't supported for direct scraping. If you're using the Clay Chrome Extension, make sure you're on the correct page and using the "Select Data to Add from Page" feature.
Was that helpful?
what is issue
can you show your serper.dev inputs in clay?
a screenshot?
The status 400 error when scraping LinkedIn webpages in Clay is likely due to incorrect URL parameters. To resolve this issue: 1. Use our Sales Navigator integration instead of direct LinkedIn scraping. 2. Go to Method Filter > Select External List. 3. Paste your Sales Navigator search URL in the Query section. 4. Ensure you're using full URLs, including https://. Note that Clay doesn't connect directly to LinkedIn accounts and relies on public web scraping. If you need additional data, consider using Claygent, our built-in AI research tool with web access, for best results.
Was that helpful?
I apologize, but I can't provide a screenshot directly. However, I can guide you on setting up the Serper integration in Clay: 1. Create a Serper.dev account and get your API key. 2. In Clay, set up an HTTP API call column. 3. Use the following parameters in your column setup: • Endpoint: [Your Serper endpoint] • API key: [Your Serper API key] (in the header) • Headers: As specified in Serper's cURL structure • JSON body: Copy from Serper's cURL example Remember to compile your Google query using a formula, as only one dynamic token can be input in the API body. For more detailed instructions, you can check our integration guide for Serper on the Clay website.
Was that helpful?
To set up and use Serper.dev inputs in Clay for your integration, follow these steps: 1. Create a Serper.dev account and obtain your API key. 2. In Clay, set up an HTTP API call column. This requires an Explorer plan or higher. 3. Configure your HTTP API call column with the following parameters: • Endpoint: Use your Serper endpoint • API key: Include your Serper API key in the header • Headers: Copy from Serper's cURL structure • JSON body: Use the structure from Serper's cURL example 4. When setting up your query, compile it using a formula. Note that only one dynamic token can be input in the API body. 5. In the "Configure" section of the enrichment side panel, provide the required input parameters for your Serper integration. 6. Use the "Define Outputs" section to specify how you want the response formatted, either as individual fields or in a JSON schema. For more detailed instructions, refer to Clay's integration guide for Serper on their website.
Was that helpful?
Looks like you're still looking for help.
If you’re dealing with a specific table, drop the URL below so we can help you quicker. Otherwise, someone from our team will be in touch soon!
can you show me values in NEW COLUMN? maybe copy paste one here?
site:Linkedinprofile
what you are trying to do?
This endpoint is expecting a complete URL
https://www.clay.com if your input is not liek this it will error out
also you need to put the data in body
not in query
it is
this is not a url
its a string
this is incorrect
url starts from http or https
I'm trying to check if my leads are still at the company. it use to work, not sure why its not working.
not from site:
this approach will always throw a 400 error
because its a bad input
against this end point
I tried it without "site" and i get the same error message
what do you rec ?
when i do a google scrape using serper i use this : https://google.serper.dev/search
message me
even
huddle me
Hi hanad, thanks for reaching out. Taking a look at this now!
In order to integrate with Serper's APIs you'll need to set up an HTTP API calling the Serper endpoint which you're targeting - in this case the search endpoint. You can follow these steps to implement the Serper integration: 1. Retrieve your Serper API key: Make an account at https://serper.dev/ and retrieve your unique API key:
2. Select playground, then code, and look at the cURL structure - here you'll be able to retrieve your endpoint, your API key, headers and JSON body structure:
3. Set up an HTTP API call column in Clay, and copy the same cURL parameters in your column setup. Here's how you can set up an HTTP API call in Clay. In this specific use case, your HTTP column should look something like this, with your API key included in the header structure:
Please note that you'll have to compile your google query using a formula, as you can only input a single dynamic token in the API body. Save and run the column - this should run the column and return your google query results!
Let me know if you're able to resolve your configuration issue here - otherwise happy to jump into your table and take a look at what my be happening here. Do you mind sending the link (url) to the table so we can take a look?