Scraping Event Data: Extracting Panel Speakers and Details | Clay

Scraping Event Data: Extracting Panel Speakers and Details

I'm trying to scrape data from an events website - i.e. list out the panel speakers, their title, and company. When I click on any of the hyperlinked panelists names it directs me to a new page (but not a new url). Is there a way to search within the website and/or scrape certain data fields into a clay table? https://www.siop.org/events/the-annual-conference/attendee-info/schedule/

6 comments

Channeled
APP
·
·
To scrape data from the SIOP events website into a Clay table, you can use our Chrome extension. Here's how: 1. Install the Clay Chrome Extension. 2. Go to the SIOP events page. 3. Click on the extension and select "Select Data to Add from Page". 4. Choose "Select a List" and click on the first few panelist items. 5. Add attributes for each item (e.g., name, title, company). 6. The extension will apply this mapping to all items in the list. 7. Name and save your recipe. For pages that open without changing URLs, the extension can still extract data from the detected list on the main page. If you need to scrape data from individual panelist pages, you may need to create separate recipes for those pages. If you need further assistance, please request human help by clicking "Talk to a person" in this chat.
Sources: Clay Chrome extension | Documentation | Clay University Deep Dive: Clay Chrome Extension [Limitless Research] - Clay University
Anna C.
·
·
talk to a person
Anna C.
·
·
I'm having trouble even selecting an element on the page. If I 'inspect i' and search for the text element, I can find it - for instance, a person's name. But I can't just 'click' on any element. It's only showing the larger 'block element' as an option.
Bo (.
·
·
Hey there, The issue is that you're trying to scrape content inside a JavaScript iframe, which is challenging to access directly. These elements aren't easily selectable with standard methods. I'd recommend trying a specialized scraper like Apify that can handle JavaScript and iframe content properly. You can learn more about scraping iframes here: https://docs.apify.com/academy/puppeteer-playwright/common-use-cases/scraping-iframes
1
Anna C.
·
·
Thank you!
Channeled
APP
·
·