How to Import a 400MB .csv File with 1.2M Records into Clay for Lookup

Hey all! 👋 I have a 400MB .csv file with 1.2M records, how can I import that into Clay (preferably into 1 file for Lookup purposes) or at this scale would it be easier to just setup a DB on the side somewhere and query that? 🤔

✅1

3 comments

Casper S.
·
·
https://app.clay.com/workspaces/48942/tables/t_m25AMW1cAD2c/views/gv_fpRy2ypMae2a it seems Clay only imports 50K records?
Clay Team
APP
·
·
Hey Casper, yep that's probably the best bet, having this in a separate and more capable database where you can look them up. Our tables currently go up to 50k rows so that would probably be a lot of tables you'd have to build out and run lookups on otherwise
Clay Team
APP
·
·
If you can set this up in an Airtable or somewhere that supports that amount, then you can use some of the available Lookup record integrations with some of those providers and would be easier to manage. Hope this helps!