I recently solved this problem for a client and I am open-sourcing the tool.
They had a massive footprint of unstructured data, and their AI tools couldn't make sense of it.
So, we scraped their website and compiled a master Knowledge Base to give Claude permanent, structured memory.
Check the post for the 6-step system we used to turn 11,000+ scattered pages into an unforgettable AI brain.
https://www.linkedin.com/posts/gtm-architect_knowledge-base-builder-activity-7449899188319850496-PLjB/