Using Local LLMs with Clay for Enhanced AI Capabilities

is it possible to use LLM that is locally running on my server in clay?

· Sorted by Oldest

Jordan C.
·
·
No
Mark L.
·
·
Hi there. Clay doesn't have a native integrations to call to a locally-hosted LLM. But hypothetically you could use something like Ngrok to set up an endpoint that routes to a local port on your machine. And you could call to that endpoint using an HTTP API column in Clay. https://www.clay.com/university/lesson/http-api-clay-101 https://www.clay.com/university/guide/http-api-integration-overview I think that might be a heavier lift than it's worth, but it might be fun to experiment with!
Channeled
APP
·
·

Jordan C.
·
·
No
Mark L.
·
·
Hi there. Clay doesn't have a native integrations to call to a locally-hosted LLM. But hypothetically you could use something like Ngrok to set up an endpoint that routes to a local port on your machine. And you could call to that endpoint using an HTTP API column in Clay. https://www.clay.com/university/lesson/http-api-clay-101 https://www.clay.com/university/guide/http-api-integration-overview I think that might be a heavier lift than it's worth, but it might be fun to experiment with!
Channeled
APP
·
·