Highly Technical Content Meets Private LLM: Insights and Lessons Learned

It's cool to pull delicious Italian recipes from unclassified recipe content, but how about feeding intricate technical documentation to the LLM?

Leveraging the potential of LLMs (large language models) to process complex technical documentation presents an interesting use case in API docs and developer portals - especially when combined with data sovereignty and privacy principles. We’ll examine the intricacies of feeding highly technical content into a private LLM, unpacking how this approach aims to help developers swiftly find answers from “Hello World” to complex apps, all while ensuring the data remains 100% sovereign. Having leveraged Lagoon, we'll discuss how an open-source hosting option played a role in deciding on our tooling, with a particular focus on the flexibility Lagoon offers, alongside the AI innovation the Lagoon community is undertaking.

We will explore the setup, outcomes, and takeaways, emphasizing why maintaining the privacy of data fed into the LLM is paramount for the end customer.