Evaluating our RAG-based Chatbot and Iteratively Improving its Reliability
- Published
- Author
- Eskild EriksenData Engineer
We evaluate the output of a RAG AI chatbot against preferred answers, across different open-source LLMs and prompts.
Read moreStay up-to-date with the latest industry news as we lift our clients to new levels.
We evaluate the output of a RAG AI chatbot against preferred answers, across different open-source LLMs and prompts.
Read moreIn a world that continues to move toward on demand self-service, we worked with a global bicycle manufacturer to improve customer service with less resources, here's how it went down.
Read moreWe compare the performance and cost of serverless big data platforms for processing a trillion-row dataset.
Read moreOur client receives data from HVAC distributors all over the country. While they sell the same or similar equipment, the models/skus can vary greatly from distributor to distributor even while selling the same model/sku.
Read moreWhen a global leader in the pool & wellness industry asks you for help, you dive right in. What started out as a cloud migration turned into $2M in annual savings on warranty service that more than paid for a scalable and secure data solution that will last for decades.
Read moreAt productOps, we look at data proficiency from a number of different perspectives, just as most organizations do. In order to align different parts of the organization—for example, Sales and IT—we first assess where the organization is on a Data Maturity scale of 1–5, with level 5 being very forward-looking and predictive (see fig 1). Then we work with all parties to understand the current level so we can build common goals and a strategy for improving.
Read moreStruggling with an antiquated system with severe device and connectivity limitations, they needed to make the right choices in order to continue to provide the service and quality their customers were accustomed to. With new hardware designs and a global reach they needed a robust and scalable platform that was secure and flexible.
Read more