Self Hosted LLMs for secure, trustworthy and multilingual customer service AI

点击翻译按钮获取中文摘要

This is a collaborative project between Algomo (UK) and Gigit(Singapore).Advances in Deep Learning have made Large Language Models (LLMs) a potential game-changer for customer service, as well as other commercial applications. These models can generate natural interactions without explicit instructions or manual data, unlike current conversational Artificial Intelligence (cAI) systems.However, these models, are notoriously large and expensive to train and serve, and as such, only large tech giants (such as Google, Meta and OpenAI) have the resources to train, maintain and serve them. Any company that wants to harness the potential of LLMs, can only access them through direct APIs.However, this poses the below issues for customer service applications:1. **Linguistic diversity**: Most LLMs are trained on mostly English data while there are many countries in Southeast Asia and Africa where English is not the main language, making these models practically useless for these geographies, and disenfranchising a significant part of their respective populations.2. **Privacy issues:** LLMs have been trained on public datasets, which contain PII information, posing a significant cybersecurity threat by generating PII data outputs. Moreover, direct API access means that companies need to share private information outside their premises, which raises ethical, regulatory and operational concerns, especially for privacy-sensitive industries like banking, insurance, and healthcare.To address these issues, Algomo, a UK company working on multilingual AI for customer service, will collaborate with Gigit, a company based in Singapore working on self-hosted and privacy-preserving LLMS.In this project, we will develop a self-hosted solution and workflow enabling training and hosting a multilingual LLM, that can be directly integrated with Algomo.These solutions are essential to bringing our multilingual conversational AI to non-technical users and contribute to our mission of bringing the advancements of AI to every person on earth, no matter what language they speak.