Persistent Systems has unveiled GenAI Hub, a platform aimed at accelerating the creation and deployment of Generative AI (GenAI) applications within enterprises. This platform integrates smoothly with a company’s existing infrastructure, applications, and data, enabling rapid development of tailored, industry-specific GenAI solutions. GenAI Hub supports the adoption of GenAI across various Large Language Models (LLMs) and cloud services, without being tied to a specific provider.
To fully harness the potential of GenAI and transform ideas into concrete business outcomes, enterprises need to integrate it easily into their existing systems. With a wide range of AI models from extensive to specialised, clients require a robust platform like GenAI Hub. This platform simplifies the development and management of multiple GenAI models, accelerating market readiness through pre-built software components, while adhering to responsible AI principles.
GenAI Hub consists of five major components:
- Playground: A no-code tool for domain experts to explore and apply GenAI with LLMs on enterprise data without programming skills. It offers a single, uniform interface to LLMs from private providers such as Azure OpenAI, AWS Bedrock, and Google Gemini, as well as open models from Hugging Face like LLaMA2 and Mistral
- Agents Framework: Provides a versatile architecture for GenAI application development, utilising libraries like LangChain and LlamaIndex for innovative solutions, including Retrieval Augmented Generation (RAG)
- Evaluation Framework: Uses an “AI to validate AI” approach and can automatically generate ground-truth questions to be verified by a human. It employs metrics to track application performance and measures any drift and bias that can be addressed
- Gateway: Acts as a router across LLMs, enabling application compatibility and improving the management of service priorities and load balancing. It also provides detailed insights into token consumption and associated costs
- Custom Model Pipelines: Facilitates the creation and integration of bespoke LLMs and Small Language Models (SLMs) into the GenAI ecosystem, supporting a streamlined process for data preparation and model fine-tuning suitable for both cloud and on-premises deployments
The GenAI Hub simplifies the development of use cases for enterprises, offering step-by-step guidance and seamless integration of data in LLMs. This enables the rapid creation of efficient and secure GenAI solutions at scale, whether for end users, customers, or employees.
“At Persistent, we have always stayed ahead of the curve to capitalize on the latest industry technology trends, and now we’re reaching new frontiers in GenAI to solve critical enterprise challenges and turbocharge client growth,” said Praveen Bhadada, Global Business Head – AI, Persistent. “With the Persistent GenAI Hub, clients can embrace a ‘GenAI-First’ strategy, delivering AI-powered applications and services at scale. They can accelerate innovation while practicing responsible AI, leveraging pre-built accelerators and evaluation frameworks, and optimising costs with a cross-LLM strategy. The GenAI Hub enables enterprises to streamline operations, enhance customer experiences, and identify new avenues for growth.”
“We are seeing a shift in the market as organisations look to scale out their GenAI deployments. A pause of reflection often follows this shift as they encounter new deployment challenges and risks. Persistent’s GenAI Hub provides both an evaluation framework to validate the AI approach and a comprehensive set of capabilities to accelerate the time to value to help organisations navigate those challenges,” added Thomas Reuner, Executive Research Leader and Head of EMEA, HFS Research.
There’s plenty of other editorial on our sister site, Electronic Specifier! Or you can always join in the conversation by commenting below or visiting our LinkedIn page.
