Eurotech has unveiled its new range of generative AI (genAI) servers, designed as comprehensive platforms that support a variety of generative AI models, including large language models (LLMs).
This new server line enables organisations to harness the latest advancements in generative AI, boosting productivity while creating secure, in-house data knowledge bases. By maintaining sensitive data within their own infrastructure, businesses can ensure greater security and achieve significant cost reductions compared to Cloud-based solutions. These servers also provide flexibility for domain-specific model customisation, allowing businesses to fine-tune AI models to their specific requirements, thereby improving operational efficiency.
Eurotech’s offering spans from entry-level to ultimate-level, catering to various AI needs, from deploying pre-trained models to performing intensive LLM training and customisation. Equipped with NVIDIA’s full accelerated computing stack, these servers deliver exceptional processing power, enabling companies to handle even the most demanding AI workloads across a wide range of applications.
Fully compatible with the NVIDIA AI Enterprise platform, Eurotech’s generative AI servers seamlessly integrate with NVIDIA NIM and NVIDIA Metropolis microservices. This integration allows for optimised inference with popular AI models from NVIDIA and its partner ecosystem, supporting the development of intelligent chatbots, advanced copilots, and visual AI agents.
Marco Carrer, CTO at Eurotech, said: “We are thrilled to introduce our new line of servers specifically designed to harness the power of generative AI applications. As generative AI advances into a new generation of smart edge applications, Eurotech’s generative AI servers offer enhanced scalability, bolstering data security and privacy, while allowing for domain-specific model-tuning and facilitating edge deployment. We are eager to see the innovative solutions our customers will develop using these cutting-edge technologies.”
To demonstrate the practical uses of these platforms, Eurotech has launched an open-source LLM agent that acts as a copilot, enhancing the use of internal knowledge bases by employing retrieval-augmented generation (RAG). This tool, powered by NVIDIA AI Enterprise—including NVIDIA NIM for generative AI—and open-source frameworks such as Llama Index, transforms product data sheets, manuals, and internal documents into an intelligent assistant for employee onboarding and customer queries.
There’s plenty of other editorial on our sister site, Electronic Specifier! Or you can always join in the conversation by commenting below or visiting our LinkedIn page.
