Nutanix is driving the rapid adoption of generative AI in enterprises

Nutanix, a prominent player in hybrid multicloud computing, has unveiled enhanced features for Nutanix GPT-in-a-Box. These updates include integrations with NVIDIA NIM inference microservices and the Hugging Face Large Language Models (LLMs) library.

Furthermore, Nutanix introduced the Nutanix AI Partner Program, designed to unite top AI solutions and services partners to assist customers in deploying, managing, and securing generative AI (GenAI) applications on the Nutanix Cloud Platform and GPT-in-a-Box. Nutanix GPT-in-a-Box is a comprehensive solution specifically crafted to streamline Enterprise AI adoption, featuring seamless integration with Nutanix Objects and Nutanix Files for model and data storage.

Thomas Cornely, SVP of Product Management at Nutanix, expressed satisfaction with the positive reception to the initial release of Nutanix GPT-in-a-Box, confirming the demand from Enterprise customers for on-premises software solutions that streamline the implementation and administration of AI models and inference endpoints. He emphasized that the Enterprise sector represents a significant frontier for GenAI, and Nutanix is enthusiastic about collaborating with its expanding network of partners to facilitate the seamless operation of GenAI applications on-premises at scale while ensuring ease of maintenance.

The company unveiled GPT-in-a-Box 2.0, which will offer enhanced NVIDIA accelerated computing and LLM support, as well as streamlined foundational model management and integrations with NVIDIA NIMs microservices and the Hugging Face LLM library. GPT-in-a-Box 2.0 will feature a consolidated user interface for foundation model management, API endpoint creation, end-user access key management, and will integrate Nutanix Files and Objects, in addition to NVIDIA Tensor Core GPUs.

GPT-in-a-Box 2.0 is set to introduce Nutanix's signature simplicity to the user experience through features such as a built-in graphical user interface, role-based access control, auditability, and dark site support, among other advantages. Additionally, it will offer a point-and-click user interface for deploying and configuring NVIDIA NIM, a component of the NVIDIA AI Enterprise software platform designed for developing and deploying production-grade AI solutions. This will enable the seamless deployment and operation of GenAI workloads in Enterprise settings and at the Edge.

Khalid Al Kaf, COO at Yahsat, highlighted the partnership with Nutanix as a key technology collaborator to support their AI initiatives and drive a future where technology benefits humanity. He emphasized that they are not merely keeping up with the future but actively influencing it by leveraging Nutanix GPT-in-a-Box. This solution offers them straightforward end-to-end management capabilities and the ability to retain control over their data.

Nutanix has revealed a collaboration with Hugging Face to expedite customers' AI progression by offering seamless access to the Hugging Face library and the implementation of LLMs for Nutanix clients. Through this partnership, mutual customers can utilize Nutanix GPT-in-a-Box 2.0 to effortlessly access validated LLMs from Hugging Face and execute them.

As part of this collaboration, Nutanix and Hugging Face will collaborate on a tailored integration with Text Generation Inference, a well-known Hugging Face open-source library used for the production deployment of Large Language Models. This integration will facilitate the availability of text-generation models from the Hugging Face Hub within Nutanix GPT-in-a-Box 2.0. The partnership aims to provide a smooth workflow for deploying validated AI LLMs from Hugging Face with comprehensive support from Nutanix, thereby significantly increasing the range of supported LLMs. This initiative will lead to a seamless deployment experience for users.

Nutanix has further improved its unstructured data platform for AI/ML and other applications by enhancing performance, density, and total cost of ownership (TCO). The Nutanix Unified Storage (NUS) now includes support for a new 550+ Terabytes dense low-cost all-NVMe platform, offering up to 10 Gigabytes/second sequential read throughput from a single node, which is close to line speed for a 100 Gigabit Ethernet port. This advancement enables quicker data reads and more efficient utilization of GPU resources. Additionally, Nutanix will introduce support for NVIDIA GPUDirect Storage to enhance the platform further.

In order to safeguard highly valuable and frequently confidential data, such as datasets utilized for training and processing AI/ML workloads, Nutanix Data Lens now extends cyber resilience value to Objects in addition to Files data. The introduction of a new Data Lens point of presence in Frankfurt caters to EU customers, enabling broader adoption and meeting their specific compliance requirements.

Nutanix has partnered with leading server OEMs to offer customers a diverse selection of AI-optimized GPUs and density-optimized GPU systems, providing them with a wide range of options. The AI-optimized GPUs, such as the NVIDIA L40S, H100, L40, and L4 GPUs, are now compatible with Nutanix GPT-in-a-Box. Additionally, Nutanix now supports density-optimized GPU systems from Dell, HPE, and Lenovo, enabling customers to reduce total cost of ownership by deploying fewer systems to meet their workload requirements.