NVSentinel is a cross-platform fault remediation service designed to rapidly remediate runtime node-level issues in GPU-accelerated computing environments

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Ongoing research training transformer models at scale

A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

NeMo Retriever Library is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever extraction uses specialized NVIDIA NIM microservices to find, contextualize, and extract text, tables, charts and images that you can use in downstream generative applications.

NCX Infra Controller - Hardware Lifecycle Management and multitenant networking

Run OpenClaw more securely inside NVIDIA OpenShell with managed inference

`std::execution`, the proposed C++ framework for asynchronous and parallel programming.

C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows