triton_cpp v1.2.1
Header-only C++ wrapper for NVIDIA Triton Inference Server clients
Loading...
Searching...
No Matches
Class List
Here are the classes, structs, unions and interfaces with brief descriptions:
[detail level 123]
 Ntriton_cpp
 Ndetail
 CPosixSharedMemory
 CCudaSharedMemoryRegionOwn a CUDA device allocation exportable through a CUDA IPC handle
 CInputDataCouple a Triton input descriptor with its backing storage
 CInputOutputMetaDataShape, datatype, and byte-size metadata for one model tensor
 CSharedMemoryRegionOwn a POSIX shared-memory mapping used by the Triton client
 CTritonInterfaceSynchronous, typed interface to one model served by Triton