|
triton_cpp v1.2.1
Header-only C++ wrapper for NVIDIA Triton Inference Server clients
|
| ▼Ntriton_cpp | |
| ▼Ndetail | |
| CPosixSharedMemory | |
| CCudaSharedMemoryRegion | Own a CUDA device allocation exportable through a CUDA IPC handle |
| CInputData | Couple a Triton input descriptor with its backing storage |
| CInputOutputMetaData | Shape, datatype, and byte-size metadata for one model tensor |
| CSharedMemoryRegion | Own a POSIX shared-memory mapping used by the Triton client |
| CTritonInterface | Synchronous, typed interface to one model served by Triton |