Shape, datatype, and byte-size metadata for one model tensor. More...

#include <types.hpp>

Public Member Functions
	InputOutputMetaData (const std::vector< int64_t > &shape, const inference::DataType &datatype)
	Build metadata and calculate the required tensor byte size.

Public Attributes
const std::vector< int64_t >	shape

const inference::DataType	datatype

const int64_t	bytesize

Detailed Description

Shape, datatype, and byte-size metadata for one model tensor.

Definition at line 272 of file types.hpp.

Constructor & Destructor Documentation

◆ InputOutputMetaData()

triton_cpp::InputOutputMetaData::InputOutputMetaData	(	const std::vector< int64_t > &	shape,
		const inference::DataType &	datatype )

inline

Build metadata and calculate the required tensor byte size.

Parameters

shape	Tensor dimensions. Dynamic dimensions contribute one to the size.
datatype	Triton tensor datatype.

Exceptions

std::invalid_argument if datatype is unsupported.

Definition at line 287 of file types.hpp.

      : shape{shape},
        datatype{datatype},
        bytesize{accumulate_shape(shape.begin(), shape.end()) *
                 std::visit([](auto&& arg) { return static_cast<std::int64_t>(sizeof(arg)); }, getZero(datatype))} {}

Member Data Documentation

◆ bytesize

const int64_t triton_cpp::InputOutputMetaData::bytesize

Total tensor buffer size in bytes.

Definition at line 278 of file types.hpp.

◆ datatype

const inference::DataType triton_cpp::InputOutputMetaData::datatype

Triton tensor datatype.

Definition at line 276 of file types.hpp.

◆ shape

const std::vector<int64_t> triton_cpp::InputOutputMetaData::shape

Tensor dimensions reported by Triton or supplied by the caller.

Definition at line 274 of file types.hpp.

The documentation for this struct was generated from the following file:

include/triton_cpp/types.hpp

Public Member Functions