supported networks, layers, and classes -凯发k8网页登录

(deep learning toolbox)

an image input layer inputs 2-d images to a network and applies data normalization.

code generation does not support 'normalization' specified using a function handle.

yes

yes

yes

(deep learning toolbox)

a sequence input layer inputs sequence data to a network.

the cudnn library supports vector and 2-d image sequences. the tensorrt library support only vector input sequences.

for vector sequence inputs, the number of features must be a constant during code generation.

for image sequence inputs, the height, width, and the number of channels must be a constant during code generation.

code generation does not support 'normalization' specified using a function handle.

yes

yes

no

(deep learning toolbox)

a feature input layer inputs feature data to a network and applies data normalization.

yes

yes

yes

(deep learning toolbox)

a 2-d convolutional layer applies sliding convolutional filters to the input.

yes

yes

yes

fullyconnectedlayer (deep learning toolbox)

a fully connected layer multiplies the input by a weight matrix and then adds a bias vector.

yes

yes

no

(deep learning toolbox)

a 2-d grouped convolutional layer separates the input channels into groups and applies sliding convolutional filters. use grouped convolutional layers for channel-wise separable (also known as depth-wise separable) convolution.

code generation for the arm mali gpu is not supported for a 2-d grouped convolution layer that has the numgroups property set as 'channel-wise' or a value greater than two.

yes

yes

yes

(deep learning toolbox)

a transposed 2-d convolution layer upsamples feature maps.

yes

yes

yes

(deep learning toolbox)

a bidirectional lstm (bilstm) layer learns bidirectional long-term dependencies between time steps of time series or sequence data. these dependencies can be useful when you want the network to learn from the complete time series at each time step.

for code generation, the stateactivationfunction property must be set to 'tanh'.

for code generation, the gateactivationfunction property must be set to 'sigmoid'.

yes

yes

no

(deep learning toolbox)

a flatten layer collapses the spatial dimensions of the input into the channel dimension.

yes

no

no

(deep learning toolbox)

a gru layer learns dependencies between time steps in time series and sequence data.

code generation supports only the 'after-multiplication' and 'recurrent-bias-after-multiplication' reset gate modes.

yes

yes

no

(deep learning toolbox)

an lstm layer learns long-term dependencies between time steps in time series and sequence data.

for code generation, the stateactivationfunction property must be set to 'tanh'.

for code generation, the gateactivationfunction property must be set to 'sigmoid'.

yes

yes

no

(deep learning toolbox)

a sequence folding layer converts a batch of image sequences to a batch of images. use a sequence folding layer to perform convolution operations on time steps of image sequences independently.

yes

no

no

(deep learning toolbox)

a sequence input layer inputs sequence data to a network.

the cudnn library supports vector and 2-d image sequences. the tensorrt library support only vector input sequences.

for vector sequence inputs, the number of features must be a constant during code generation.

for image sequence inputs, the height, width, and the number of channels must be a constant during code generation.

code generation does not support 'normalization' specified using a function handle.

yes

yes

no

(deep learning toolbox)

a sequence unfolding layer restores the sequence structure of the input data after sequence folding.

yes

no

no

(text analytics toolbox)

a word embedding layer maps word indices to vectors.

yes

yes

no

(deep learning toolbox)

a clipped relu layer performs a threshold operation, where any input value less than zero is set to zero and any value above the clipping ceiling is set to that clipping ceiling.

yes

yes

yes

(deep learning toolbox)

an elu activation layer performs the identity operation on positive inputs and an exponential nonlinearity on negative inputs.

yes

yes

no

(deep learning toolbox)

a leaky relu layer performs a threshold operation, where any input value less than zero is multiplied by a fixed scalar.

yes

yes

yes

(deep learning toolbox)

a relu layer performs a threshold operation to each element of the input, where any value less than zero is set to zero.

yes

yes

yes

(reinforcement learning toolbox)

a softpluslayer is a deep neural network layer that implements the softplus activation y = log(1 e^x), which ensures that the output is always positive.

yes

yes

no

(deep learning toolbox)

a swish activation layer applies the swish function on the layer inputs.

yes

yes

no

(deep learning toolbox)

a hyperbolic tangent (tanh) activation layer applies the tanh function on the layer inputs.

yes

yes

yes

(deep learning toolbox)

a batch normalization layer normalizes each input channel across a mini-batch.

yes

yes

yes

(deep learning toolbox)

a 2-d crop layer applies 2-d cropping to the input.

yes

yes

yes

(deep learning toolbox)

a channel-wise local response (cross-channel) normalization layer carries out channel-wise normalization.

yes

yes

yes

(deep learning toolbox)

a dropout layer randomly sets input elements to zero with a given probability.

yes

yes

yes

(deep learning toolbox)

a group normalization layer normalizes a mini-batch of data across grouped subsets of channels for each observation independently.

yes

yes

no

(reinforcement learning toolbox)

scaling layer for actor or critic network.

for code generation, values for the 'scale' and 'bias' properties must have the same dimension.

yes

yes

yes

(deep learning toolbox)

an average pooling layer performs down-sampling by dividing the input into rectangular pooling regions and computing the average values of each region.

code generation using third-party libraries such as cudnn, arm compute does not support non-zero padding value.

for simulink^® models that implement deep learning functionality using matlab function block, simulation errors out if the network contains an average pooling layer with non-zero padding value. in such cases, use the blocks from the deep neural networks library instead of a matlab function to implement the deep learning functionality.

yes

yes

yes

(deep learning toolbox)

a global average pooling layer performs down-sampling by computing the mean of the height and width dimensions of the input.

yes

yes

yes

(deep learning toolbox)

a global max pooling layer performs down-sampling by computing the maximum of the height and width dimensions of the input.

yes

yes

yes

(deep learning toolbox)

a max pooling layer performs down-sampling by dividing the input into rectangular pooling regions, and computing the maximum of each region.

if equal max values exists along the off-diagonal in a kernel window, implementation differences for the maxpooling2dlayer might cause minor numerical mismatch between matlab^® and the generated code. this issue also causes mismatch in the indices of the maximum value in each pooled region. for more information, see (deep learning toolbox).

yes

yes

yes

(deep learning toolbox)

a max unpooling layer unpools the output of a max pooling layer.

if equal max values exists along the off-diagonal in a kernel window, implementation differences for the maxpooling2dlayer might cause minor numerical mismatch between matlab and the generated code. this issue also causes mismatch in the indices of the maximum value in each pooled region. for more information, see (deep learning toolbox).

yes

yes

no

(deep learning toolbox)

an addition layer adds inputs from multiple neural network layers element-wise.

yes

yes

yes

(deep learning toolbox)

a concatenation layer takes inputs and concatenates them along a specified dimension.

yes

yes

no

(deep learning toolbox)

a depth concatenation layer takes inputs that have the same height and width and concatenates them along the third dimension (the channel dimension).

yes

yes

yes

(computer vision toolbox)

an anchor box layer stores anchor boxes for a feature map used in object detection networks.

yes

yes

yes

(image processing toolbox)

yes

yes

yes

(computer vision toolbox)

yes

yes

yes

(image processing toolbox)

yes

yes

yes

(computer vision toolbox)

an ssd merge layer merges the outputs of feature maps for subsequent regression and classification loss computation.

yes

yes

no

(computer vision toolbox)

yes

yes

yes

(computer vision toolbox)

yes

yes

yes

(computer vision toolbox)

create output layer for yolo v2 object detection network.

yes

yes

yes

(computer vision toolbox)

create reorganization layer for yolo v2 object detection network.

yes

yes

yes

(computer vision toolbox)

create transform layer for yolo v2 object detection network.

yes

yes

yes

(deep learning toolbox)

a classification layer computes the cross entropy loss for multi-class classification problems with mutually exclusive classes.

yes

yes

yes

(computer vision toolbox)

a dice pixel classification layer provides a categorical label for each image pixel or voxel using generalized dice loss.

yes

yes

yes

(computer vision toolbox)

yes

yes

yes

output layer (deep learning toolbox)

all output layers including custom classification or regression output layers created by using nnet.layer.classificationlayer or nnet.layer.regressionlayer.

for an example showing how to define a custom classification output layer and specify a loss function, see (deep learning toolbox).

for an example showing how to define a custom regression output layer and specify a loss function, see (deep learning toolbox).

yes

yes

yes

(computer vision toolbox)

a pixel classification layer provides a categorical label for each image pixel or voxel.

yes

yes

yes

(computer vision toolbox)

yes

yes

yes

(deep learning toolbox)

a regression layer computes the half-mean-squared-error loss for regression problems.

yes

yes

yes

(computer vision toolbox)

yes

yes

yes

(deep learning toolbox)

a sigmoid layer applies a sigmoid function to the input.

yes

yes

yes

(deep learning toolbox)

a softmax layer applies a softmax function to the input.

yes

yes

yes

nnet.keras.layer.cliplayer (deep learning toolbox)

clips the input between the upper and lower bounds.

yes

yes

no

nnet.keras.layer.flattencstylelayer (deep learning toolbox)

flatten activations into 1-d assuming c-style (row-major) order.

yes

yes

yes

nnet.keras.layer.globalaveragepooling2dlayer (deep learning toolbox)

global average pooling layer for spatial data.

yes

yes

yes

nnet.keras.layer.prelulayer (deep learning toolbox)

parametric rectified linear unit.

yes

yes

no

nnet.keras.layer.sigmoidlayer (deep learning toolbox)

sigmoid activation layer.

yes

yes

yes

nnet.keras.layer.tanhlayer (deep learning toolbox)

hyperbolic tangent activation layer.

yes

yes

yes

nnet.keras.layer.timedistributedflattencstylelayer (deep learning toolbox)

flatten a sequence of input image into a sequence of vector, assuming c-style (or row-major) storage ordering of the input layer.

yes

yes

no

nnet.keras.layer.zeropadding2dlayer (deep learning toolbox)

zero padding layer for 2-d input.

yes

yes

yes

nnet.onnx.layer.cliplayer (deep learning toolbox)

clips the input between the upper and lower bounds.

yes

yes

no

nnet.onnx.layer.elementwiseaffinelayer (deep learning toolbox)

layer that performs element-wise scaling of the input followed by an addition.

yes

yes

yes

nnet.onnx.layer.flatteninto2dlayer (deep learning toolbox)

flattens a matlab 2d image batch in the way onnx does, producing a 2d output array with cb format.

yes

yes

no

nnet.onnx.layer.flattenlayer (deep learning toolbox)

flattens the spatial dimensions of the input tensor to the channel dimensions.

yes

yes

yes

nnet.onnx.layer.globalaveragepooling2dlayer (deep learning toolbox)

global average pooling layer for spatial data.

yes

yes

yes

nnet.onnx.layer.identitylayer (deep learning toolbox)

layer that implements onnx identity operator.

yes

yes

yes

nnet.onnx.layer.prelulayer (deep learning toolbox)

parametric rectified linear unit.

yes

yes

no

nnet.onnx.layer.sigmoidlayer (deep learning toolbox)

sigmoid activation layer.

yes

yes

yes

nnet.onnx.layer.tanhlayer (deep learning toolbox)

hyperbolic tangent activation layer.

yes

yes

yes

nnet.onnx.layer.verifybatchsizelayer (deep learning toolbox)

verify fixed batch size.

yes

yes

yes

custom layers

custom layers, with or without learnable parameters, that you define for your problem.

to learn how to define custom deep learning layers, see (deep learning toolbox) and (deep learning toolbox).

for an example on how to generate code for a network with custom layers, see code generation for object detection using yolo v3 deep learning network.

the outputs of the custom layer must be fixed-size arrays.

using 'unified' as the mallocmode in requires extra memory copies leading to slower performance. for custom layers, it is recommended to use 'discrete' mode. for more information on gpu memory allocation, see discrete and managed modes

cudnn targets support both row-major and column-major code generation for custom layers. tensorrt targets support only column-major code generation.

for code generation, custom layers must contain the %#codegen pragma.

code generation for a sequence network containing custom layer and lstm or gru layer is not supported.

you can pass dlarray to custom layers if:

for unsupported dlarray methods, then you must extract the underlying data from the dlarray, perform the computations and reconstruct the data back into the dlarray for code generation. for example,

function z = predict(layer, x)
if coder.target('matlab')
   z = dopredict(x);
else
   if isdlarray(x)
      x1 = extractdata(x);
      z1 = dopredict(x1);
      z = dlarray(z1);
  else
      z = dopredict(x);
  end
end
end

yes

yes

no