Norm Layers

Batch-Normalization Layer

class TFNetworkLayer.BatchNormLayer(**kwargs)[source]

Implements batch-normalization (http://arxiv.org/abs/1502.03167) as a separate layer.

All kwargs which are present in our base class are passed to our base class. All remaining kwargs are used for self.batch_norm().

layer_class = 'batch_norm'[source]

Layer-Normalization Layer

class TFNetworkLayer.LayerNormLayer(epsilon=1e-06, **kwargs)[source]

Applies layer-normalization.

layer_class = 'layer_norm'[source]
classmethod get_out_data_from_opts(sources, name, **kwargs)[source]
Parameters:
  • sources (list[LayerBase]) –
  • name (str) –
Return type:

Data