returnn.torch.data.extern_data#

From raw dict to extern_data tensor dict.

returnn.torch.data.extern_data.extern_data_template_from_config_opts(extern_data_dict: Dict[str, Any]) → TensorDict[source]#
Parameters:

extern_data_dict – as you would specify in the config

Returns:

extern data tensor dict

returnn.torch.data.extern_data.raw_dict_to_extern_data(extern_data_raw: Dict[str, Tensor | ndarray], *, extern_data_template: TensorDict, device: str | device) → TensorDict[source]#
Parameters:

  • extern_data_raw – This comes out of the DataLoader.

  • extern_data_template – Specified via extern_data in the config.

  • device – E.g. the GPU.

Returns:

tensor dict, like extern_data_template, but with raw tensors set to Torch tensors, on the right device.

returnn.torch.data.extern_data.get_batch_dim_from_extern_data(extern_data: TensorDict) → Dim[source]#

We expect that the batch dim is the first dim in any of the tensors. See collate_batch.

We allow that the batch dim is not necessarily the global batch_dim object. We also allow that this is not even marked as batch dim (is_batch_dim() can be False).