The parameter to enable the pretraining is called pretrain and needs to be set to a dictionary. The dictionary usually contains:


this needs to be a function that has the signature (idx, net_dict) -> net_dict and should return the transformed network structure for pretraining step “idx”.


this number defines how many epochs should be run during each pretraining step. If not specified this will be 1.