HDFDataset

class HDFDataset.HDFDataset(*args, **kwargs)[source]
add_file(filename)[source]
Setups data:
self.seq_lengths self.file_index self.file_start self.file_seq_start

Use load_seqs() to load the actual data. :type filename: str

get_tag(sorted_seq_idx)[source]
is_data_sparse(key)[source]
get_data_dtype(key)[source]
len_info()[source]
class HDFDataset.StreamParser(seq_names, stream)[source]
get_data(seq_name)[source]
get_seq_length(seq_name)[source]
class HDFDataset.FeatureSequenceStreamParser(*args, **kwargs)[source]
get_data(seq_name)[source]
get_seq_length(seq_name)[source]
class HDFDataset.SparseStreamParser(*args, **kwargs)[source]
get_data(seq_name)[source]
get_seq_length(seq_name)[source]
class HDFDataset.NextGenHDFDataset(input_stream_name, *args, **kwargs)[source]
parsers = {'sparse': <class 'HDFDataset.SparseStreamParser'>, 'feature_sequence': <class 'HDFDataset.FeatureSequenceStreamParser'>}[source]
add_file(path)[source]
initialize()[source]
init_seq_order(epoch=None, seq_list=None)[source]
Parameters:| None seq_list (list[str]) – In case we want to set a predefined order.