utils.data.lock

utils.data.lock

Logic for loading / preparing a dataset once over all processes.

Classes

Name	Description
FileLockLoader	Simple class for abstracting single process data loading / processing. The first

FileLockLoader

utils.data.lock.FileLockLoader(cfg)

Simple class for abstracting single process data loading / processing. The first process that creates a lock file does the work; the remaining procesees simply load the preprocessed dataset once the first process is done.

Methods

Name	Description
cleanup	Clean up ready flag when last process is done.

cleanup

utils.data.lock.FileLockLoader.cleanup()

Clean up ready flag when last process is done.