src.system.data_sources.data_source.file.DataSourceFile

class src.system.data_sources.data_source.file.DataSourceFile(path: str, dataframe_load_function: Callable[[str], DataFrame])

Abstract data source object for a file on disk. Loads file from disk into cache. Inherit this class to specify a particular file format.

Inheritance Diagram

Inheritance diagram of DataSourceFile

Variables & Properties

Methods

__init__(path, dataframe_load_function)

Constructor method.

Details

__init__(path: str, dataframe_load_function: Callable[[str], DataFrame])

Constructor method. Checks if the file exists.

Parameters:

  • path – Path to a file that contains data source data.

  • dataframe_load_function – Function used to load data into the cache

cache: DataFrame

Internal cache, populated at runtime.