kedro.io.AbstractDataSet

class kedro.io.AbstractDataSet[source]

AbstractDataSet is the base class for all data set implementations. All data set implementations should extend this abstract class and implement the methods marked as abstract.

Example:

from kedro.io import AbstractDataSet
import pandas as pd

class MyOwnDataSet(AbstractDataSet):
    def __init__(self, param1, param2):
        self._param1 = param1
        self._param2 = param2

    def _load(self) -> pd.DataFrame:
        print("Dummy load: {}".format(self._param1))
        return pd.DataFrame()

    def _save(self, df: pd.DataFrame) -> None:
        print("Dummy save: {}".format(self._param2))

    def _describe(self):
        return dict(param1=self._param1, param2=self._param2)
__init__()

Initialize self. See help(type(self)) for accurate signature.

Methods

from_config(name, config[, load_version, …]) Create a data set instance using the configuration provided.
load() Loads data by delegation to the provided load method.
save(data) Saves data by delegation to the provided save method.