kedro.runner.AbstractRunner¶
-
class
kedro.runner.
AbstractRunner
[source]¶ Bases:
abc.ABC
AbstractRunner
is the base class for allPipeline
runner implementations.Methods
AbstractRunner.create_default_data_set
(…)Factory method for creating the default data set for the runner. AbstractRunner.run
(pipeline, catalog)Run the Pipeline
using theDataSet``s provided by ``catalog
and save results back to the same objects.AbstractRunner.run_only_missing
(pipeline, …)Run only the missing outputs from the Pipeline
using theDataSet``s provided by ``catalog
and save results back to the same objects.-
__init__
¶ Initialize self. See help(type(self)) for accurate signature.
-
create_default_data_set
(ds_name, max_loads)[source]¶ Factory method for creating the default data set for the runner.
Parameters: - ds_name (
str
) – Name of the missing data set - max_loads (
int
) – Maximum number of timesload
method of the default data set is allowed to be invoked. Any number of calls is allowed if the argument is not set.
Return type: AbstractDataSet
Returns: An instance of an implementation of AbstractDataSet to be used for all unregistered data sets.
- ds_name (
-
run
(pipeline, catalog)[source]¶ Run the
Pipeline
using theDataSet``s provided by ``catalog
and save results back to the same objects.Parameters: - pipeline (
Pipeline
) – ThePipeline
to run. - catalog (
DataCatalog
) – TheDataCatalog
from which to fetch data.
Raises: ValueError
– Raised whenPipeline
inputs cannot be satisfied.Return type: Dict
[str
,Any
]Returns: Any node outputs that cannot be processed by the
DataCatalog
. These are returned in a dictionary, where the keys are defined by the node outputs.- pipeline (
-
run_only_missing
(pipeline, catalog)[source]¶ Run only the missing outputs from the
Pipeline
using theDataSet``s provided by ``catalog
and save results back to the same objects.Parameters: - pipeline (
Pipeline
) – ThePipeline
to run. - catalog (
DataCatalog
) – TheDataCatalog
from which to fetch data.
Raises: ValueError
– Raised whenPipeline
inputs cannot be satisfied.Return type: Dict
[str
,Any
]Returns: Any node outputs that cannot be processed by the
DataCatalog
. These are returned in a dictionary, where the keys are defined by the node outputs.- pipeline (
-