
Welcome to Kedro’s API docs and tutorials!¶
Introduction
Getting Started
Tutorial
User Guide
- Setting up Visual Studio Code
- Setting up PyCharm
- Configuration
- The Data Catalog
- Using the Data Catalog within Kedro configuration
- Specifying the location of the dataset
- Using the Data Catalog with the YAML API
- Adding parameters
- Feeding in credentials
- Loading multiple datasets that have similar configuration
- Transcoding datasets
- Transforming datasets
- Versioning datasets and ML models
- Using the Data Catalog with the Code API
- Configuring a Data Catalog
- Loading datasets
- Saving data
- Nodes
- Pipelines
- Logging
- Advanced IO
- Working with PySpark
- Developing Kedro plugins
- Working with IPython and Jupyter Notebooks / Lab
- Working with Databricks
- Journal
- Creating a new dataset
- Scenario
- Project setup
- Problem
- The anatomy of a dataset
- Implement the
_load
method withfsspec
- Implement the
_save
method withfsspec
- Implement the
_describe
method - Bringing it all together
- Integrating with
PartitionedDataSet
- Adding Versioning
- Thread-safety consideration
- Handling credentials and different filesystems
- Contribute your dataset to Kedro
Resources
- Frequently asked questions
- What is Kedro?
- What are the primary advantages of Kedro?
- How does Kedro compare to other projects?
- How can I find out more about Kedro?
- What is data engineering convention?
- What version of Python does Kedro use?
- How do I upgrade Kedro?
- What best practice should I follow to avoid leaking confidential data?
- What is the philosophy behind Kedro?
- Where do I store my custom editor configuration?
- How do I look up an API function?
- How do I build documentation for my project?
- How do I build documentation about Kedro?
- Kedro architecture overview
- Guide to CLI commands
- Linting your Kedro project
- Images and icons
API Docs¶
kedro |
Kedro is a framework that makes it easy to build robust and scalable data pipelines by providing uniform project templates, data abstraction, configuration and pipeline assembly. |