Kedro newsletter — 5 min read

In the pipeline: May 2024

From the latest news to upcoming events and interesting topics, “In the Pipeline” is overflowing with updates for the Kedro community.

7 May 2024 (last updated 1 Jul 2024)
In the pipeline

Release news

Since our last newsletter post, we’ve made quite a few releases!

We shipped Python 3.12 support for our core package and a few plugins, improved the developer experience, and dropped some dependencies to make Kedro more lightweight.

We released Kedro 0.19.5 (a hotfix on top of 0.19.4) that supports running commands in any subdirectory (and offers improved error messages outside a Kedro project), faster pipeline creation, more visible cookiecutter errors, and substantial improvements to the Kedro + Airflow documentation.

We launched kedro-datasets 3.0 to ship the much anticipated ibis.TableDataset contributed by Deepyaman Datta from Voltron Data, as well as a NetCDF dataset for climate and weather data contributed by Riley X. Brady, Ph.D. from QuantumBlack, AI by McKinsey

Kedro-Viz 9.0 dropped, adding filters and namespace pipeline states to stateful URLs, the option to preview JSON datasets, and an upgrade to Node 18.

Phew! Throw in some additional releases of kedro-telemetry 0.4.0, kedro-mlflow 0.12.2 by Yolan Honoré-Rougé and kedro-boot 0.2.2 by Takieddine KADIRI, and you’ll understand why we were a bit quiet on this blog last month!

Kedro TSC news

We are pleased to welcome Simon Brugman to Kedro’s Technical Steering Committee. Simon has been consistently contributing to Kedro since at least 2020, and in particular he has been a great contributor to kedro-airflow, has pushed for upstreaming solutions to typical problems for Kedro users such as PyCodeHash, and has advocated for Kedro at work and elsewhere.

Kedro in presentation 📢

There are some Kedro presentations coming up in the near future at events around the world.

At PyCon US 2024, there’s a presentation on May 18th titled “Improve Your ML Projects: Embrace Reproducibility and Production Readiness with Kedro” by Juliana Ferreira Alves.

PyData London will feature “Analytics engineering without dbt? Building the composable Python data stack with Kedro and Ibis” on June 14th.

EuroPython 2024 showcases “From zero to MLOps: An open source stack to fight spaghetti ML” although we don’t have a fixed date for this as yet, it’ll be during the event running 8th-14th July.

Kedro in print 📚

We recommend checking out a fantastic new book from O’Reilly: Software Engineering for Data Scientists. The book explains the best practices needed to write reproducible, robust, scalable code, which is, of course, a guiding philosophy for Kedro projects. We were pleased to spot multiple mentions of Kedro, particularly in the chapter on design and refactoring.

If you don't have access to Safari Online, you can get 30 days free access to the book, and other O’Reilly content, with this code.

Kedro on film 📽️

Janick Spirig has made a video for Kedro. In less than 15 minutes, he explains how you can use Kedro’s Data Catalog in any Python project for loading and storing datasets, without the need of implementing traditional Kedro components such as nodes or pipelines. Check it out!

If you spot Kedro in an article or video, don’t forget to share it on the #resources channel on Slack. And if you make a video about Kedro, or write an article, don’t be shy! Add it to the channel and to the “Awesome Kedro” repository so others can find it!

Recently on the Kedro blog

That’s it for this edition!

Don’t forget that we also make regular Kedro updates on LinkedIn, on our Mastodon and on our increasingly popular Slack community. Keep an eye on the QuantumBlack LinkedIn feed too!

Bookmark this blog or add our RSS feed to your favorite reader to stay in the loop and join us next month for a summery update from the Kedro team.


On this page:

Photo of Jo Stichbury
Jo Stichbury
Technical Writer, QuantumBlack
Share post:
Mastodon logoLinkedIn logo

All blog posts

cover image alt

GenAI — 10 min read

Building a GenAI-powered chatbot using Kedro and LangChain

This post shows how to use Kedro to build and organize GenAI applications with a real-world example: a Retrieval-Augmented Generation (RAG) chatbot trained on Kedro Slack conversations. You'll learn how to structure your pipeline, manage LLMs and prompts, and apply practical Kedro tricks to streamline GenAI workflows - plus see why RAG outperforms plain LLMs in real use cases.

Elena Khaustova

25 Apr 2025

cover image alt

Success stories — 10 min read

Building Robust Data Science Pipelines at TomTom with Kedro

In this guest blog post, Toni Almagro, Senior Staff Data Scientist at TomTom, shares the transformative journey of Map Quality & Insights as the team transitioned from using Databricks notebooks to the Kedro framework for building data science pipelines. Initially prioritizing speed, the team faced challenges with technical debt, code repetition, and version control issues, which made their workflows unsustainable.

Toni Almagro

21 Apr 2025

cover image alt

News — 5 min read

Deprecating Experiment Tracking in Kedro Viz

Kedro-Viz will phase out its Experiment Tracking feature in the upcoming release of Kedro-Viz 11.0, with complete removal in version 12.0 due to low user adoption and the availability of robust alternatives like MLflow. This blog post includes detailed guidance on migrating to kedro-mlflow, a plugin that seamlessly integrates Kedro with MLflow.

cover image alt

Feature highlight — 5 min read

Top 10 features added to the Kedro ecosystem in 2024

This blog post highlights ten of the most notable enhancements and improvements to the Kedro ecosystem in the recent releases.

Merel Theisen

7 Oct 2024

cover image alt

Kedro newsletter — 5 min read

In the pipeline: October 2024

From the latest news to upcoming events and interesting topics, “In the Pipeline” is overflowing with updates for the Kedro community.

Jo Stichbury

2 Oct 2024