Release news
Since our last In the Pipeline post, we have made a few releases.
We released a new version of the Kedro VS Code Extension (version 0.2.2), which integrates Kedro-Viz into your development workflow. The additions enable you to visualise and explore your pipelines directly within VS Code. Within Kedro-Vizr, you can now jump to the source code or the dataset definitions in your Kedro project by clicking on the nodes and datasets directly. While it's still in an experimental stage, we plan to add some more powerful capabilities soon, so stay tuned! You can find the full set of release notes on the Slack archive.
We also released Kedro-Viz version 10.0.0 to align with the addition to the extension. This new version also now includes Visual Pipeline Slicing to make slicing your pipelines more intuitive by doing it visually in Kedro-Viz. Select the start and end nodes and Kedro-Viz will show the corresponding kedro run
command that you can drop directly in the terminal. Take a look at the documentation for more information or watch Huongās video!
In Kedro-Viz version 10.0.0, we also added a new command (kedro viz --lite
) for when you need to view and explore your Kedro pipelines without installing any project dependencies.
Last, but not least, we also made two new Kedro releases: version 0.19.7 and version 0.19.8.
In Kedro version 0.19.8 we added another improvement to the Databricks and Kedro development experience. We waved farewell to databricks_run.py
and Kedro projects now come with a single entrypoint that supports the full Kedro CLI even in interactive environments such as Databricks. This means you can do python -m <package_name> run
anywhere. Check out our updated Databricks deployment docs for more details.
In Kedro version 0.19.7 we made some changes so that Kedro commands are now lazily loaded to add performance gains when being run. We implemented key completion support for accessing datasets in the DataCatalog
, and added Dataset
and DataCatalog
pretty printing.
Weāve now moved to an opt-out model for telemetry, enabling it by default without requiring prior consent. To disable it, set the DO_NOT_TRACK
or KEDRO_DISABLE_TELEMETRY
environment variables.
Kedro in conference
Since our last post, Merel has been presenting on behalf of QuantumBlack Labs at a few events. She was at the September 2024 Kickstart AI event, co-organized with PyData Eindhoven, where she shared awesome insights on embedding software engineering best practices into ML projects with Kedro. Her tips on making ML projects more scalable and manageable were super helpful!
Merel and Elena both presented at PyLadies London, hosted at at QuantumBlack, AI by McKinsey in mid night, where attendees explored exciting topics on AI and machine learning.
Coming up in October and November!
Merel will be at PyCon NL in Utrecht š³š± on 10th of October to present āEfficient Python Project Setup: Showing Cookiecutter's Potential within Kedroā. Check out the event website for more details of the speakers and presentations.
Later in November, there will be two talks about Kedro at PyCon France š«š· one about its use in precision agriculture and another one about its integration with MLFlow.
Hacktoberfest
Itās October already! And that meansā¦Hacktoberfest is upon us. Hacktoberfest is a global celebration of open source that takes place during the month of October. Why not become a Kedroid notch up some contributions to Kedro or Kedro-Viz?
Find more information and a list of issues ready for you to tackle. You may also want to take a look at the guidance for contributors, and ask us if youāve any questions, either on the individual GitHub issues, or over on Slack.
Thatās it for this edition!
Donāt forget that we also make regular Kedro updates on LinkedIn, Bluesky, Mastodon, and on our increasingly popular Slack community. Keep an eye on QuantumBlackās LinkedIn feed too!
Bookmark this blog or add our RSS feed to your favorite reader to stay in the loop and join us next month for another update.
Recently on the Kedro blog
Recently published on the Kedro blog:
Weāre always looking for collaborators to write about their experiences using Kedro. Get in touch with us on our Slack workspace to tell us your story!
PSā¦
Donāt forget, if you spot Kedro in an article or video, donāt forget to share it on the #resources channel on Slack. And if you make a video about Kedro, or write an article, donāt be shy! Add it to the channel and to the āAwesome Kedroā repository so others can find it!