Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DataFusion 45 blog post #57

Merged
merged 14 commits into from
Feb 25, 2025
Merged

DataFusion 45 blog post #57

merged 14 commits into from
Feb 25, 2025

Conversation

Omega359
Copy link
Contributor

@Omega359 Omega359 commented Feb 20, 2025

Copy link
Contributor

@2010YOUY01 2010YOUY01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the post

2. In the [core DataFusion repo] alone we reviewed and accepted almost 1600 PRs from 206 different
committers, created over 1100 issues and closed 751 of them 🚀. All changes are listed in the detailed
[changelogs].
3. DataFusion focused meetups happened in multiple cities around the world: [Hangzhou], [Belgrade], [New York],
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WOW -- this is pretty crazy to see it listed here

Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @Omega359 -- this is awesome. I have some small suggestions, but I also think the blog could be published as is.

It is very much appreciated

of work went into making this happen!

<img
src="/blog/images/datafusion-45.0.0/performance_over_time.png"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BTW thanks again to @pmcgleenon for creating these images ❤️
Screenshot 2025-02-22 at 6 17 01 AM


DataFusion continues to improve overall in quality. In addition to ongoing bug
fixes, one of the most exciting improvements in the last 6 months was the addition of the
[SQLite sqllogictest suite] thanks to [@Omega359]. These tests run over 5 million
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

100%

@alamb alamb changed the title DF 45 blog post DataFusion 45 blog post Feb 22, 2025
@alamb
Copy link
Contributor

alamb commented Feb 22, 2025

@ozankabak and @comphead and @andygrove and @Dandandan ,

Are there other things / features you think we should highlight in the DataFusion 45 blog post (that covers the last several months of work)?

@alamb
Copy link
Contributor

alamb commented Feb 23, 2025

I'll plan to merge this in the tomorrow unless anyone else would like time to comment

@ozankabak
Copy link

We will take a look tomorrow and come up with suggestions if we can think of anything

@alamb
Copy link
Contributor

alamb commented Feb 23, 2025

I'll wait for your comments before releasing

Copy link
Member

@andygrove andygrove left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great!

Copy link

@kevinjqliu kevinjqliu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Saw this PR mentioned on the devlist. Great read! I double checked the hyperlinks 👍

Copy link

@ozankabak ozankabak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me. Reading the post made me think we should aim to get our top spot back :) If we improve a few things like COUNT(DISTINCT), I think we can pull it off :)

@alamb alamb merged commit 57caa83 into apache:main Feb 25, 2025
1 check passed
@alamb
Copy link
Contributor

alamb commented Feb 25, 2025

Thanks again everyone! I'll keep an eye on this and make sure it gets published and post the final link, etc here

@alamb
Copy link
Contributor

alamb commented Feb 25, 2025

It has been published: https://datafusion.apache.org/blog/2025/02/20/datafusion-45.0.0/

(kudos again to @timsaucer for automating that process ❤️ )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Blog post with DataFusion July - Sep 2024
7 participants