Skip to content

Upgrade to DataFusion 53#559

Draft
nuno-faria wants to merge 1 commit intodatafusion-contrib:mainfrom
nuno-faria:datafusion_53
Draft

Upgrade to DataFusion 53#559
nuno-faria wants to merge 1 commit intodatafusion-contrib:mainfrom
nuno-faria:datafusion_53

Conversation

@nuno-faria
Copy link
Copy Markdown
Contributor

@nuno-faria nuno-faria commented Mar 3, 2026

There are still some items to do:

  • @phillipleblanc could you update the duckdb fork to to arrow-58?
  • @zeroshade could you update r2d2-adbc to adbc_core-0.23.0 once it releases?
  • @alexanderbianchi the test test_postgres_io_runtime_segregation (from Add IO runtime handle to postgres connector #549) is failing (it was already happening before this update):
    Cannot drop a runtime in a context where blocking is not allowed. This happens when a runtime is dropped from within an asynchronous context.
    
    Could you check what's wrong?

datafusion-proto = { git = "https://github.com/apache/datafusion", branch = "branch-53" }
datafusion-physical-expr = { git = "https://github.com/apache/datafusion", branch = "branch-53" }
datafusion-physical-plan = { git = "https://github.com/apache/datafusion", branch = "branch-53" }
datafusion-python = { git = "https://github.com/nuno-faria/datafusion-python", branch = "datafusion_53" }
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

datafusion and datafusion-federation still need to be updated to a release version.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just FYI, I think Datafusion 53 is now officially released on crates.io

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, datafusion-federation has also been updated. Once datafusion-python and adbc-core are updated I will finish this PR.

@alexanderbianchi
Copy link
Copy Markdown
Contributor

I'll try and take a look!

@phillipleblanc
Copy link
Copy Markdown
Collaborator

@nuno-faria I've published v1.4.4 with Arrow 58 for spiceai_duckdb_fork: https://crates.io/crates/spiceai_duckdb_fork/1.4.4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants