Skip to content

Upgrade to duckdb v1.10502 and arrow v58#447

Merged
georgestagg merged 4 commits into
mainfrom
upgrade-duckdb
May 14, 2026
Merged

Upgrade to duckdb v1.10502 and arrow v58#447
georgestagg merged 4 commits into
mainfrom
upgrade-duckdb

Conversation

@georgestagg
Copy link
Copy Markdown
Collaborator

@georgestagg georgestagg commented May 14, 2026

Upgrade duckdb-rs and arrow, to align the required arrow version in preparation for #422.

Includes changes to deal with two duckdb issues,

With this PR we cannot consume .parquet files with GEOMETRY columns without casting. For now we cast the world builtin dataset to WKB when loading. This can be removed once we upgrade to a version of duckdb-rs that has fixed support for GEOMETRY.

The solution in the meantime for if when user needs to use their own .parquet file with a GEOMETRY column is to cast to WKB binary format when loading the data,

SELECT * REPLACE (ST_AsWKB(geom) AS geom) FROM read_parquet([...]);

Copy link
Copy Markdown
Collaborator

@teunbrand teunbrand left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is an example where this code exists:

FILTER ST_Intersects(geom, ST_MakeEnvelope(-20.0, -35.0, 55.0, 38.0))

and should probably become (I've not tested this myself)

FILTER ST_Intersects(ST_GeomFromWKB(geom), ST_MakeEnvelope(-20.0, -35.0, 55.0, 38.0))

Otherwise, this LGTM!

@georgestagg georgestagg merged commit da5a290 into main May 14, 2026
2 checks passed
@georgestagg georgestagg deleted the upgrade-duckdb branch May 14, 2026 13:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants