Skip to content

feat!(storage): Integration Storage trait with FileIO#2116

Open
CTTY wants to merge 2 commits intoapache:mainfrom
CTTY:ctty/update-fileio
Open

feat!(storage): Integration Storage trait with FileIO#2116
CTTY wants to merge 2 commits intoapache:mainfrom
CTTY:ctty/update-fileio

Conversation

@CTTY
Copy link
Collaborator

@CTTY CTTY commented Feb 5, 2026

Which issue does this PR close?

What changes are included in this PR?

  • Update FileIO to hold dyn Storage instead of OpenDalStorage
  • Update FileIOBuilder accordingly
  • Removed Extensions from FileIO
  • Add with_storage_factory in CatalogBuilder and update all implementations accordingly
  • Add an optional dyn StorageFactory to IcebergTableProviderFactory
  • Update other FileIOBuilder usages accordingly

Are these changes tested?

Mostly rely on the existing tests, added some uts for FileIOBuilder

use crate::runtime::runtime;

/// Parse the scheme from a URL and return the appropriate StorageFactory.
fn storage_factory_from_path(path: &str) -> PyResult<Arc<dyn StorageFactory>> {
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We probably need to add storage wrapper for user to better configure the storage backend they want to use. Right now it's hard wired to opendal for simplicity

@CTTY CTTY added the breaking label Feb 6, 2026
@CTTY CTTY force-pushed the ctty/update-fileio branch from 082d2d2 to 7d692d8 Compare February 12, 2026 16:12
@CTTY CTTY marked this pull request as ready for review February 12, 2026 16:23
@CTTY CTTY requested review from Xuanwo and blackmwk February 12, 2026 16:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integrate Storage trait with FileIO and related structs

1 participant