Skip to content

feat!(storage): Integration Storage trait with FileIO#2116

Merged
blackmwk merged 14 commits intoapache:mainfrom
CTTY:ctty/update-fileio
Mar 4, 2026
Merged

feat!(storage): Integration Storage trait with FileIO#2116
blackmwk merged 14 commits intoapache:mainfrom
CTTY:ctty/update-fileio

Conversation

@CTTY
Copy link
Collaborator

@CTTY CTTY commented Feb 5, 2026

Which issue does this PR close?

What changes are included in this PR?

  • Update FileIO to hold dyn Storage instead of OpenDalStorage
  • Update FileIOBuilder accordingly
  • Removed Extensions from FileIO
  • Add with_storage_factory in CatalogBuilder and update all implementations accordingly
  • Add an optional dyn StorageFactory to IcebergTableProviderFactory
  • Update other FileIOBuilder usages accordingly

Are these changes tested?

Mostly rely on the existing tests, added some uts for FileIOBuilder

@CTTY CTTY added the breaking label Feb 6, 2026
@CTTY CTTY force-pushed the ctty/update-fileio branch from 082d2d2 to 7d692d8 Compare February 12, 2026 16:12
@CTTY CTTY marked this pull request as ready for review February 12, 2026 16:23
@CTTY CTTY requested review from Xuanwo and blackmwk February 12, 2026 16:23
@mbutrovich mbutrovich self-requested a review February 25, 2026 16:26
@CTTY CTTY force-pushed the ctty/update-fileio branch from d74a640 to df9dcf0 Compare February 27, 2026 01:05
@CTTY
Copy link
Collaborator Author

CTTY commented Feb 27, 2026

Hi @blackmwk, this PR is to wrap up the phase 1 work of Storage trait and is ready for review

Copy link
Contributor

@blackmwk blackmwk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @CTTY for this pr, generally LGTM!

Copy link
Contributor

@blackmwk blackmwk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @CTTY for this pr!

@blackmwk blackmwk merged commit bc33657 into apache:main Mar 4, 2026
19 checks passed
gbrgr pushed a commit to RelationalAI/iceberg-rust that referenced this pull request Mar 10, 2026
<!--
We generally require a GitHub issue to be filed for all bug fixes and
enhancements and this helps us generate change logs for our releases.
You can link an issue to this PR using the GitHub syntax. For example
`Closes apache#123` indicates that this PR will close issue apache#123.
-->

- This depends on apache#2109
- Closes apache#2058

- Update `FileIO` to hold `dyn Storage` instead of `OpenDalStorage`
- Update `FileIOBuilder` accordingly
- Removed `Extensions` from `FileIO`
- Add `with_storage_factory` in `CatalogBuilder` and update all
implementations accordingly
- Add an optional `dyn StorageFactory` to `IcebergTableProviderFactory`
- Update other FileIOBuilder usages accordingly

<!--
Provide a summary of the modifications in this PR. List the main changes
such as new features, bug fixes, refactoring, or any other updates.
-->

Mostly rely on the existing tests, added some uts for FileIOBuilder
<!--
Specify what test covers (unit test, integration test, etc.).

If tests are not included in your PR, please explain why (for example,
are they covered by existing tests)?
-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integrate Storage trait with FileIO and related structs

2 participants