Encrypting IO as a DelegateFileIO#14876
Conversation
|
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
|
Bump to remove staleness |
|
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
|
not stale |
|
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
|
Bump to remove staleness |
|
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions. |
|
not stale |
52a182a to
cd054ad
Compare
| } | ||
|
|
||
| if (io instanceof SupportsPrefixOperations) { | ||
| if (io instanceof DelegateFileIO) { |
There was a problem hiding this comment.
I agree this isn't the nicest, but just following the existing pattern with SupportsPrefixOperations. DelegateFileIO is a very common case so I think we should support this flow
|
cc @huaxingao @ggershinsky @singhpk234 please may you take a look here? |
A table having encryption should not discount it from it supporting bulk operations (e.g.
iceberg/spark/v4.0/spark/src/main/java/org/apache/iceberg/spark/actions/DeleteOrphanFilesSparkAction.java
Lines 316 to 344 in 9ca8029
EncryptingFileIO#combinewill never result in aFIleIOthatSupportsBulkOperations.