Skip to content

Iceberg Add Files #37701

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ahmedabu98 wants to merge 8 commits into
base: master
Choose a base branch
from
+1,129 −4
Open

Iceberg Add Files #37701

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
9b9d553
add files transform and schematransform
ahmedabu98 Feb 23, 2026
98328b8
minor fixes
ahmedabu98 Feb 24, 2026
49936ab
add tests
ahmedabu98 Mar 5, 2026
096f9de
Merge branch 'master' of https://github.com/ahmedabu98/beam into iceb…
ahmedabu98 Mar 5, 2026
3b2e86d
create table if needed; determine partition spec from metrics
ahmedabu98 Mar 7, 2026
f507d0a
spotless
ahmedabu98 Mar 7, 2026
9045996
add batch route as well
ahmedabu98 Mar 10, 2026
d4a0db1
spotless
ahmedabu98 Mar 10, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion sdks/java/io/iceberg/build.gradle
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,7 @@ dependencies {
implementation library.java.joda_time
implementation "org.apache.parquet:parquet-column:$parquet_version"
implementation "org.apache.parquet:parquet-hadoop:$parquet_version"
implementation project(":sdks:java:io:parquet")
implementation "org.apache.orc:orc-core:$orc_version"
implementation "org.apache.iceberg:iceberg-core:$iceberg_version"
implementation "org.apache.iceberg:iceberg-api:$iceberg_version"
Expand All @@ -74,11 +75,11 @@ dependencies {
testImplementation library.java.bigdataoss_gcsio
testImplementation library.java.bigdataoss_util_hadoop
testImplementation "org.apache.parquet:parquet-avro:$parquet_version"
testImplementation "org.apache.parquet:parquet-common:$parquet_version"
testImplementation "org.apache.iceberg:iceberg-data:$iceberg_version"
testImplementation project(path: ":sdks:java:core", configuration: "shadowTest")
testImplementation project(":sdks:java:extensions:google-cloud-platform-core")
testImplementation library.java.junit
testImplementation library.java.hamcrest

// Hive catalog test dependencies
testImplementation project(path: ":sdks:java:io:iceberg:hive")
Expand Down
Loading
Loading