Skip to content

GCP: Add CloudMonitoringMetricsReporter to export Iceberg metrics to Cloud Monitoring#16107

Open
talatuyarer wants to merge 3 commits intoapache:mainfrom
talatuyarer:gcp-cloud-monitoring
Open

GCP: Add CloudMonitoringMetricsReporter to export Iceberg metrics to Cloud Monitoring#16107
talatuyarer wants to merge 3 commits intoapache:mainfrom
talatuyarer:gcp-cloud-monitoring

Conversation

@talatuyarer
Copy link
Copy Markdown
Contributor

This PR adds a new MetricsReporter implementation to the iceberg-gcp module that sends Iceberg scan and commit metrics to Google Cloud Monitoring.

@talatuyarer talatuyarer force-pushed the gcp-cloud-monitoring branch 4 times, most recently from 60316ce to fc34a15 Compare April 25, 2026 00:25
@stevenzwu stevenzwu changed the title Add CloudMonitoringMetricsReporter to export Iceberg metrics to Cloud Monitoring GCP: Add CloudMonitoringMetricsReporter to export Iceberg metrics to Cloud Monitoring Apr 30, 2026
Comment thread gcp-bundle/build.gradle
implementation "com.google.cloud:google-cloud-bigquery"
implementation "com.google.cloud:google-cloud-core"
implementation "com.google.cloud:google-cloud-kms"
implementation "com.google.cloud:google-cloud-monitoring"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should be very careful with dependency change for runtime bundle jar. was this PR created after all the dependency/license fixes. at least, rebase with the latest main branch. CI should catch dependency/license problems nowadays.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes I created this PR Last Friday. How can I verify that ? There is also license check too

https://github.com/apache/iceberg/actions/runs/25008117162/job/73236359466?pr=16107

@talatuyarer talatuyarer requested a review from stevenzwu May 5, 2026 15:44
…e Cloud Monitoring

	modified:   gcp/src/integration/java/org/apache/iceberg/gcp/metrics/TestCloudMonitoringMetricsReporterIntegration.java
	modified:   gcp/src/main/java/org/apache/iceberg/gcp/metrics/CloudMonitoringMetricsReporter.java
	modified:   gcp/src/test/java/org/apache/iceberg/gcp/metrics/TestCloudMonitoringMetricsReporter.java
…sses

	modified:   gcp/src/integration/java/org/apache/iceberg/gcp/metrics/TestCloudMonitoringMetricsReporterIntegration.java
	modified:   gcp/src/main/java/org/apache/iceberg/gcp/metrics/CloudMonitoringMetricsReporter.java
	modified:   gcp/src/test/java/org/apache/iceberg/gcp/metrics/TestCloudMonitoringMetricsReporter.java
@talatuyarer talatuyarer force-pushed the gcp-cloud-monitoring branch from c94ffc9 to 3a062b4 Compare May 5, 2026 19:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants