Skip to content

Reading Iceberg tables show 0.0B for the Input column on Spark's executor UI #5264

Description

@hsiang-c

Describe the bug

spark.comet.scan.icebergNative.enabled=true
Image

spark.comet.scan.icebergNative.enabled=false

Image

Steps to reproduce

SELECT COUNT(DISTINCT(col_string)) FROM $ICEBERG_TABLE WHERE ... (predicates)

Expected behavior

CometIcebergNativeScan should also report input size per executor.

Additional context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions