Skip to content

HIVE-29534: getColStatistics to use HMS NDV values for DATE/TIMESTAMP column types#6406

Open
konstantinb wants to merge 3 commits intoapache:masterfrom
konstantinb:HIVE-29534
Open

HIVE-29534: getColStatistics to use HMS NDV values for DATE/TIMESTAMP column types#6406
konstantinb wants to merge 3 commits intoapache:masterfrom
konstantinb:HIVE-29534

Conversation

@konstantinb
Copy link
Copy Markdown
Contributor

@konstantinb konstantinb commented Apr 2, 2026

What changes were proposed in this pull request?

HIVE-29534: getColStatistics to use HMS NDV values forDATE/TIMESTAMP column types

Why are the changes needed?

Using statistics info for these fields when available could improve query planning/performance

Does this PR introduce any user-facing change?

No

How was this patch tested?

reviewed impacted .out files

@konstantinb konstantinb changed the title HIVE-29534: getColStatistics to use HMS NDV values forDATE/TIMESTAMP column types HIVE-29534: getColStatistics to use HMS NDV values for DATE/TIMESTAMP column types Apr 2, 2026
Copy link
Copy Markdown
Member

@zabetak zabetak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am fully supportive of this change. Even though it leads to many .q.out changes not having NDV for DATE/TIMESTAMP columns is a genuine bug that requires a fix. In its current state, some .q.out files seem to be a bit messed up but once you get a clean run with all .q.out correctly updated I will approve the PR.

@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud bot commented Apr 7, 2026

@konstantinb konstantinb marked this pull request as ready for review April 7, 2026 17:44
@konstantinb
Copy link
Copy Markdown
Contributor Author

I needed to rebase the branch and regenerate JSON .out files. All tests pass now

@konstantinb konstantinb requested a review from zabetak April 7, 2026 17:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants