-
Notifications
You must be signed in to change notification settings - Fork 4.8k
HIVE-26877: Parquet CTAS with JOIN on decimals with different precision/scale fail #6274
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HIVE-26877: Parquet CTAS with JOIN on decimals with different precision/scale fail #6274
Conversation
thomasrebele
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
| return new TimestampDataWriter((TimestampObjectInspector)inspector); | ||
| case DECIMAL: | ||
| return new DecimalDataWriter((HiveDecimalObjectInspector)inspector); | ||
| return new DecimalDataWriter((HiveDecimalObjectInspector) inspector, |
This comment was marked as resolved.
This comment was marked as resolved.
Sorry, something went wrong.
ql/src/test/queries/clientpositive/parquet_join_dec_col_diff_pre_scale.q
Outdated
Show resolved
Hide resolved
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/write/DataWritableWriter.java
Outdated
Show resolved
Hide resolved
soumyakanti3578
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall LGTM logically. Please consider resolving the remaining comments.
ql/src/test/queries/clientpositive/parquet_join_dec_col_diff_pre_scale.q
Outdated
Show resolved
Hide resolved
fd70f84 to
f3405b0
Compare
|



HIVE-26877: Parquet CTAS with JOIN on decimals with different precision/scale fail
What changes were proposed in this pull request?
While creating the writer object, if it is decimal type then using the precision and scale from schema instead of object inspector.
Why are the changes needed?
To fix the issue HIVE-26877
Does this PR introduce any user-facing change?
No
How was this patch tested?
Added q file test
mvn test -Dtest=TestMiniLlapLocalCliDriver -Dqfile=parquet_join_dec_col_diff_pre_scale.q -pl itests/qtest -Pitests