Skip to content

Conversation

@rameeshm
Copy link
Contributor

Hive Insert command failed in Ranger Docker setup due to authentication and authorization issue.

  1. apache-tez-0.10.4-bin.tar.gz failed to copy into /apps/tez due to lack of kerberos token present while copying.
  2. user "hive" needs hdfs RWX permission to create folder and copy tez jar for insert to succeed.

What changes were proposed in this pull request?

  1. have default policy for user "hive" in hdfs repo.
  2. To the kinit for the hive and create necessary hdfs folder / files in /opt/tez folder for the Tez to work correctly during INSERT operation.

How was this patch tested?

Testing in the DOCKER.
Screenshot 2025-12-16 at 11 42 00 AM

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR addresses authentication and authorization failures in the Ranger Docker setup when executing Hive INSERT commands. The core issue was that the hive user lacked both Kerberos tokens for authentication and HDFS permissions for writing Tez libraries and temporary files required for INSERT operations.

Key Changes:

  • Added Kerberos authentication (kinit/kdestroy) for hive user when performing HDFS operations in Kerberos-enabled environments
  • Created default HDFS policy granting hive user read/write/execute permissions for Tez operations
  • Refactored HDFS operations to use the hive user instead of hdfs user when Kerberos is enabled

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 5 comments.

File Description
dev-support/ranger-docker/scripts/hive/ranger-hive-setup.sh Added Kerberos authentication logic for hive user and split HDFS operations into Kerberos-enabled and non-Kerberos branches
dev-support/ranger-docker/scripts/admin/create-ranger-services.py Added default HDFS policy granting hive user permissions to access paths needed for Tez operations

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

…authentication and authorization issue - review comment fix
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated 12 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

…authentication and authorization issue - review comment fix #2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant