HDDS-13465. Adding an endpoint to get all storage distribution summary in Recon

[priyeshkaratha]

What changes were proposed in this pull request?

A new REST API endpoint /storagedistribution has been introduced to provide a summarized view of storage distribution across the cluster. This endpoint is designed to consolidate various storage-related insights, particularly focusing on used capacity, pending deletions, and overall data distribution across Ozone components.

Key Functionalities

1. Endpoint Name: /storagedistribution
   • Exposes consolidated metrics related to the usage and distribution of storage.
2. Data Sources Used:
   • OMDBInsightEndpoint:
     • Retrieves OM-level data such as bucket-level usage, namespace size, and used capacity
   • SCMClient:
     • Fetches pending deletion metrics from SCM.
     • This includes block-level metadata such as size and replicated size info for accurate estimation of reclaimable space.
   • Datanode Storage Reports:
     • Gathers current storage usage statistics from individual datanodes.
     • Helps in determining used vs available capacity and contributes to classifying data distribution based on node-wise storage usage.

What is the link to the Apache JIRA

HDDS-13465

How was this patch tested?

Currently tested by unittestcases by mocking scm and dn data. Also tested manually using postman.

[ArafatKhan2198]

Thanks @priyeshkaratha some comments!
Please take a look

[priyeshkaratha]

closing this PR since approach is changed and is handled as part of #8995