Skip to content

Permission indexing creates unused, orphan perm docs for unchanged files in draft versions#12094

Merged
sekmiller merged 16 commits intoIQSS:developfrom
QualitativeDataRepository:indexingperf3
Feb 10, 2026
Merged

Permission indexing creates unused, orphan perm docs for unchanged files in draft versions#12094
sekmiller merged 16 commits intoIQSS:developfrom
QualitativeDataRepository:indexingperf3

Conversation

@qqmyers
Copy link
Copy Markdown
Member

@qqmyers qqmyers commented Jan 16, 2026

What this PR does / why we need it: At some point, content indexing was updated such that files in a released version, whose metadata has not changed in a draft version, are no longer indexed in the draft version (so you could still find the file from the released version, but would not know it existed in a newer draft as well from the search results alone - a minor inconvenience to avoid doubling the cost of indexing files when new drafts are created.)

However, permission indexing was not updated to match and thus, when permissions are indexed, files in this situation get perm docs for both the released version (where a matching content doc exists) and the draft version (where no content doc has been created). This PR fixes that and uses the same approach in permission indexing to not perm reindex files if their metadata does not change.

Which issue(s) this PR closes:

  • Closes #

Special notes for your reviewer: The PR builds on #12082 and #12093 which can hopefully be merged first. The final fix here is relatively straight forward - just ~reusing the existing logic from the content indexing - I did change the query to return file ids rather than filemetadata ids since we don't have easy access to the filemetadata ids on the permission side due to earlier optimizations.

Suggestions on how to test this: Primarily regression testing - visible indexing and search shouldn't change. The one effect that can be seen is that there will no longer be perm docs for a files in a post-release draft version that don't have metadata changes. That can be seen via the Solr console/direct query to Solr.

Does this PR introduce a user interface change? If mockups are available, please link/include them here:

Is there a release notes update needed for this change?:

Additional documentation:

@qqmyers qqmyers added the Size: 3 A percentage of a sprint. 2.1 hours. label Jan 16, 2026
@qqmyers qqmyers moved this to Ready for Triage in IQSS Dataverse Project Jan 16, 2026
@coveralls
Copy link
Copy Markdown

coveralls commented Jan 16, 2026

Coverage Status

coverage: 24.354% (+0.02%) from 24.334%
when pulling da704b9 on QualitativeDataRepository:indexingperf3
into 180aa55 on IQSS:develop.

@scolapasta scolapasta moved this from Ready for Triage to Ready for Review ⏩ in IQSS Dataverse Project Jan 20, 2026
@landreev landreev moved this from Ready for Review ⏩ to In Review 🔎 in IQSS Dataverse Project Jan 20, 2026
@landreev landreev self-assigned this Jan 20, 2026
@landreev
Copy link
Copy Markdown
Contributor

I'm ready to approve this, but will wait until the other 2 PRs are merged, to avoid any confusion.

@github-project-automation github-project-automation Bot moved this from In Review 🔎 to Ready for QA ⏩ in IQSS Dataverse Project Jan 27, 2026
@landreev landreev removed their assignment Jan 27, 2026
@cmbz cmbz added FY26 Sprint 15 FY26 Sprint 15 (2026-01-14 - 2026-01-28) FY26 Sprint 16 FY26 Sprint 16 (2026-01-28 - 2026-02-11) labels Jan 29, 2026
@sekmiller sekmiller self-assigned this Feb 10, 2026
@sekmiller sekmiller moved this from Ready for QA ⏩ to QA ✅ in IQSS Dataverse Project Feb 10, 2026
@sekmiller sekmiller merged commit 1cc3391 into IQSS:develop Feb 10, 2026
13 of 14 checks passed
@github-project-automation github-project-automation Bot moved this from QA ✅ to Merged 🚀 in IQSS Dataverse Project Feb 10, 2026
@scolapasta scolapasta moved this from Merged 🚀 to Done 🧹 in IQSS Dataverse Project Feb 11, 2026
@pdurbin pdurbin added this to the 6.10 milestone Feb 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

FY26 Sprint 15 FY26 Sprint 15 (2026-01-14 - 2026-01-28) FY26 Sprint 16 FY26 Sprint 16 (2026-01-28 - 2026-02-11) Size: 3 A percentage of a sprint. 2.1 hours.

Projects

Status: Done 🧹

Development

Successfully merging this pull request may close these issues.

7 participants