Skip to content

H-6617: Create custom graph rendering pipeline inside frontend - #8952

Draft
indietyp wants to merge 517 commits into
mainfrom
bm/h-6617-experiment-with-graph-rendering-inside-of-hash-graph
Draft

H-6617: Create custom graph rendering pipeline inside frontend#8952
indietyp wants to merge 517 commits into
mainfrom
bm/h-6617-experiment-with-graph-rendering-inside-of-hash-graph

Conversation

@indietyp

@indietyp indietyp commented Jul 3, 2026

Copy link
Copy Markdown
Member

🌟 What is the purpose of this PR?

🔗 Related links

  • ...

🚫 Blocked by

  • ...

🔍 What does this change?

  • ...

Pre-Merge Checklist 🚀

🚢 Has this modified a publishable library?

This PR:

  • does not modify any publishable blocks or libraries, or modifications do not need publishing
  • modifies an npm-publishable library and I have added a changeset file(s)
  • modifies a Cargo-publishable library and I have amended the version
  • modifies a Cargo-publishable library, but it is not yet ready to publish
  • modifies a block that will need publishing via GitHub action once merged
  • I am unsure / need advice

📜 Does this require a change to the docs?

The changes in this PR:

  • are internal and do not require a docs change
  • are in a state where docs changes are not yet required but will be
  • require changes to docs which are made as part of this PR
  • require changes to docs which are not made in this PR
    • Provide more detail here
  • I am unsure / need advice

🕸️ Does this require a change to the Turbo Graph?

The changes in this PR:

  • do not affect the execution graph
  • affected the execution graph, and the turbo.json's have been updated to reflect this
  • I am unsure / need advice

⚠️ Known issues

🐾 Next steps

🛡 What tests cover this?

❓ How to test this?

  1. Checkout the branch / view the deployment
  2. Try X
  3. Confirm that Y

📹 Demo

@vercel

vercel Bot commented Jul 3, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
hash Ready Ready Preview Aug 14, 2026 1:34pm
petrinaut Ready Ready Preview Aug 14, 2026 1:34pm
1 Skipped Deployment
Project Deployment Actions Updated (UTC)
hashdotdesign-tokens Ignored Ignored Preview Aug 14, 2026 1:34pm

@github-actions github-actions Bot added area/deps Relates to third-party dependencies (area) area/apps > hash* Affects HASH (a `hash-*` app) area/infra Relates to version control, CI, CD or IaC (area) area/apps > hash-api Affects the HASH API (app) area/libs Relates to first-party libraries/crates/packages (area) type/eng > frontend Owned by the @frontend team type/eng > backend Owned by the @backend team area/apps labels Jul 3, 2026

indietyp commented Jul 3, 2026

Copy link
Copy Markdown
Member Author

@vercel
vercel Bot temporarily deployed to Preview – petrinaut July 3, 2026 16:19 Inactive
@indietyp
indietyp force-pushed the bm/h-6617-experiment-with-graph-rendering-inside-of-hash-graph branch from 2fbcafb to e313dac Compare July 3, 2026 16:21
@codspeed-hq

codspeed-hq Bot commented Jul 3, 2026

Copy link
Copy Markdown

Merging this PR will regress 2 benchmarks

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 14 improved benchmarks
❌ 2 regressed benchmarks
✅ 82 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Benchmark BASE HEAD Efficiency
bit_matrix/dense/union_rows[1000] 102.4 µs 119.3 µs -14.16%
bit_matrix/sparse/union_rows[1000] 126.3 µs 144.8 µs -12.82%
n50000_d256[32] 1,467.9 ms 696.5 ms ×2.1
n10000_d256[128] 4 s 1.9 s ×2.1
n10000_d256[32] 1,033.5 ms 517.7 ms +99.63%
n10000_d256[8] 94.3 ms 47.9 ms +96.69%
d256[64] 68.3 µs 40.7 µs +67.74%
d1536[16] 111.6 µs 70.6 µs +57.92%
d3072[16] 221.2 µs 140.2 µs +57.76%
d256[16] 19.5 µs 12.5 µs +56.75%
d256[15] 18.6 µs 12.4 µs +50.22%
kernel/micro_4x2[256] 4.9 µs 3.8 µs +27.89%
kernel/micro_4x2[1536] 23.9 µs 18.8 µs +27.01%
kernel/micro_4x2[3072] 46.8 µs 36.8 µs +26.99%
bit_matrix/dense/iter_row[1000] 496.4 ns 440.8 ns +12.6%
kernel/dot[256] 1.3 µs 1.2 µs +10.56%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing bm/h-6617-experiment-with-graph-rendering-inside-of-hash-graph (6c41b64) with main (276e17d)1

Open in CodSpeed

Footnotes

  1. No successful run was found on main (aafb03b) during the generation of this report, so 276e17d was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Comment thread tools/embedding-worker/embed.py Outdated
@codecov

codecov Bot commented Jul 3, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 0% with 19 lines in your changes missing coverage. Please review.
✅ Project coverage is 61.51%. Comparing base (a1d86bd) to head (7b47685).
⚠️ Report is 16 commits behind head on main.

Files with missing lines Patch % Lines
apps/hash-api/src/atlas-proxy.ts 0.00% 12 Missing ⚠️
.../src/graph/knowledge/primitive/cluster-entities.ts 0.00% 7 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #8952      +/-   ##
==========================================
+ Coverage   59.19%   61.51%   +2.32%     
==========================================
  Files        1389     1248     -141     
  Lines      135001   123443   -11558     
  Branches     6183     5785     -398     
==========================================
- Hits        79910    75936    -3974     
+ Misses      54151    46623    -7528     
+ Partials      940      884      -56     
Flag Coverage Δ
apps.hash-ai-worker-py ?
apps.hash-ai-worker-ts 1.92% <ø> (ø)
apps.hash-api 7.57% <0.00%> (-0.03%) ⬇️
backend-integration-tests ?
blockprotocol.type-system 40.84% <ø> (ø)
deer ?
error-stack ?
local.claude-hooks 0.00% <ø> (ø)
local.harpc-client 51.49% <ø> (ø)
local.hash-backend-utils 1.88% <ø> (ø)
local.hash-graph-sdk 10.02% <ø> (ø)
local.hash-isomorphic-utils 0.17% <ø> (ø)
local.hash-subgraph ?
rust.antsi 0.00% <ø> (ø)
rust.deer ?
rust.error-stack 90.89% <ø> (ø)
rust.harpc-codec 84.70% <ø> (ø)
rust.harpc-net 96.24% <ø> (+0.04%) ⬆️
rust.harpc-tower 67.03% <ø> (ø)
rust.harpc-types 0.00% <ø> (ø)
rust.harpc-wire-protocol 92.23% <ø> (ø)
rust.hash-codec 72.76% <ø> (ø)
rust.hash-graph-api ?
rust.hash-graph-authorization 62.59% <ø> (ø)
rust.hash-graph-embeddings 91.88% <ø> (ø)
rust.hash-graph-postgres-store 24.57% <ø> (-0.03%) ⬇️
rust.hash-graph-store 38.28% <ø> (-0.20%) ⬇️
rust.hash-graph-temporal-versioning 47.95% <ø> (ø)
rust.hash-graph-types 0.00% <ø> (ø)
rust.hash-graph-validation 84.71% <ø> (ø)
rust.hashql-ast 89.63% <ø> (ø)
rust.hashql-compiletest 28.39% <ø> (ø)
rust.hashql-core 78.98% <ø> (ø)
rust.hashql-diagnostics 72.51% <ø> (ø)
rust.hashql-eval 80.04% <ø> (ø)
rust.hashql-hir 89.09% <ø> (ø)
rust.hashql-mir 87.92% <ø> (ø)
rust.hashql-syntax-jexpr 94.04% <ø> (ø)
rust.sarif ?
sarif ?
tests.hash-backend-integration ?
unit-tests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@vercel
vercel Bot temporarily deployed to Preview – petrinaut July 3, 2026 16:26 Inactive
@github-actions github-actions Bot removed the area/libs Relates to first-party libraries/crates/packages (area) label Jul 3, 2026
@vercel
vercel Bot temporarily deployed to Preview – petrinaut July 3, 2026 16:40 Inactive
@indietyp
indietyp force-pushed the bm/be-629-implement-kmeans-clustering-in-the-hash-graph branch from 7c7fadb to 26a8078 Compare July 6, 2026 07:44
@indietyp
indietyp force-pushed the bm/h-6617-experiment-with-graph-rendering-inside-of-hash-graph branch from f4af41d to a4a2e3d Compare July 6, 2026 07:44
@vercel
vercel Bot temporarily deployed to Preview – petrinaut July 6, 2026 07:49 Inactive
@indietyp
indietyp force-pushed the bm/h-6617-experiment-with-graph-rendering-inside-of-hash-graph branch from a4a2e3d to f91ab64 Compare July 6, 2026 07:57
@vercel
vercel Bot temporarily deployed to Preview – petrinaut July 6, 2026 08:01 Inactive
@indietyp
indietyp force-pushed the bm/h-6617-experiment-with-graph-rendering-inside-of-hash-graph branch from f91ab64 to efb273c Compare July 6, 2026 08:15
@vercel
vercel Bot temporarily deployed to Preview – petrinaut July 6, 2026 08:20 Inactive
- clarify that the rank-inverse check is a bounded sample, not a full proof
- replace comma splices in schedule and cut docs
- replace each format's own endianness flag with a shared Machine word
- bump every file format's layout version by one
- make EdgeRecord/GroupRecord generic over validated row and scalar types
- reject out-of-domain values at the file parse instead of index validation
- make ScopeRow, ScopeSchedule::over, and the cut re-export module-private
- move their white-box tests into schedule::tests alongside them
- add heap_bytes to the bitset, visibility proof, and scope schedule
- split cache.rs into cache::{scope, tests} and weigh entries by retained memory
- store typed row ids and domain-typed confidences in InstanceRecord
- reject out-of-domain confidences at the spool's mapped parse
- delete the unchecked constructors from the read-back path
- catch-all now merges per-bucket segments and re-sorts on every read instead of caching a materialized tail
- heap_bytes no longer charges for a tail that isn't retained
- stop forcing the saturated memo to build when weighing a small scope
- add a per-container allowance and the cache key's inline size to the estimate
- saturate the weight fold instead of risking overflow
- compile disjoint column-equality tuples in an Any group into one UNNEST/row-membership predicate instead of one branch per tuple
- add owned SQL parameters (SqlParameter, add_owned_parameter) so array literals can be bound in one shot
- read_detail moves from query_opt to query_raw and now explicitly rejects a second row
- add capture/verify harness (route_fixture.rs) and the checked-in fixture pair
- document the declaration-readback contract in wire.md
- add the TypeScript conformance case that decodes it under the served schedule
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/apps > hash.design Affects the `hash.design` design site (app) area/apps > hash* Affects HASH (a `hash-*` app) area/apps > hash-api Affects the HASH API (app) area/apps > hash-graph area/apps area/deps Relates to third-party dependencies (area) area/infra Relates to version control, CI, CD or IaC (area) area/libs Relates to first-party libraries/crates/packages (area) area/tests New or updated tests type/eng > backend Owned by the @backend team type/eng > frontend Owned by the @frontend team type/legal Owned by the @legal team

Development

Successfully merging this pull request may close these issues.

3 participants