Skip to content

Move pdpv0 into main branch#840

Closed
LexLuthr wants to merge 121 commits intomainfrom
pdpv0-main
Closed

Move pdpv0 into main branch#840
LexLuthr wants to merge 121 commits intomainfrom
pdpv0-main

Conversation

@LexLuthr
Copy link
Copy Markdown
Contributor

@LexLuthr LexLuthr commented Dec 16, 2025

  • 1. AJ: Remove all task name conflicts (in alignment with PDPv0 branch): done already
  • 2. AJ: Create an equivalent SQL file: Skip, current files work fine.
  • 3. MP: Set MinConfidence to 5 for message watcher and use MinConfidence 1 for Eth watch. Confirm that PDP does not use message watcher. If there are no instances then we can safely have both. Otherwise, flag this.
  • 4. MP: Move pdpv0 in a directory. Maybe update package name for pdpv0
  • 5. Finish Tacker Issue for pdpv0 to main fixes and features #695
  • 6. No common tasks for this PR between PDPv0 and PDPv1
  • 7. Add correct termination path to PDPv1. A modified version of PDPv0 implementation.
  • 8. Hook Up payment based deletion
  • 9. Review if any new IPNI changes are being done to PDPv0 and see if IPNI mess can be sorted.
  • 10. For now, IPNI has 3 TODOs. These are related to find a balance between PDP (Filecoin Pin) and PoRep.
  • 11. Merge ALL PRs since split (minus DB changes), including Rod's download from other SP PR once merged into PDPv0: feat(pdp): add SP-to-SP piece pull endpoint #864

Outside of the Scope of this PR but required for PDPv1.

  • Create+Add in PDPv1. Partially enabled in this PR by slight change to ChainScheduler.
  • Payment based deletion in PDPv1
  • Review ppInit, PPNext tasks in v1 and ensure everything is upto date with v0

For future:

  • Figure out how to reconcile IPNI peerIDs in service registry. Should we have separate registry entries?

rvagg and others added 30 commits August 4, 2025 21:53
* feat(pdp): commpv2 shim

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): commpv2 shim more

* fix(pdp): commpv2 fix upload commp digest comparison

* feat(pdp): update pdptool to do commpv2

* fix(pdp): update contract address

---------

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
Co-authored-by: Jakub Sztandera <oss@kubuxu.com>
* fix(pdp): use pgx.ErrNoRows

* chore(pdp): update contract address
* generate .abi from .json

* update abi

* abigen with make

* extract package name from stem

* rename

* use GetPDPConfig

* fix capitalization
…614)

Treat it as indirection to the contract that we can use to find a
contract that implements IPDPProvingSchedule that we can use for
proving parameters.
Using current Alpha release FilecoinWarmStorageService contract address on calibnet

Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
* feat: ui node cordon button

* improve visuals
* move proofsvc here

* layout tasks

* request task

* missing sql schema

* implement prove

* proofshare: Submit task

* proofshare webrpc

* proofshare web

* make gen

* fixes for basic flow

* client schema/ui

* improve market ui more

* pure Go post proof verification

* proof bincode encode

* bg task name

* wip genadt

* cborlink

* update cbor-gen

* init router

* debug commands

* working deposit

* most flows working

* Withdraw, DST

* Complete Withdraw

* more info

* Plumb most of the remaining stuff

* router wallet ui start

* webui balance add

* make gen

* client message listing

* usable withdrawal

* ui: price settings

* pricing integration

* sort of working c1outraw cbor

* undo

* wip pricing changes

* voucher check utils

* persist provider payments

* wip

* wip remote task pipeline

* cleanup client

* guided setup for non-sp cluster

* correct enable

* make gen

* wallet source fixes

* don't retry bad batch tasks for no reason

* missing clientctl

* closer to working

* payment recovery

* fix payment undo

* ocean of fixes

* make gen

* basic backoffs

* record provider payments correctly

* some settle ui

* redeem improvements

* ui: wallet hover details

* provider settle button

* minor fixes

* more submit retry

* snap vanilla verif on proof type

* missing files

* snap snark check

* remote snap prove task

* snap pricing

* close to final provider ui

* gen, new ledger types

* more types

* block helpers

* svc l2 iteration

* make gen

* svc contract final touches

* snksvc client cli

* snk ask withdraw

* dedup reassigned requests

* handle pow

* prove oldest first

* sig msg type, gen

* signing impl

* basic noncecache

* signer fixes

* wire up signatures

* make gen

* tos

* tos in schema

* deployment settings

* Apply suggestions from code review

Co-authored-by: Andrew Jackson (Ajax) <snadrus@gmail.com>

* tos finalization

* add licence term to psvc packages

* make gen

* rm temp task skip

* fix initial provider form

* remove useless price epoch from proof request

* gone work handling

* cache client read calls

* fixed client price math

* log zero price

* pricing debug

* more pricinc debug

* fix price cache

* caches are hard

* allow separate cql db

* register proving tasks when remote proving is enabled

* what

* more detailed logs

* filter market prices

* good logs are good

* Provider autosettle

* fix infer nvme devices

* Don't auto-accept AI suggestions

* Wallet Balance Manager

* gofmt

* make gen

* web: compact pretty epoch in porep pipeline

* del unused scripts/gen.go

* lint fixes

* faster poll

* poll metrics

* client payments table stats

* provider: smarter sched logic

* hold the correct way

* attempt at smart storage allocation

* storage tuning

* rm bs fetch limit

* fix likely deadlock

* refactor client pipeline

* gen, default upload max

* review

* fix orphan send

* fix name len limit

* fix null in psvc poll

* eww

* fix porep get

* fix snap too

* fix poll edge-cases

* send fixes

* filter spdis in createpayment correctly

* fix bad src address

* fix proof retry hopefully

* optimized snark candidate picker

* mark finished submit when orphaned

* make gen

* cleanup abandoned tasks

* more generous retry

* fix lint

* drop default hardhat readme

* validate wallet input strings

* fix ctxlk test

* fix chainhead ddos

* address review

* make gen

* translations

* gen translations

* cleanup stray todo

---------

Co-authored-by: Andrew Jackson (Ajax) <snadrus@gmail.com>
* basic wallet exporter

* plumb into the constructor

* fix lint

* increasing bucket order

* make gen

* move wallet exporter config to subsystems

* missing file

* docs

* post-merge make gen
* per sector commit simulation

* fix batching timezone
* sector sched UI

* confirm btn

* integrate into supraseal

* fix table

* make gen

* don't start batch seal with too-few sectors

* rename scheduler upsert rpc to edit
* snark market balancemgr ui/schema

* balancemgr filter supported types in CanAccept

* implement proofshare bmgr do

* make gen

* cleanup

* fix msg tracking address type
* cordon: yield bg tasks

* make PSClientPoll yield as well

* harmonytask: Scheduling Overrides

* metrics: record version

* fix build

* smart restart

* webui: Jsonrpc reconnect fixes

* webui: restart requests

* make gen

* jrpc reject on conn fail

* missing schema file

* rm snake case
* release v1.26.0

* fix FFI version
Specifying @filecoin-project/curio as the codeowners so that branch protection rules / rulesets against `main` that "Require review from Code Owners" actually has enforcement.
Kubuxu and others added 12 commits November 7, 2025 17:07
* chore: remove trailing spaces

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): pdss -> pdds in processPendingDeletes

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): watch_piece_delete rm_message_hex -> rm_message_hash

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): processIndexingAndIPNICleanup, piece_size -> piece_padded_size

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): processIndexingAndIPNICleanup, piece_size -> piece_padded_size

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): metadata not existing, it is just default IPFS gateway meta

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): the query uses ID not PieceRef

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* chore: fix imports

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): missing continue if msg status is not known

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* fix(pdp): update rm_message_hash in handleDeleteDataSetPiece

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

---------

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
* fix(pdp): commit removal transaction when we don't have IPNI ads

Currently the transaction will be rolled back when there are no IPNI ads
for the pieces.

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

* chore(pdp): make cleaning up log more accurate

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

---------

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
Just misc error and log output fixes

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
* fix: align address decoding with Solidity canonical behavior

* fix(pdp): Align capability address decoding to match Solidity behavior (Fixes #758)

* Minor changes

* Changes

* Logic change
* return 404 for piece retrievals correctly

* fix multiple wrapped errors with xerrors.Errorf

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>

---------

Signed-off-by: Jakub Sztandera <oss@kubuxu.com>
Co-authored-by: Jakub Sztandera <oss@kubuxu.com>
Co-authored-by: Rod Vagg <rod@vagg.org>
Preserve the original PieceCID from the URL and use it for the
Content-Disposition header filename.

Fixes #824

Signed-off-by: Anubhav Singh <anubhavsingh@Anubhavs-MacBook-Air.local>
Co-authored-by: Anubhav Singh <anubhavsingh@Anubhavs-MacBook-Air.local>
@LexLuthr LexLuthr requested a review from a team as a code owner December 16, 2025 15:18
@LexLuthr LexLuthr mentioned this pull request Dec 18, 2025
@BigLep BigLep added this to the M4.5: GA Fast Follows milestone Jan 12, 2026
@BigLep BigLep added the team/fs-wg Items being worked on or tracked by the "FS Working Group". See FilOzone/github-mgmt #10 label Jan 12, 2026
@FilOzzy FilOzzy added this to FOC Jan 12, 2026
@github-project-automation github-project-automation Bot moved this to 📌 Triage in FOC Jan 12, 2026
@rjan90 rjan90 moved this from 📌 Triage to 🐱 Todo in FOC Jan 28, 2026
@LexLuthr LexLuthr marked this pull request as draft February 18, 2026 08:34
@LexLuthr LexLuthr closed this Feb 19, 2026
@github-project-automation github-project-automation Bot moved this from 🐱 Todo to 🎉 Done in FOC Feb 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

team/fs-wg Items being worked on or tracked by the "FS Working Group". See FilOzone/github-mgmt #10

Projects

None yet

Development

Successfully merging this pull request may close these issues.