docker buildx bake caddy --with params ignored?

[SmikeSix]

Ive done my own build script since i love the idea of php + go working together.

    CGO_ENABLED=1 \
    XCADDY_GO_BUILD_FLAGS="-ldflags='-w -s' -tags=nobadger,nomysql" \
    CGO_CFLAGS="$(php-config-zts --includes) -D_GNU_SOURCE" \
    CGO_LDFLAGS="$(php-config-zts --ldflags) $(php-config-zts --libs)" \
    xcaddy build \
        --output frankenphp \
        --with github.com/dunglas/frankenphp/caddy \
        --with github.com/ueffel/caddy-brotli \
        --with github.com/dunglas/vulcain/caddy \
        --with github.com/baldinof/caddy-supervisor 

if we use this approach and do the xcaddy build directly it works (besides the issues reported elsewhere)

 docker buildx bake \
        --load \
        --set static-builder-musl.platform=linux/amd64 \
        --set static-builder-musl.args.MIMALLOC=1 \
        --set static-builder-musl.args.XCADDY_ARGS="--with github.com/caddyserver/cache-handler --with github.com/darkweak/souin/plugins/caddy" \
        --set static-builder-musl.args.SPC_PARALLEL_JOBS=$CORES \
        --set static-builder-musl.args.MAKEFLAGS="-j$CORES" \
        --set static-builder-musl.args.CMAKE_BUILD_PARALLEL_LEVEL=$CORES \
        --set static-builder-musl.args.NO_COMPRESS=1 \
        static-builder-musl 2>&1 | tee $SERVER_ROOT/build/setup.log

but when using the docker build with any -- with caddy args, and im not sure if i did it wrong - but they do not seem to be passes through fully. We end up with the ones that are hardcoded when nothing is given. at least i couldnt see anything being added to the log outputs later on.

maybe im wrong though