Encountering an error at random sometimes where Received shutdown signal hangs.
By force killing the process, it gets the queue in a weird state. When restarting the node ace queue:work process, I see this error
[14:51:55.462] ERROR (23892): Worker error
queueName: "default"
err: {
"type": "Error",
"message": "Connection is closed.",
"stack":
Error: Connection is closed.
at EventEmitter.sendCommand (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/ioredis@5.6.1/node_modules/ioredis/built/Redis.js:332:28)
at Script.execute (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/ioredis@5.6.1/node_modules/ioredis/built/Script.js:59:26)
at EventEmitter.extendLocks:5.56.0 (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/ioredis@5.6.1/node_modules/ioredis/built/utils/Commander.js:111:27)
at Scripts.execCommand (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/scripts.js:41:46)
at Scripts.extendLocks (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/scripts.js:362:21)
at async /Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/worker.js:789:39
at async trace (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/utils.js:304:20)
at async Worker.extendLocks (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/worker.js:782:9)
at async Timeout._onTimeout (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/worker.js:732:29)
Only way to fix this is to force kill the process pkill -9 -f "node ace queue:work"
Encountering an error at random sometimes where
Received shutdown signalhangs.By force killing the process, it gets the queue in a weird state. When restarting the
node ace queue:workprocess, I see this error[14:51:55.462] ERROR (23892): Worker error queueName: "default" err: { "type": "Error", "message": "Connection is closed.", "stack": Error: Connection is closed. at EventEmitter.sendCommand (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/ioredis@5.6.1/node_modules/ioredis/built/Redis.js:332:28) at Script.execute (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/ioredis@5.6.1/node_modules/ioredis/built/Script.js:59:26) at EventEmitter.extendLocks:5.56.0 (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/ioredis@5.6.1/node_modules/ioredis/built/utils/Commander.js:111:27) at Scripts.execCommand (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/scripts.js:41:46) at Scripts.extendLocks (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/scripts.js:362:21) at async /Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/worker.js:789:39 at async trace (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/utils.js:304:20) at async Worker.extendLocks (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/worker.js:782:9) at async Timeout._onTimeout (/Users/lukasz/Developer/github.com/motion-creative/agent-builder/apps/backend/node_modules/.pnpm/bullmq@5.56.0/node_modules/bullmq/dist/cjs/classes/worker.js:732:29)Only way to fix this is to force kill the process
pkill -9 -f "node ace queue:work"