Skip to content

Database Adapter #1054

Draft
marcocapozzoli wants to merge 7 commits intomasterfrom
masc/1013-db-adapter-thread-pool
Draft

Database Adapter #1054
marcocapozzoli wants to merge 7 commits intomasterfrom
masc/1013-db-adapter-thread-pool

Conversation

@marcocapozzoli
Copy link
Copy Markdown
Collaborator

Testing the database adapter with thread pooling.

…sumer count in ThreadPool from 4 to 8 for improved concurrency.
…agement

- Added BoundedSharedQueue class with enqueue, dequeue, empty, and size methods.
- Updated DatabaseMappingJob, AtomPersistenceJob, and AtomPersistenceJob2 to use BoundedSharedQueue.
- Refactored Pipeline and PostgresWrapper to replace SharedQueue with BoundedSharedQueue.
- Introduced BatchConsumer for managing batch processing with ThreadPool.
- Adjusted logging and batch size configurations for better performance.
… to Atom/Metta transformation

- Added DatabaseLoader.h and DatabaseLoader.cc to handle database mapping jobs.
- Introduced DatabaseMapper.h and DatabaseMapper.cc for mapping SQL rows to Metta S-Expressions and Atom objects.
- Created DatabaseTypes.h to define structures for SQL rows and column values.
- Updated PostgresWrapper and DatabaseWrapper to include new database mapping functionalities.
- Enhanced main application with a new entry point for database adapter operations.
- Updated build configurations to include new source files and dependencies.
- Modified test files to integrate new database loader and mapper functionalities.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant