go-db-etl

Actions

Private repo for CI/CD orchestrations.

Description

go-db-etl is intended to be a handy tool for loading data out of mutliple data sources and insert into another data source. This may include targets such as Data Warehouses.
Further more it will build a history of the data loads in a so called raw data vault. (rdv). The load history has been inspired by

The plan is to support multiple types of source systems such as:

• files
  • json
  • csv
• mysql
  • mariadb
  • innodb
• postgresql
• MSSQL
• neo4j
  • via JSON export

Docker

Images

Docker images are pubished on the github container registry:

• Main branch: ghcr.io/ooemperor/go-db-etl:main
• Development branch: ghcr.io/ooemperor/go-db-etl:development

Compose

If you want to build and run via docker compose you can use the following command:

docker compose -f .\build\docker-compose.yml up --build -d