Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
176 commits
Select commit Hold shift + click to select a range
8a4e552
fixed compose for wsl
StangaSimo Aug 27, 2025
d848d60
fixed postegress on brokeroo, added kafka on compose and on brokeroo
StangaSimo Aug 29, 2025
6c45947
fixed the fix that unfixed traky
StangaSimo Aug 29, 2025
53a012a
added simple cache and async logger
skipperoo Sep 1, 2025
9239b88
added StatVar delta distance from last point and fuel consumption
skipperoo Sep 1, 2025
025fa6a
Update logger.go
skipperoo Sep 1, 2025
963defd
added ctx on kafka write
StangaSimo Sep 2, 2025
76e1c65
added flink
StangaSimo Sep 3, 2025
393f24c
added retry for brokeroo on mqtt
StangaSimo Sep 3, 2025
4c4b93e
flink is aggregatingggggggg
StangaSimo Sep 4, 2025
e030769
added redis with fallback
skipperoo Sep 5, 2025
d710e4d
adding rabbitmq events watcher
skipperoo Sep 7, 2025
89dfbda
added redis + rabbit events for connection/disconnection
skipperoo Sep 8, 2025
51c09f6
minor fixes
skipperoo Sep 8, 2025
b8e7d38
flink flinking
StangaSimo Sep 9, 2025
0da7501
Merge branch 'master' into simo-dev
StangaSimo Sep 9, 2025
65ba84c
Merge branch 'ls-dev' into simo-dev
StangaSimo Sep 9, 2025
f4f356d
tracky fix
StangaSimo Sep 9, 2025
ac80b02
kube init
StangaSimo Sep 9, 2025
61bcafa
compose
skipperoo Sep 9, 2025
4c4a992
trakeroo broken
StangaSimo Sep 9, 2025
ccf58dd
compose
skipperoo Sep 9, 2025
4d6d87e
compose
skipperoo Sep 9, 2025
6c50d3b
nothing
StangaSimo Sep 9, 2025
04bd301
resolved conflict
StangaSimo Sep 9, 2025
1ac64a1
compose
skipperoo Sep 9, 2025
8ea8774
testing workflow
skipperoo Sep 9, 2025
c33a27a
testing workflow
skipperoo Sep 9, 2025
7fcf0fa
testing workflow
skipperoo Sep 9, 2025
b527d65
testing workflow
skipperoo Sep 9, 2025
db48ffa
testing workflow
skipperoo Sep 9, 2025
a794ec9
testing workflow
skipperoo Sep 9, 2025
a8713d4
testing workflow
skipperoo Sep 9, 2025
f3504a3
testing workflow
skipperoo Sep 9, 2025
ac8d947
testing workflow
skipperoo Sep 9, 2025
e40f7c4
testing workflow
skipperoo Sep 9, 2025
61c52a1
testing workflow
skipperoo Sep 9, 2025
88e6315
testing workflow
skipperoo Sep 9, 2025
5c68d02
added grafana sample dashboard
skipperoo Sep 9, 2025
1ba6c5b
flink update and small brokeroo fixes
StangaSimo Sep 10, 2025
2febdb4
adding http publish
skipperoo Sep 11, 2025
1c7119a
almost flink
StangaSimo Sep 16, 2025
7f0389d
refactor froc
StangaSimo Sep 16, 2025
ba2134e
light refactor of flink
StangaSimo Sep 23, 2025
5f835be
flink refactor
StangaSimo Sep 30, 2025
6154574
merged branches
skipperoo Oct 3, 2025
2c4ea5a
manual ack and removed redundant unmarshal
skipperoo Oct 6, 2025
68f2a6d
Merge branch 'dev' into ls-dev
skipperoo Oct 6, 2025
22047d0
Merge pull request #4 from skiby7/ls-dev
StangaSimo Oct 6, 2025
815c34a
parametri inseritiii
StangaSimo Oct 6, 2025
e45f23c
allowed preflight
skipperoo Oct 7, 2025
da37173
preflight
skipperoo Oct 7, 2025
bb7a4f6
Merge pull request #5 from skiby7/ls-dev
skipperoo Oct 7, 2025
4c0e765
updated gitignore
StangaSimo Oct 7, 2025
fd239d7
updated gitignore
StangaSimo Oct 7, 2025
6601f95
updated gitignore
StangaSimo Oct 7, 2025
ed7e6fa
updated gitignore
StangaSimo Oct 7, 2025
b97f939
removed .gradle
StangaSimo Oct 7, 2025
804470d
removed trash
StangaSimo Oct 7, 2025
a32c2f0
Merge pull request #6 from skiby7/simo-dev
StangaSimo Oct 7, 2025
4e3aefb
changed password
skipperoo Oct 7, 2025
51ef446
fixed schema to allow user apps access to schema trackeroo
skipperoo Oct 7, 2025
3ff728a
added build on pushes o dev
skipperoo Oct 7, 2025
795d227
changed init of tsdb in cluster
skipperoo Oct 7, 2025
18b0300
fixing tsdb
skipperoo Oct 7, 2025
f2495d1
fixing tsdb
skipperoo Oct 7, 2025
6c8e6dc
fixing \tsdb
skipperoo Oct 7, 2025
a98478d
fixing tsdb
skipperoo Oct 7, 2025
feabadb
fixing tsdb
skipperoo Oct 7, 2025
ebf151c
fixing tsdb
skipperoo Oct 7, 2025
b8edad1
fixing tsdb
skipperoo Oct 7, 2025
87cd46c
fixing tsdb
skipperoo Oct 7, 2025
2f2352b
fixing tsdb
skipperoo Oct 7, 2025
37674af
deploying infra
skipperoo Oct 7, 2025
d470334
deploying infra
skipperoo Oct 7, 2025
f3fc2df
deploying infra
skipperoo Oct 7, 2025
055f22f
deploying infra
skipperoo Oct 7, 2025
42f610a
deploying infra
skipperoo Oct 7, 2025
fdd8093
deploying infra
skipperoo Oct 7, 2025
e54d613
deploying infra
skipperoo Oct 7, 2025
c806102
sizes
skipperoo Oct 7, 2025
abac2d0
sizes
skipperoo Oct 7, 2025
d18d97e
fix
skipperoo Oct 7, 2025
65b05bb
fix
skipperoo Oct 7, 2025
a1ad3d5
fix
skipperoo Oct 7, 2025
0c874ef
fix
skipperoo Oct 7, 2025
b8ba3a6
fix
skipperoo Oct 7, 2025
601be8f
fix
skipperoo Oct 7, 2025
ae0460a
fix
skipperoo Oct 7, 2025
afa0d14
fix
skipperoo Oct 7, 2025
a91b2d7
fix
skipperoo Oct 7, 2025
a64e175
fix
skipperoo Oct 7, 2025
206816b
fix
skipperoo Oct 7, 2025
a6de197
fix
skipperoo Oct 7, 2025
18eed95
fix
skipperoo Oct 7, 2025
5719eda
fix
skipperoo Oct 7, 2025
b4dbf45
fix
skipperoo Oct 7, 2025
5cde7ef
fix
skipperoo Oct 7, 2025
fc85f31
fix
skipperoo Oct 7, 2025
44326f8
fix
skipperoo Oct 7, 2025
9f579fb
fix
skipperoo Oct 7, 2025
63edbff
fix
skipperoo Oct 7, 2025
eaf21a0
added retention policy to tsdb
skipperoo Oct 8, 2025
cbe781c
fixed trackeroo deployment
skipperoo Oct 8, 2025
98d78bc
fixed trackeroo deployment
skipperoo Oct 8, 2025
46fdbff
wrong user key mount
skipperoo Oct 8, 2025
1673e31
wrong user key mount
skipperoo Oct 8, 2025
e59b666
tried playbooks
StangaSimo Oct 8, 2025
c53cb74
tried playbooks
StangaSimo Oct 8, 2025
8818633
wrong user key mount
skipperoo Oct 8, 2025
4e8af5e
trackeroo pull polocy
skipperoo Oct 8, 2025
7dd54cc
preventing workloads to be scheduled on the servers
skipperoo Oct 8, 2025
b35032d
preventing workloads to be scheduled on the servers
skipperoo Oct 8, 2025
58d91f3
preventing workloads to be scheduled on the servers
skipperoo Oct 8, 2025
33e09c4
preventing workloads to be scheduled on the servers
skipperoo Oct 8, 2025
56bdcba
preventing workloads to be scheduled on the servers
skipperoo Oct 8, 2025
7a97fe0
preventing workloads to be scheduled on the servers
skipperoo Oct 8, 2025
3b1e65a
preventing workloads to be scheduled on the servers
skipperoo Oct 8, 2025
ef3d922
giving nodes more resources
skipperoo Oct 8, 2025
8bfa91c
redis access to disk
skipperoo Oct 8, 2025
a1a6920
trackeroo mqtt and rabbit handling
skipperoo Oct 8, 2025
e2cb400
trackeroo mqtt and rabbit handling
skipperoo Oct 8, 2025
986cdbf
trackeroo mqtt and rabbit handling
skipperoo Oct 8, 2025
0001d8f
trackeroo mqtt and rabbit handling
skipperoo Oct 8, 2025
4865ba2
ansible maybe
StangaSimo Oct 8, 2025
7825658
Merge remote-tracking branch 'origin/dev' into simo-dev
StangaSimo Oct 8, 2025
61d5be0
flink ansible fix
StangaSimo Oct 8, 2025
9b7bfaf
fix ansible
StangaSimo Oct 8, 2025
b1caaa6
fix
StangaSimo Oct 8, 2025
5521e59
gitignore
skipperoo Oct 8, 2025
b7c665d
fixed kafka
StangaSimo Oct 8, 2025
f3295fb
fix
StangaSimo Oct 8, 2025
2746491
fix
StangaSimo Oct 8, 2025
ca25918
kafka fix
StangaSimo Oct 8, 2025
1b68c0b
fix 1
StangaSimo Oct 8, 2025
6a98d8c
fix 2
StangaSimo Oct 8, 2025
30d682b
kafka
skipperoo Oct 8, 2025
b38fdfb
kafka
skipperoo Oct 8, 2025
ecbb920
kafka
skipperoo Oct 8, 2025
937d1e5
kafka
skipperoo Oct 8, 2025
ce2b17b
kafka
skipperoo Oct 8, 2025
7a079b4
fix 2
StangaSimo Oct 8, 2025
9c4da68
fix 2
StangaSimo Oct 8, 2025
b424ea1
fix kafka
StangaSimo Oct 8, 2025
2fcba99
tags
skipperoo Oct 8, 2025
c3a80be
fix kafka
StangaSimo Oct 8, 2025
197da5f
Merge branch 'simo-dev' of github.com:skiby7/sdc-project into simo-dev
skipperoo Oct 8, 2025
ef1f441
fix flink
StangaSimo Oct 8, 2025
d80ef7b
fix flink 2
StangaSimo Oct 8, 2025
d9b7602
fix flink port
StangaSimo Oct 8, 2025
530d79f
fix flink
StangaSimo Oct 8, 2025
a6f1039
fix flink
StangaSimo Oct 8, 2025
bd0c993
fix flink
StangaSimo Oct 8, 2025
dfeacac
fix flink
StangaSimo Oct 8, 2025
fac4f6d
fix flink
StangaSimo Oct 8, 2025
2832a12
fix flink
StangaSimo Oct 8, 2025
389c91d
Merge branch 'simo-dev' of github.com:skiby7/sdc-project into simo-dev
skipperoo Oct 8, 2025
31678ed
hoping that flink flinks
skipperoo Oct 8, 2025
d5bf2fe
hoping that flink flinks
skipperoo Oct 8, 2025
950074c
hoping that flink flinks
skipperoo Oct 8, 2025
bdd736b
hoping that flink flinkss
skipperoo Oct 8, 2025
157af78
Merge pull request #7 from skiby7/simo-dev
skipperoo Oct 8, 2025
351ba45
allocating resources to brokeroo
skipperoo Oct 8, 2025
c186c01
setting brokeroo replicas and client id
skipperoo Oct 8, 2025
42568a7
changed brokeroo from deployment to statefulset
skipperoo Oct 8, 2025
50a3aa1
prevent rabbit from deleting the messages upon disconnection
skipperoo Oct 8, 2025
44f49af
prevent rabbit from deleting the messages upon disconnection
skipperoo Oct 8, 2025
116a6ea
reverted
skipperoo Oct 8, 2025
1ce3ad3
benchmarking brokeroo
skipperoo Oct 8, 2025
d0b7d0c
shrinking batchsize
skipperoo Oct 8, 2025
4debeb3
auto ack
skipperoo Oct 8, 2025
a3ebe60
increased tsdb storage
skipperoo Oct 8, 2025
53746ff
small brokeroo updates
StangaSimo Oct 11, 2025
de15ca8
Merge branch 'dev' into simo-dev
StangaSimo Oct 11, 2025
eb7a27a
async added to brokero, maybe
StangaSimo Oct 11, 2025
28a1a41
removed .class
StangaSimo Oct 11, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 28 additions & 6 deletions .github/workflows/images-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,12 @@ name: Build and Push Docker Images

on:
push:
branches: [master]
branches: [master, dev]
paths:
- "images/**"
- "tsdb/**"
- "trackeroo-backend/**"
- "brokeroo/**"
- "flink_job/**"
workflow_dispatch:

jobs:
Expand All @@ -22,15 +25,33 @@ jobs:
list-files: shell
filters: |
tsdb:
- 'images/tsdb/**'
- 'tsdb/**'
trackeroo-backend:
- "trackeroo-backend/**"
brokeroo:
- "brokeroo/**"
flink_job:
- "flink_job/**"

build:
needs: detect
if: needs.detect.outputs.images != '[]'
runs-on: ubuntu-latest
strategy:
matrix:
image: ${{ fromJSON(needs.detect.outputs.images) }}
include:
- image: tsdb
context: ./tsdb
dockerfile: ./tsdb/Dockerfile
- image: trackeroo-backend
context: ./trackeroo-backend/src
dockerfile: ./trackeroo-backend/src/Dockerfile
- image: brokeroo
context: ./brokeroo
dockerfile: ./brokeroo/Dockerfile
- image: flink_job
context: ./flink_job
dockerfile: ./flink_job/Dockerfile
permissions:
contents: read
packages: write
Expand All @@ -47,13 +68,14 @@ jobs:
- name: Read version.yml
id: version
run: |
VERSION=$(yq e '.version' images/${{ matrix.image }}/version.yml)
VERSION=$(yq e '.version' ${{ matrix.context }}/version.yml)
echo "version=$VERSION" >> $GITHUB_OUTPUT

- name: Build and Push Docker image
uses: docker/build-push-action@v6
with:
context: ./images/${{ matrix.image }}
context: ${{ matrix.context }}
file: ${{ matrix.dockerfile }}
push: true
tags: |
ghcr.io/${{ github.repository_owner }}/${{ matrix.image }}:${{ steps.version.outputs.version }}
Expand Down
11 changes: 10 additions & 1 deletion .gitignore
Comment thread
skipperoo marked this conversation as resolved.
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
*.qcow2
*.pem
*.class
*.bin
*.lock
flink_job/.gradle
secrets
.pytest_cache
__pycache__
Expand All @@ -11,7 +15,12 @@ tdevice.json
claim.py
status
brockeroo
grafana
trackeroo-backend/grafana
trackeroo-backend/mongo/data
nominatim-data
osrm-data
trackeroo-backend/redis
mqtt_client
tracky/docker-compose.yml
grafana.json
.project
3 changes: 3 additions & 0 deletions .vscode/settings.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
{
"java.compile.nullAnalysis.mode": "automatic"
}
2 changes: 1 addition & 1 deletion bootstrap/cloud-init/nodes/user-data.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ locale: en_US.UTF-8
# User configuration
users:
- name: k3s-admin
passwd: $6$rounds=4096$v0k4/WEZZLQnikFD$1b5obdvCiCz.BffcjSUPS4MTPV7Ro6cr8J87HWpyonOQX7rX823rap/1mk/.plRFnMlhOvGLkuoWrgfCArZOb.
passwd: $6$rounds=4096$hctGKNXeELHL1wkO$Vqml85LbOZvpBoLjbU2Se77TLVVcX2GhP5MHXtF/amhAGSM36x7xviZzmBEkfoa06m6N3ZUCUkIsAid6myFvl.
lock_passwd: false
groups: sudo
shell: /bin/bash
Expand Down
2 changes: 1 addition & 1 deletion bootstrap/cloud-init/servers/user-data.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ locale: en_US.UTF-8
# User configuration
users:
- name: k3s-admin
passwd: $6$rounds=4096$v0k4/WEZZLQnikFD$1b5obdvCiCz.BffcjSUPS4MTPV7Ro6cr8J87HWpyonOQX7rX823rap/1mk/.plRFnMlhOvGLkuoWrgfCArZOb.
passwd: $6$rounds=4096$B9SFui0p6YaAGZAF$PVHzzOun0HNCAOY4G6aJs.2EqXNwJiD3CE4/IFlaUs6e6HNGDl0CzpTmzkwTsBCUD4DLt5bFvn2q4fW5nFKBS0
lock_passwd: false
groups: sudo
shell: /bin/bash
Expand Down
24 changes: 12 additions & 12 deletions bootstrap/cloud-init/specs.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
- machine_type: server
name: k3s-server-cronus
cpu: 4
ram: 4096
cpu: 2
ram: 2048
os_storage: 20
longhorn_storage: 0
networks:
Expand All @@ -15,8 +15,8 @@
mac: 52:54:00:19:b9:c4
- machine_type: server
name: k3s-server-hyperion
cpu: 4
ram: 4096
cpu: 2
ram: 2048
os_storage: 20
longhorn_storage: 0
networks:
Expand All @@ -30,8 +30,8 @@
mac: 52:54:00:ba:81:7a
- machine_type: server
name: k3s-server-oceanus
cpu: 4
ram: 4096
cpu: 2
ram: 2048
os_storage: 20
longhorn_storage: 0
networks:
Expand All @@ -45,8 +45,8 @@
mac: 52:54:00:9b:6e:0b
- machine_type: node
name: k3s-node-hermes
cpu: 6
ram: 4096
cpu: 8
ram: 6144
os_storage: 20
longhorn_storage: 100
networks:
Expand All @@ -60,8 +60,8 @@
mac: 52:54:00:36:8c:61
- machine_type: node
name: k3s-node-achilles
cpu: 6
ram: 4096
cpu: 8
ram: 6144
os_storage: 20
longhorn_storage: 100
networks:
Expand All @@ -75,8 +75,8 @@
mac: 52:54:00:ca:d5:31
- machine_type: node
name: k3s-node-odysseus
cpu: 6
ram: 4096
cpu: 8
ram: 6144
os_storage: 20
longhorn_storage: 100
networks:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,6 @@
curl -sfL https://get.k3s.io | K3S_URL="https://{{ kube_api_vip }}:6443" \
INSTALL_K3S_VERSION="{{ k3s_version }}" \
K3S_TOKEN="{{ leader_token.content | b64decode | trim }}" \
sh -s - agent --node-ip {{ hostvars[inventory_hostname].internal_ip }} --kubelet-arg node-status-update-frequency=5s
sh -s - agent --node-ip {{ hostvars[inventory_hostname].internal_ip }} --kubelet-arg node-status-update-frequency=5s --node-label "workload-type=apps"
args:
creates: /etc/rancher/k3s
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,10 @@ sh -s - ${K3S_ROLE} ${K3S_CLUSTER_INIT} ${K3S_SERVER} \
--tls-san {{ kube_api_vip }} \
--flannel-iface {{ internal_interface }} \
--disable-cloud-controller \
--disable servicelb
--disable servicelb \
--node-taint CriticalAddonsOnly=true:NoSchedule \
# --node-taint "workload-type=apps"

# This is to prevent any workload from being scheduled on the servers.
# --node-taint CriticalAddonsOnly=true:NoSchedule \
echo "K3s server installation completed"
Original file line number Diff line number Diff line change
Expand Up @@ -122,6 +122,7 @@
name: "{{ item }}"
namespace: longhorn-system
spec:
name: "{{ item }}"
allowScheduling: false

loop: "{{ groups['servers'] }}"
Expand Down
1 change: 1 addition & 0 deletions bootstrap/k3s-ansible/playbooks/site.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@

- name: Deploy MetalLB and configure IP pool
hosts: servers[0]
tags: metallb
run_once: true
roles:
- metallb
Expand Down
File renamed without changes.
Loading