Implemented OTLP for the metrics crate to standardize metrics collection#190
Closed
LorenzoTettamanti wants to merge 33 commits into
Closed
Implemented OTLP for the metrics crate to standardize metrics collection#190LorenzoTettamanti wants to merge 33 commits into
LorenzoTettamanti wants to merge 33 commits into
Conversation
… function that returns a Result type
… repository to the cortexflow org ghcr.io repository
…n from Result type with ? operator for the apply_component() function in install.rs module. Fixed stack overflow error while returning a custom error. implemented coloured error outputs,added docs in error.rs module
…o return general errors. simplified ClientError responses and AgentError responses
…. Remove duplicated code in metrics module
…pace implementation. Added a small doc in the conntracker/main.rs file
…ed.Improved map handlers code
* [CortexFlow#158]: moved map_handlers module from identity crate to common crate * [CortexFlow#158]: simplified identity logic. removed duplicated code and functions * [CortexFlow#158]: added program handlers function in the common crate. Remove duplicated code in metrics module * [CortexFlow#168]: added load from program-handlers in identity user space implementation. Added a small doc in the conntracker/main.rs file * [CortexFlow#158]: fixed typos in the map names * [CortexFlow#158]: fixed bpf error: Error: the program is already loaded.Improved map handlers code * [CortexFlow#174]: added open telemetry (otel) logger for logs. Added otel daemonset with otel agent and collector * [CortexFlow#158]: improved docs for the conntracker data structures. removed useless conversion from u8 to 64 with .into() for state variable * [CortexFlow#174]: Added otel libraries and features in the common crate. .update identity kubernetes manifest with the otel env variables. * [CortexFlow#158]: imroved documentation in the user space for the identity (VethLog) data structure * [CortexFlow#158]: restored blocklist map initialization * [CortexFlow#158]: added better docs. Updated while true pattern with "loop" pattern. Code cleaning * [CortexFlow#174]: added prettify to logger * [CortexFlow#181]: added command to repair blocklist configmaps * [CortexFlow#182]: added GetTrackedVeth grpc endpoint definition * [CortexFlow#158]: added load_perf_event_array_from_mapdata function in map_handlers.rs * [CortexFlow#182]: added total monitored veth_events (tot_monitored_veth) * [CortexFlow#182]: added "cfcli monitoring veth" command frontend. added send_tracked_veth_requests function in api/requests.rs * [refactoring]: separate experimental service discovery from the helpers in the identity service * [refactoring]: created BufferType enum to centralize the event readers for PacketLog, VethLog and TcpPacketRegistry * updated common cargo.toml * [CortexFlow#158]: moved IpProtocols and network structures from the identity crate to the common crate. Added BufferType enum to list different buffers readers. Added buffer_type module in cortexbrain common (experimental) * [update]: cli packages update * [update]: IpProtocols update . Btter code formatting * [CortexFlow#158]: fixed typos from latest commit * [CortexFlow#182]: Added tracked events agent API implementation. Added VethEvent protobuffer message type * [proposal]: added batcher module intial bones * [158]: removed old deprecated functions to show veth logs. added packed representation for the VethLog structure. changed dev_addr type from [u32;8] to [u8;6] (see https://wiki.osdev.org/Address_Resolution_Protocol). Added unit tests to check VethLog structure bytes size. Changed "actual program" to "kernel_symbol" in the load_program function * [CortexFlow#158]: added a map_manager to call BpfMaps using the map name instead of relying on the declaration order during the startup * [CortexFlow#182]: added VethEvent protobuf message. Added log to see the veth event in the agent api * [docker] pushed new development images
…reuse the function in metrics service
…map handling and added read_perf_buffer function
…ed imports. Added error handling in event listener
…esses vector is empty. Added comments and annotations
…_VETH). The shared map is used to store the veth names and the status (attached or not) during the startup
…e the tracked veths (pt.2)
….rs. Simplified buffers filling and buffer initialization
…ing opentelemetry sdk. added srtruct Metrics to group all the metrics in one place. added auxiliary functions record_network_metrics and record_timestamp_metrics. added exporter setting in buffer_type/read_network_metrics and buffer_type/read_timestamp_metrics
…the function in the common crate
… ConfigMap. Added updated image in the metrics.yaml with the new implementations
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.