Python vs Go vs Rust for Practical Data Engineering

[ioakeim-h]

Python is the most common language for data engineering, but recently people show interest in Go and Rust. I am a small-scale data engineer, building mostly local ETL pipelines with Python, processing several millions of records. I've never worked with big data and do not have much cloud knowledge, so I do not get the fuzz around Go and Rust.

I was wandering why bootdev plans on releasing a data engineering learning path with Python & Go, with Go being used in the place of Python for the ETL course. However, there are plans for a data manipulation course in Python, meaning that Go is not meant to be a complete replacement.

My question is, how practical is Go and Rust for daily data engineering? Rust feels like it will be used mostly for building the tools for Python, and Go only for special cases where data ingestion is an issue.

That said, I can't wait for the data engineering path to be released. Also, I will definitely be learning Go because Lane got me excited about it and looks like he knows what he is doing.