About
Hello World! My name is Vedanth V Baliga, I'm a Data Engineer @ StoneX.
This is a complete documentation of Data Engineering Tools that I'm learning from courses and on the job.
Feel free to connect with me on LinkedIn
Tools and Tech Stack
| Tool / Technology | Usage | Notes |
|---|---|---|
| Airflow Astronomer | Data Orchestration | Astronomer |
| Azure Databricks | Data Processing | Databricks |
| Pyspark Databricks Course | Data Processing | PySpark Databricks |
| Spark YouTube Stuff | Data Processing | PySpark YouTube |
| Microsoft Azure Fabric | Data Lakehouse and Data Processing | Microsoft Fabric |
| Redpanda Kafka Streaming | Streaming and Realtime | Redpanda |