Roles and Responsibilities
Design, develop, test, deploy, and maintain large-scale data pipelines using Python as the primary language.
Collaborate with cross-functional teams to gather requirements and deliver high-quality ETL solutions.
Develop complex SQL queries to extract insights from various databases and transform them into meaningful reports.
Ensure data quality by implementing robust validation checks on incoming data streams.
Troubleshoot issues related to pipeline failures or performance bottlenecks.