21 Nov
|
Synechron
|
Hyderabad
21 Nov
Synechron
Hyderabad
Job Description: Senior Data Engineer
Experience: 8+ years
Role: Senior Data Engineer
Core Skills: GCP, Spark, PySpark, SQL, ETL/Data Pipelines
Role Summary
We are looking for an experienced Senior Data Engineer with 8+ years of Data Engineering experience to design, build, and optimize large-scale data processing solutions. The candidate should have robust hands-on expertise in GCP, Apache Spark, PySpark, SQL, and ETL, with the ability to independently own complex data pipelines from design through production.
Key Responsibilities
Design, develop, and maintain scalable, reliable, and high-performance ETL/ELT pipelines for large-volume data processing.
Build distributed data processing solutions using Apache Spark and PySpark, including performance tuning and optimization.
Develop cloud-native data solutions on Google Cloud Platform (GCP) using services such as BigQuery, Cloud Storage, Dataproc,
Dataflow, and Composer/Airflow.
Write and optimize complex SQL for data transformation, reconciliation, validation, and analytical workloads.
Design effective data models and processing patterns for batch and large-scale data workloads.
Own the complete engineering lifecycle including design, development, unit testing, deployment, production support, monitoring, and troubleshooting.
Establish controls for data quality, completeness, accuracy, reconciliation, and pipeline resiliency.
Troubleshoot production issues and optimize pipelines for performance, scalability, reliability, and cost.
Participate in design and code reviews and ensure adherence to engineering standards and best practices.
📌 Data Engineer Immediate Joiners Hyderabad
🏢 Synechron
📍 Hyderabad