20 Nov
|
Synechron
|
Hyderabad
20 Nov
Synechron
Hyderabad
Job Description: Senior Data Engineer
Experience: 8+ years
Role: Senior Data Engineer
Core Skills: GCP, Spark, PySpark, SQL, ETL/Data Pipelines
Role Summary
We are looking for an experienced Senior Data Engineer with 8+ years of Data Engineering experience to design, build, and optimize large-scale data processing solutions. The candidate should have strong hands-on expertise in GCP, Apache Spark, PySpark, SQL, and ETL, with the ability to independently own complex data pipelines from design through production.
Key Responsibilities
- Design, develop, and maintain scalable, reliable, and high-performance ETL/ELT pipelines for large-volume data processing.
- Build distributed data processing solutions using Apache Spark and PySpark, including performance tuning and optimization.
- Develop cloud-native data solutions on Google Cloud Platform (GCP) using services such as BigQuery, Cloud Storage, Dataproc, Dataflow,
and Composer/Airflow.
- Write and optimize complex SQL for data transformation, reconciliation, validation, and analytical workloads.
- Design effective data models and processing patterns for batch and large-scale data workloads.
- Own the complete engineering lifecycle including design, development, unit testing, deployment, production support, monitoring, and troubleshooting.
- Establish controls for data quality, completeness, accuracy, reconciliation, and pipeline resiliency.
- Troubleshoot production issues and optimize pipelines for performance, scalability, reliability, and cost.
- Participate in design and code reviews and ensure adherence to engineering standards and best practices.
📌 Data Engineer | Immediate Joiners (Hyderabad)
🏢 Synechron
📍 Hyderabad