Notice Period: Immediate Joiners / Serving Notice Period Preferred
About the Role
We are looking for a skilled and passionate Data Engineer to join our growing team. The ideal candidate will have solid experience in designing, developing, and maintaining scalable data pipelines, working with big data technologies, and leveraging cloud platforms to build robust data solutions.
Key Responsibilities
Design, develop, and optimize scalable data pipelines and ETL processes.
Build and maintain data processing workflows using PySpark and Python.
Develop and manage data solutions on AWS cloud services.
Work with large datasets to ensure data quality, reliability, and performance.
Create and optimize SQL queries for data extraction, transformation, and analysis.
Implement and manage workflow orchestration using Apache Airflow.
Utilize AWS Redshift for data warehousing and analytics.
Manage and optimize big data processing using AWS EMR.
Collaborate with cross-functional teams including Data Analysts, Data Scientists, and Business Stakeholders.
Ensure adherence to data governance, security, and best practices.
Required Skills
Robust proficiency in Python
Hands-on experience with PySpark
Advanced knowledge of SQL
Experience with AWS Services:
Redshift
EMR
Airflow
Experience in data warehousing and ETL development
Robust problem-solving and analytical skills
Excellent communication and collaboration abilities
Preferred Qualifications
Experience working with large-scale distributed data processing systems.
Knowledge of data modeling and performance tuning.
Familiarity with CI/CD pipelines and version control tools such as Git.
AWS Certifications are a plus.
📌 Data Engineer Secunderabad (India)
🏢 Quest Global
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.