22 Aug
|
Delphic Global
|
India
22 Aug
Delphic Global
India
Senior Data Engineer – Data Engineering
Experience: 4+ Years
Location: Remote
Job Summary
We are looking for a Senior Data Engineer with strong expertise in Python, PySpark, Apache Spark, AWS, and Azure. The candidate will work with large and complex datasets, build scalable ETL/ELT pipelines, and independently lead data engineering projects.
Key Responsibilities
- Design and develop scalable data pipelines for structured, unstructured, and real-time data.
- Build complex ETL/ELT and data transformation processes using Python, PySpark, and Apache Spark.
- Work with AWS and Azure data services to develop and manage cloud-based data solutions.
- Develop and maintain data models for business and analytical requirements.
- Work with cloud and on-premise data warehouses and understand their architectures.
- Use services such as AWS Glue, EMR, and Azure Data Factory.
- Ensure data pipelines are scalable, reliable, and optimized for performance.
- Troubleshoot data engineering, performance, and scalability issues.
- Independently lead projects and provide technical guidance to team members.
- Collaborate with data scientists, analysts, developers, and business stakeholders.
- Prepare technical documentation, design specifications, and best-practice guidelines.
- Stay updated with emerging data engineering tools and technologies.
Required Skills
- 4+ years of experience in Data Engineering.
- Strong hands-on experience with Python, PySpark, and Apache Spark.
- Experience with AWS and Azure cloud platforms.
- Strong knowledge of ETL/ELT, data pipelines, and data modeling.
- Experience with AWS Glue, EMR, and Azure Data Factory.
- Understanding of cloud/on-premise data warehouses.
- Solid analytical, problem-solving, and troubleshooting skills.
- Excellent communication and stakeholder management skills.
- Ability to work independently and lead technical projects.
Good to Have
- Snowflake
- Dataiku
- Alteryx
- Experience with real-time/streaming data technologies.
Education
Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.
Work Mode: Remote
Pay: ₹1,000,000.00 - ₹1,200,000.00 per year
Work Location: Remote
📌 Sr.Data Engineers (India)
🏢 Delphic Global
📍 India