24 Sep
|
InfoCepts
|
Pune
Position: Cloud Data Engineer
Location: Pune/Nagpur
Type of Employment: FTE
Purpose of the Position: We are seeking a Cloud Data Engineer with expertise across Google Cloud Platform (GCP) and Amazon Web Services (AWS) to support enterprise-scale data platform initiatives. The role involves designing, developing, and optimising cloud-native data solutions, while contributing to the migration and modernisation of data workloads from GCP to AWS. The individual will work closely with architects, data engineers, DevOps teams, and business stakeholders to build scalable, secure, and high-performing data ecosystems that support analytics and business intelligence needs
Key Result Areas and Activities:
- Cloud Data Platform Engineering – Design, build, and maintain scalable cloud-based data pipelines, storage solutions, and data processing frameworks across GCP and AWS environments.
- Cloud Migration & Modernization – Support migration of data platforms, ETL workloads, databases, and analytics solutions from GCP to AWS while ensuring minimal disruption and optimal performance.
- Data Integration & Pipeline Development – Develop and optimize batch and real-time data ingestion pipelines leveraging modern cloud-native services and engineering best practices.
- Data Quality, Security & Governance – Ensure implementation of data quality checks, security controls, compliance standards, and governance frameworks across data platforms.
- Operational Excellence & Stakeholder Collaboration – Collaborate with cross-functional teams to troubleshoot issues, improve platform performance, and deliver business solutions aligned with organisational objectives.
Essential Skills:
- Strong experience in cloud data engineering using AWS and GCP platforms.
- Expertise in designing and developing ETL/ELT data pipelines.
- Hands-on experience with AWS services such as S3, Glue,
EMR, Redshift, Lambda, IAM, Athena, and CloudWatch.
- Working knowledge of GCP services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and IAM.
- Strong proficiency in Python and SQL for data engineering and automation.
- Experience with migration of data workloads, analytics platforms, and data pipelines between cloud environments.
- Knowledge of CI/CD, Infrastructure as Code (Terraform preferred), and cloud-native deployment practices.Deep understanding of Supply Chain, Procurement, Inventory, Manufacturing, and Operations Analytics.
Desirable Skills:
- Experience with Spark, PySpark, or distributed data processing frameworks.
- Exposure to Databricks or modern Lakehouse architectures.
- Knowledge of containerization technologies such as Docker and Kubernetes.
- Experience with data governance, metadata management, and data catalogue solutions.
- AWS and/or GCP cloud certifications.
Qualifications:
Experience:
- 5+ years of experience in Data Engineering or Cloud Data Engineering.
- Experience working across AWS and GCP ecosystems.
- Proven experience supporting cloud migration and data modernization initiatives.
- Experience delivering scalable enterprise data solutions in cloud environments.
Education:
- Bachelor's or master's degree in computer science, Information Technology, Engineering, Data Science, or a related field.
- Relevant AWS and/or GCP certifications will be an added advantage.
Qualities:
- Strong analytical and problem-solving mindset.
- Ability to work effectively across multiple cloud platforms.
- Excellent communication and stakeholder management skills.
- Robust ownership and accountability for deliverables.
- Adaptability to evolving technologies and business requirements.
- Focus on solutioning, innovation, and continuous improvement.
- Collaborative team player with a customer-focused approach.
📌 Cloud Data Engineer (Pune)
🏢 InfoCepts
📍 Pune