Our client seeks a Lead Data Engineer proficient in AWS and Python to join their Technology and Development team based in Kolkata. If you are enthusiastic about showcasing your expertise and thriving in a team-oriented environment alongside a group of talented engineers, this role is tailored for you.
At the forefront of technology innovation, our client specializes in delivering cutting-edge solutions across various sectors, with a strategic emphasis on finance, banking, and corporate verticals. Renowned for their commitment to excellence, they seek a Lead Data Engineer to bolster their global projects team.

As a Lead Data Engineer , you will spearhead data pipeline design, development, and maintenance, playing a pivotal role in enabling data-driven decision-making and analytics and making sure project deadlines are met with your team of dedicated engineers. Leveraging your expertise, you will contribute to the establishment of a robust data infrastructure that underpins the organization's objectives.

Key Responsibilities:

ETL Pipeline Development: Lead the design, development,



and maintenance of ETL processes using Python, AWS Glue, or other serverless technologies to ingest data from diverse sources, transform it into actionable insights, and load it into data warehouses or data lakes.

AWS Serverless Expertise: Harness AWS services such as AWS Lambda, AWS Step Functions, AWS Glue, AWS S3, and AWS Redshift to architect scalable, reliable, and cost-effective serverless data pipelines.

Data Modeling: Collaborate with data scientists and analysts to conceptualize and implement data models optimized for analytical purposes, ensuring optimal data structuring.

Data Quality Assurance: Implement robust data validation and quality checks within ETL pipelines to ensure accuracy, completeness, and consistency.

Performance Optimization: Continuously optimize ETL processes for enhanced efficiency, performance, and scalability, promptly addressing any bottlenecks or issu

📌 Lead Data Engineer (Kolkata)
🏢 Hour Consulting
📍 Kolkata