We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data platforms that support analytics, machine learning, and AI initiatives. The ideal candidate will have robust expertise in ETL development, data warehousing, cloud-based data platforms, orchestration frameworks, and data governance.

Key Responsibilities

- Design, develop, and automate scalable ETL/ELT pipelines to ingest data from multiple internal and external sources.
- Build and maintain robust data warehouses, data lakes, and supporting database structures.
- Develop and optimize model-ready datasets for analytics, machine learning, and AI applications.
- Provision, manage, and support data infrastructure across GCP and on-premises environments.
- Design, implement, and maintain workflow orchestration using Apache Airflow.
- Ensure data reliability through rigorous validation, monitoring, logging, and alerting mechanisms.
- Implement data governance, security, lineage, and compliance controls to meet GDPR and EU AI Act requirements.
- Collaborate closely with Data Scientists, AI Engineers, Product Teams, and Business Stakeholders.
- Optimize data storage, processing performance, and infrastructure costs.
- Troubleshoot production issues and ensure high availability of data platforms.
- Contribute to architecture decisions, best practices, and technical standards across the organization.





Required Qualifications

- Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or related field.
- 5+ years of experience in Data Engineering.
- Strong programming skills in Python and SQL.
- Hands-on experience with Apache Airflow.
- Experience with GCP services such as BigQuery, Cloud Storage, Dataflow, Dataproc, and Cloud Composer.
- Strong understanding of Data Warehousing and Data Lake architectures.
- Experience with Spark/PySpark.
- Knowledge of GDPR, data governance, and data quality frameworks.
- Experience with CI/CD pipelines, Docker, Kubernetes, and Git.

Preferred Qualifications

- Experience supporting AI/ML platforms and feature engineering pipelines.
- Knowledge of Terraform and Infrastructure as Code.
- Experience with streaming technologies such as Kafka or Pub/Sub.
- Familiarity with MLOps practices.
- Understanding of EU AI Act compliance requirements.

Nice to Have

- Databricks
- Kafka
- Snowflake
- OpenSearch / ELK
- Grafana
- Terraform
- Vertex AI

Key Competencies

- Data Architecture
- Problem Solving
- Performance Optimization
- Stakeholder Management
- Communication Skills
- Ownership & Accountability
- Continuous Improvement

If you are interested in this opportunity, please click on the 'Apply Now' button to submit your application.

📌 Senior Data Engineer (Maharashtra)
🏢 Delta IoT Solutions
📍 Maharashtra