We are looking for a skilled Data Engineer with 3+ years of experience to design, build, and maintain scalable data pipelines and data platforms. The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure high-quality, reliable, and performant data solutions.

Key Responsibilities
Design, develop, and maintain end-to-end ETL/ELT data pipelines
Build and optimize data ingestion frameworks from multiple sources (APIs, databases, files, streaming
Work with data warehouses and lakehouse architectures (Snowflake, Redshift, BigQuery, Databricks, etc.)
Develop and maintain batch and near-real-time pipelines
Ensure data quality, validation, monitoring, and observability
Optimize SQL queries and data models for performance and scalability
Collaborate with analytics, BI, and ML teams to support reporting and advanced analytics
Implement data governance, security, and access controls
Automate workflows using orchestration tools (Airflow, Luigi, etc.)
Troubleshoot and resolve data pipeline and production issues

Required Skills & Qualifications Must-Have
3+ years of hands-on experience as a Data Engineer




Strong proficiency in Python and SQL
Experience with ETL/ELT pipeline development
Hands-on experience with data warehouses (Snowflake preferred)
Experience with Apache Airflow or similar orchestration tools
Solid understanding of data modeling (star/snowflake schemas)
Experience working with large-scale datasets
Familiarity with Git-based version control
Experience working in agile environments

Valuable to Have
Experience with Apache Spark / PySpark
Exposure to Kafka or streaming platforms
Knowledge of cloud platforms (AWS / Azure / GCP)
Experience with Docker & Kubernetes
Familiarity with data quality frameworks (Excellent Expectations, Soda, etc.)
BI tools experience (Power BI, Looker, Tableau)
Infrastructure-as-Code tools (Terraform, CloudFormation)
CI/CD pipelines for data workflows

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Data Engineer Ahmedabad
🏢 Bacancy Technology
📍 Ahmedabad