14 Nov
|
Stackzy Technologies
|
India
14 Nov
Stackzy Technologies
India
Senior Data Engineer – ETL/ELT, Cloud Data Platforms & AI
Needed for US client interview and project.
Strictly 9+ years of overall experience,
You can also directly DM on whatsapp (phone hidden),
Required availability ( between 6:30 PM to 2:30 AM) IST.
Senior Data Engineer – ETL/ELT, Cloud Data Platforms & AI
We are looking for professionals who can design, develop, optimize, and maintain robust data pipelines while working with modern cloud technologies, data warehouses, and AI-assisted engineering tools.
The ideal candidate should have strong hands-on experience with SQL, Python, ETL/ELT development, data modeling, and enterprise data platforms.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build enterprise data warehouses, data lakes, and lakehouse solutions.
- Develop data integration solutions across multiple systems and platforms.
- Perform data modeling, transformation, validation, and optimization.
- Work with cloud-based data engineering platforms and technologies.
- Implement data quality, governance, lineage, and security standards.
- Optimize SQL queries, pipeline performance, and data processing costs.
- Develop automated testing, monitoring, and CI/CD workflows.
- Collaborate with business analysts, data architects,
BI developers, and stakeholders.
- Leverage AI coding assistants and agentic development tools to improve engineering productivity.
Required Technical Skills
- Solid SQL and Python programming skills.
- Hands-on ETL/ELT pipeline development.
- Experience with Microsoft Fabric, Azure Data Factory, or similar data platforms.
- Experience with Snowflake, Databricks, BigQuery, or Amazon Redshift.
- Knowledge of data warehousing, dimensional modeling, and lakehouse architecture.
- Experience with Apache Spark, PySpark, or distributed data processing.
- Understanding of data quality, data governance, and data security.
- Experience with orchestration tools such as Airflow, Dagster, or Azure Data Factory.
- Knowledge of Git, CI/CD, and automated testing.
Preferred Skills
- Microsoft Fabric and OneLake.
- Delta Lake, Apache Iceberg, and medallion architecture.
- Kafka, Flink, or streaming data pipelines.
- dbt and metadata-driven pipeline frameworks.
- AI coding assistants, AI agents, MCP, and agentic development workflows.
- Experience supporting AI/ML and analytics workloads.
- Experience working with enterprise clients and business stakeholders.
📌 Senior Data Engineer – ETL/ELT, Cloud Data Platforms & AI (India)
🏢 Stackzy Technologies
📍 India