We are seeking a core Data Engineer to design, build, and scale enterprise data pipelines. You will work extensively with the up-to-date data stack to optimize our Lakehouse architecture and ensure high data quality and availability.
Key Responsibilities & Requirements:
- Pipeline Development: Build and maintain end-to-end ETL/ELT pipelines using Azure Data Factory and Databricks.
- Data Processing: Write highly optimized, distributed data processing jobs using PySpark and complex SQL.
- Architecture: Implement and scale Lakehouse solutions utilizing the Medallion Architecture with Delta Lake.
- Governance & Security: Manage data governance and row/column-level access using Unity Catalog.
- DevOps/IaC: Automate infrastructure deployments utilizing Terraform and maintain robust CI/CD pipelines via GitHub Actions.
- Tech Stack: Strong proficiency in Python, SQL, Azure, and Apache Spark.
📌 Data Engineer (Chennai)
🏢 Intellea
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.