We are seeking a core Data Engineer to design, build, and scale enterprise data pipelines. You will work extensively with the up-to-date data stack to optimize our Lakehouse architecture and ensure high data quality and availability.
Key Responsibilities & Requirements:
Pipeline Development: Build and maintain end-to-end ETL/ELT pipelines using Azure Data Factory and Databricks.
Data Processing: Write highly optimized, distributed data processing jobs using PySpark and complex SQL.
Architecture: Implement and scale Lakehouse solutions utilizing the Medallion Architecture with Delta Lake.
Governance & Security: Manage data governance and row/column-level access using Unity Catalog.
DevOps/IaC: Automate infrastructure deployments utilizing Terraform and maintain robust CI/CD pipelines via GitHub Actions.
Tech Stack: Robust proficiency in Python, SQL, Azure, and Apache Spark.
📌 Data Engineer Chennai
🏢 Intellea
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.