We are seeking a core Data Engineer to design, build, and scale enterprise data pipelines. You will work extensively with the contemporary data stack to optimize our Lakehouse architecture and ensure high data quality and availability.
Key Responsibilities & Requirements:
Pipeline Development: Build and maintain end-to-end ETL/ELT pipelines using Azure Data Factory and Databricks.
Data Processing: Write highly optimized, distributed data processing jobs using PySpark and complex SQL.
Architecture: Implement and scale Lakehouse solutions utilizing the Medallion Architecture with Delta Lake.
Governance & Security: Manage data governance and row/column-level access using Unity Catalog.
DevOps/IaC: Automate infrastructure deployments utilizing Terraform and maintain robust CI/CD pipelines via GitHub Actions.
Tech Stack: Solid proficiency in Python, SQL, Azure, and Apache Spark.
📌 Data Engineer Tamil Nadu
🏢 Intellea
📍 Tamil Nadu
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.