03 Oct
|
Atharv Consultings
|
Bangalore Urban
03 Oct
Atharv Consultings
Bangalore Urban
Role Overview
We are looking for a Senior Data Engineer with 7+ years of experience in designing, developing, and maintaining scalable data platforms and analytics solutions. The candidate should have solid expertise in Apache Spark, Databricks, SQL, Python, Data Warehousing, Data Modeling, Streaming, and Azure Data Services.
Key Responsibilities
Design, develop, and optimize ETL/ELT data pipelines for large-scale data processing.
Build and maintain data solutions using Apache Spark, Databricks, SQL, and Python.
Develop robust batch and real-time data ingestion frameworks.
Design and implement Data Warehouses, Data Marts, and Lakehouse architectures.
Create and maintain logical and physical data models aligned with business requirements.
Develop streaming solutions using event-driven architectures and real-time processing frameworks.
Utilize Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Data Lake Storage (ADLS) for orchestration and transformation.
Ensure data quality, governance, security, and compliance across data platforms.
Collaborate with Data Scientists, Analysts, and Business Stakeholders to deliver data-driven solutions.
Monitor, troubleshoot, and optimize data platform performance, reliability, and scalability.
📌 Senior Data Engineer (Bangalore Urban)
🏢 Atharv Consultings
📍 Bangalore Urban