19 Sep
|
Apexon
|
Bengaluru
nRequirement details:
nRole: Azure Data Engineer
nLocation: Bengaluru / 5 days WFO
nInterview Process
n
n
- Round 1: Face-to-Face Interview
n
- Round 2: Virtual Techno Manager
n
nJob Summary
nWe are looking for a Data Engineer with 6to 8 years of experience in building and supporting scalable data engineering solutions across Azure and Big Data platforms. The ideal candidate should have strong hands-on experience with Azure Databricks, PySpark, Hadoop, Talend, Delta Lake, and Azure Data Factory (ADF).
nThe role will involve developing, integrating, and optimizing data pipelines that support analytics, reporting, and AI/ML initiatives, while working closely with data architects, engineers, and business stakeholders.
nKey Responsibilities
n
n
- Develop and maintain scalable data pipelines using Azure Databricks and PySpark.
n
- Build data transformation and processing solutions using Delta Lake and Lakehouse architecture.
n
- Develop and optimize ETL/ELT pipelines using Talend for large-scale data ingestion and transformation.
n
- Work with Hadoop ecosystem technologies for distributed data processing and storage.
n
- Integrate data from multiple sources including databases, APIs, files, and streaming platforms.
n
- Build and manage data orchestration workflows using Azure Data Factory (ADF).
n
- Optimize Spark jobs, Databricks clusters, and data pipelines for performance and cost efficiency.
n
- Implement data quality, validation, security,
and governance practices.
n
- Collaborate with architects, business stakeholders, and data teams to understand requirements and deliver technical solutions.
n
- Participate in code reviews, technical discussions, and implementation of engineering best practices.
n
- Work with DevOps teams on CI/CD and deployment automation for data engineering solutions.
n
- Troubleshoot and resolve data pipeline and production issues.
n
nMust-Have Skills
n
n
- 6 to 8 years of experience in Data Engineering / Big Data Engineering.
n
- Strong hands-on experience with Azure Databricks and PySpark.
n
- Solid experience with Hadoop and its ecosystem.
n
- Hands-on experience with Talend for ETL/data integration.
n
- Good experience with Delta Lake / Lakehouse architecture.
n
- Strong experience with Azure Data Factory (ADF).
n
- Strong SQL and data transformation skills.
n
- Experience working with large-scale datasets and distributed data processing.
n
- Understanding of cloud-based data engineering and data integration concepts.
n
- Exposure to CI/CD and DevOps practices.
n
nGood to Have
n
n
- Experience with Azure Data Lake Storage (ADLS).
n
- Experience with streaming technologies.
n
- Knowledge of data governance and security.
n
- Exposure to data engineering solutions supporting AI/ML workloads.
n
- Experience with Agile development methodologies.
n
📌 Senior Azure Data Engineer | 7+ Years | Bangalore (Bengaluru)
🏢 Apexon
📍 Bengaluru