Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Databricks Unified Data Analytics Platform

Good to have skills : Business Intelligence (BI) Reporting Tools, Python (Programming Language), Data Engineering

Minimum 7.5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role includes creating efficient data pipelines and ensuring the integrity and quality of data throughout its lifecycle. The position also requires implementing extract, transform, and load processes to facilitate seamless migration and deployment of data across various systems, enabling smooth data flow and accessibility for organizational needs. Collaboration with different teams to align data strategies and troubleshoot data-related challenges is an integral part of the daily routine.

Data Engineering Lead

Roles & Responsibilities:





- Build and maintain ingestion pipelines from source systems into Azure Data Lake develop transformation logic using Databricks (notebooks, Delta Live Tables), Python and PySpark implement incremental, change-data and full-refresh patterns build and manage ADF orchestration workflows implement data-quality checks and validation via Unity Catalog maintain data lineage and metadata write unit and integration tests support onboarding of new sources provide L2/L3 support for production pipelines.

Professional & Technical Skills:

- Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform, Data Engineering, Python (Programming Language), Business Intelligence (BI) Reporting Tools.
- Valuable To Have Skills: Experience with Data Engineering, Python (Programming Language), Business Intelligence (BI) Reporting Tools.
- Strong knowledge of data pipeline architecture and best practices for data integration.
- Experience in designing and implementing scalable ETL processes.
- Familiarity with cloud-based data platforms and distributed computing frameworks.
- Ability to troubleshoot complex data issues and optimize data processing workflows.
- DevOps CICD / Databricks

Additional Information:

- The candidate should have minimum 7.5 years of experience in Databricks Unified Data Analytics Platform.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.

📌 Data Engineer (Bengaluru)
🏢 Accenture
📍 Bengaluru