Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Databricks Unified Data Analytics Platform
Good to have skills : Business Intelligence (BI) Reporting Tools, Python (Programming Language), Data Engineering
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role includes creating productive data pipelines and ensuring the integrity and quality of data throughout its lifecycle. The position also requires implementing extract, transform, and load processes to facilitate seamless migration and deployment of data across various systems, enabling smooth data flow and accessibility for organizational needs. Collaboration with different teams to align data strategies and troubleshoot data-related challenges is an integral part of the daily routine.

Data Engineering Lead

Roles & Responsibilities:





- Build and maintain ingestion pipelines from source systems into Azure Data Lake develop transformation logic using Databricks (notebooks, Delta Live Tables), Python and PySpark implement incremental, change-data and full-refresh patterns build and manage ADF orchestration workflows implement data-quality checks and validation via Unity Catalog maintain data lineage and metadata write unit and integration tests support onboarding of new sources provide L2/L3 support for production pipelines.

Professional & Technical Skills:

- Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform, Data Engineering, Python (Programming Language), Business Intelligence (BI) Reporting Tools.
- Good To Have Skills: Experience with Data Engineering, Python (Programming Language), Business Intelligence (BI) Reporting Tools.
- Strong knowledge of data pipeline architecture and best practices for data integration.
- Experience in designing and implementing scalable ETL processes.
- Familiarity with cloud-based data platforms and distributed computing frameworks.
- Ability to troubleshoot complex data issues and optimize data processing workflows.
- DevOps CICD / Databricks

Additional Information:

- The candidate should have minimum 7.5 years of experience in Databricks Unified Data Analytics Platform.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.

15 years full time education

📌 Data Engineer (India)
🏢 Accenture
📍 India