Project Role : Custom Software Engineer

Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.

Must have skills : Microsoft SQL Server

Good to have skills : Databricks Unified Data Analytics Platform

Minimum 3 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Senior Data Engineer – SQL Server, Databricks & Power BI - 6+ Years in SQL Server Development, Data Engineering, ETL, Production Support, and Analytics along with Databricks

Job Summary

We are seeking an experienced Data Engineer with strong expertise in SQL Server, Databricks, ETL development, data validation, reporting, and production support. The ideal candidate will be responsible for designing and optimizing data solutions, managing large-scale data integration processes, ensuring data quality, supporting business reporting needs, and driving automation initiatives across enterprise data platforms.

Key Responsibilities

SQL Server Development & Database Management (6+ Years)

Design, develop, and maintain complex SQL queries, stored procedures, views, functions, and database objects.

Create and manage database structures including tables, indexes, constraints, and partitions while ensuring data integrity and security.

Optimize database performance through query tuning, indexing strategies, and execution plan analysis.

Automate recurring database tasks using SQL Agent Jobs, scripts, and scheduling frameworks.

Collaborate with business and technical teams to translate requirements into scalable data solutions.

Databricks & Data Engineering (2+ Years)

Develop and maintain data pipelines using Databricks and cloud-based data engineering technologies.





Build and optimize ETL/ELT workflows for processing structured and semi-structured datasets.

Work with large-scale datasets leveraging Spark and Databricks for data transformation and analytics.

Support data migration, modernization, and cloud adoption initiatives.

Monitor, troubleshoot, and improve data pipeline performance and reliability.

Data Integration & ETL Processing

Design and maintain end-to-end data ingestion and integration workflows across multiple source and target systems.

Develop scalable ETL pipelines for processing data from diverse enterprise applications and databases.

Manage data extracts, imports, synchronization processes, and downstream integrations.

Ensure accurate source-to-target data movement through reconciliation and validation processes.

Support multi-region data processing and reporting requirements.

Production Support & Operations (6+ Years)

Provide Level 2/Level 3 production support for data platforms, SQL databases, and ETL processes.

Monitor critical jobs and ensure compliance with operational SLAs.

Troubleshoot and resolve data, application, and system issues with minimal business impact.

Perform root cause analysis and implement preventive measures for recurring issues.

Support cross-functional teams and critical business processes as a backup resource.

Data Validation & Quality Assurance

Perform comprehensive data quality checks and validation activities including:

Record count reconciliation

Duplicate and exception analysis

Aggregate and trend validation

Null and completeness assessments





Conduct periodic and ad-hoc validations prior to data publication.

Identify data anomalies and partner with stakeholders to resolve quality issues.

Maintain data quality standards and governance practices.

Reporting, Analytics & Visualization (3+ Years)

Develop and maintain Power BI dashboards, reports, and KPI scorecards.

Generate analytical reports to identify trends, anomalies, and business insights.

Support business users with self-service reporting and data analysis requirements.

Perform variance analysis and reconciliation reporting across multiple datasets.

Automation & Process Improvement (6+ Years)

Develop reusable automation frameworks for validation, reconciliation, monitoring, and reporting processes.

Build workflow automations using Power Automate and Power Platform solutions.

Drive continuous improvement initiatives focused on operational efficiency and data quality.

Explore and implement AI-enabled automation opportunities to reduce manual effort.

Required Skills & Technologies

Mandatory

SQL Server

SQL Server Management Studio (SSMS)

Databricks

Power BI

ETL/Data Engineering

Power Automate

Power Apps

Advanced Microsoft Excel

Stored Procedures, Views, Functions, Performance Tuning

Data Validation & Reconciliation

Good to Have

Azure Data Factory (ADF)

Azure Data Lake

PySpark

Cloud Data Platforms (Azure/AWS)

GenAI and Data Automation Tools

Additional Requirements

Ability to support Shift-B operations with availability until 11:00 AM PST.

Robust analytical, troubleshooting, and problem-solving skills.

Excellent communication and stakeholder management capabilities.

Willingness to work from office as per organizational policy.

Return to Office (RTO)

Mandatory 5-day Work from Office from one of the strategic locations:

Bengaluru

Hyderabad

Chennai

Coimbatore

📌 Custom Software Engineer (Chennai)
🏢 Accenture in India
📍 Chennai