19 Sep
|
Smart Energy Water
|
Mumbai
19 Sep
Smart Energy Water
Mumbai
Job Description – Data EngineerExperience:
5–7 YearsRole:
Sr. Data EngineerDepartment:
Data Engineering / Product EngineeringRole OverviewWe are looking for an experienced
Data Engineer
with 5–7 years of hands-on experience in
ETL/ELT, database engineering, Big Data processing, and complex bi-directional data integrations . The candidate should have robust SQL and database expertise, experience working with large datasets, and the ability to design, develop, optimize, and support reliable data pipelines in production environments.Key ResponsibilitiesDesign, develop, and maintain scalable
ETL/ELT pipelines
for batch and near-real-time data processing.Build data integrations using
REST APIs, SFTP, files, webhooks, and database-to-database interfaces .Develop and support
bi-directional data integrations
between applications, databases, and external enterprise systems.Implement data synchronization, incremental processing, reconciliation, error handling, retries, and duplicate/missing-data prevention.Develop complex
SQL queries, stored procedures, functions, views, and data transformations .Work extensively with
PostgreSQL and SQL Server ; exposure to MongoDB is preferred.Perform
database and query performance tuning , including execution-plan analysis, indexing, joins, partitioning, locking/blocking, and long-running query optimization.Work with large datasets and distributed processing frameworks; optimize data processing for scalability and performance.Implement data validation, quality checks, logging, auditing, and monitoring for critical pipelines.Troubleshoot production ETL, database, integration,
and data-quality issues and perform root-cause analysis.Collaborate with application, product, DBA, DevOps, and client teams to resolve end-to-end data issues.Required Technical SkillsMust Have:5–7 years of Data Engineering / ETL experienceStrong
SQL and Python
skillsStrong hands-on experience with
PostgreSQL and SQL ServerGood understanding of
ETL/ELT and data pipeline architectureExperience with
complex data integrations and data synchronizationExperience with REST APIs, SFTP, file-based and database integrationsStrong understanding of
database performance tuning and optimizationExperience handling large-volume datasetsGood understanding of data modeling, data quality, validation, and reconciliationStrong troubleshooting and problem-solving skillsGood to Have:Apache Spark / PySparkApache AirflowTalend / SSIS / other ETL toolsMongoDBAzure / AWS / GCPAzure Databricks / Delta Lake / Data LakeKafka or other streaming technologiesCDC / incremental data processingGit, Azure DevOps/GitHub and CI/CDPreferred Candidate ProfileThe ideal candidate should be comfortable working across the complete data lifecycle:Candidates who have experience working with
multiple databases, high-volume data, complex bi-directional integrations, and performance-critical production workloads
will be preferred.Key CompetenciesStrong analytical and problem-solving abilityGood understanding of data architecture and integration patternsAbility to independently troubleshoot complex data issuesOwnership of deliverables and production issuesGood communication and cross-functional collaboration skillsEducation:
Bachelor's/Master's degree in Computer Science, IT, Engineering, or related technical discipline.
📌 Sr Data Engineer (Mumbai)
🏢 Smart Energy Water
📍 Mumbai