24 Aug
|
Vivantify Technology Solutions India
|
Pune
24 Aug
Vivantify Technology Solutions India
Pune
Location: Pan India
Experience: 5–7 Years
About The Role We are looking for a Data Engineer with strong expertise in PostgreSQL and SQL to design, build, and support reliable data pipelines and enterprise data assets. The role focuses on data engineering, SQL performance optimization, data modeling, data quality, and scalable data integration for analytics and real-time consumption.
The role involves designing and maintaining data pipelines that acquire, aggregate, refine, and securely move data between source and target systems. You will develop reusable data assets that support enterprise querying, analytics, feature engineering, APIs, and ingestion processes.
A key focus of the role is developing production-grade SQL and optimizing PostgreSQL performance through query tuning, execution plan analysis, indexing, partitioning, and database maintenance. You will also design logical and physical data models and establish standards for schemas, keys, constraints, naming conventions, and slowly changing dimensions.
The position requires building resilient pipelines with appropriate error handling, retry mechanisms, idempotency, and reprocessing capabilities. You will collaborate with data wranglers, data scientists, and technical development teams to deliver reliable and high-quality data solutions.
Key Responsibilities
- Design, build, and support scalable data pipelines across source and target systems
- Develop production-grade PostgreSQL SQL using CTEs, window functions, and set-based processing
- Optimize PostgreSQL performance through query tuning, indexing, partitioning, and execution plan analysis
- Use EXPLAIN ANALYZE BUFFERS to diagnose query performance and identify I/O and execution bottlenecks
- Design and maintain logical, physical, normalized, and dimensional data models
- Define and maintain data contracts covering schemas, keys, constraints, naming standards, and business definitions
- Implement resilient data pipelines with error handling, retries, idempotency, and reprocessing/backfill capabilities
- Implement data quality checks, monitoring, and reusable data assets for analytical and real-time consumption
Required Skills
- PostgreSQL
- Advanced SQL
- CTEs, window functions, and set-based processing
- PostgreSQL query tuning and execution plan analysis
- Indexing strategies including B-tree, Hash, GiST, and GIN
- Database partitioning and maintenance
- VACUUM/ANALYZE and table statistics management
- Locking and concurrency handling
- EXPLAIN ANALYZE BUFFERS
- Data modeling: logical, physical, normalized, and dimensional models
- Data contracts and schema evolution
- ETL and data integration
- Data quality and pipeline monitoring
- Error handling, retry logic, idempotency, and data reprocessing
Mandatory Skills
- PostgreSQL
Candidate Profile The ideal candidate should have 5–7 years of experience in data engineering with strong hands-on expertise in PostgreSQL and advanced SQL , including database performance optimization and data modeling. The candidate should be capable of building reliable data pipelines and reusable data assets while collaborating effectively with data scientists, data wranglers, and technical development teams.
Advantages Package
- Competitive salary and benefits package
- Opportunities for professional growth and development
- A collaborative and inclusive work environment
- The opportunity to work on exciting and challenging projects with leading clients
📌 Specialist - Data Engineering (Pune)
🏢 Vivantify Technology Solutions India
📍 Pune