06 Sep
|
Simplify3x Software
|
India
06 Sep
Simplify3x Software
India
We are looking for an experienced Data Engineer with robust hands-on experience in AWS Glue, Amazon Redshift, PostgreSQL, Python, PySpark, and Tableau.
The candidate will be responsible for developing and supporting high-volume ETL/ELT pipelines, data processing solutions, database development, and reporting dashboards. The role involves working with billing and revenue data, including data from Oracle Revenue Management and Billing (ORMB).
Key Responsibilities
• Design and maintain ETL/ELT pipelines using AWS Glue, S3, PostgreSQL, and Redshift.
• Develop complex SQL queries, stored procedures, functions, views, and materialized views.
• Build AWS Glue jobs using Python and PySpark for large-volume data processing.
• Perform data transformation, cleansing, validation, and reconciliation.
• Optimize SQL, ETL, Glue, and Spark processes for better performance.
• Work with data modeling, incremental loads, CDC, and SCD.
• Develop and maintain Tableau dashboards using PostgreSQL and Redshift.
• Publish dashboards through Tableau Server/Tableau Cloud.
• Troubleshoot production issues and provide performance improvements.
• Work with business stakeholders to understand requirements and deliver technical solutions.
• Participate in Jira/Scrum activities including sprint planning, development, testing, and delivery.
Required Skills
AWS Glue
Amazon Redshift
PostgreSQL & Robust SQL
Python & PySpark
Amazon S3
ETL/ELT & Data Modeling
Spark Performance Optimization
Data Quality & Reconciliation
Tableau Desktop & Dashboard Development
Tableau Server/Tableau Cloud
Billing & Revenue Data
ORMB knowledge is preferred
Positive to Have
• Healthcare revenue management/billing experience
• AWS Lambda & DMS
• Glue Data Catalog & Crawlers
• Redshift Spectrum, WLM & Materialized Views
• AWS/Redshift cost and performance optimization
Education: Bachelor's degree in Computer Science, Engineering, IT, Information Systems, or a related field.
📌 Data Engineer Billing & Revenue Bengaluru (India)
🏢 Simplify3x Software
📍 India