21 Nov
|
Mobile Apps US
|
Bengaluru
21 Nov
Mobile Apps US
Bengaluru
Job Title: Senior Data Engineer – Commercial Data Products
Location: Bengaluru (100% Onsite)
Experience: 6–9 Years
Job Summary:
We are seeking a Senior Data Engineer with robust expertise in Databricks, PySpark, Spark SQL, AWS Glue, and dbt to build and optimize scalable data pipelines and commercial data products.
Key Responsibilities:
Build and optimize ETL/ELT pipelines using PySpark, Spark SQL, Databricks, and AWS Glue.
Develop Delta Lake/Iceberg tables and Medallion Architecture (Bronze, Silver, Gold).
Build data products for commercial analytics and reporting.
Implement data quality, monitoring, reconciliation, and performance tuning.
Integrate data from APIs, databases, Kafka, files, and CDC sources.
Support production pipelines, code reviews,
and cross-functional collaboration.
Required Skills:
6–9 years of Data Engineering experience.
Robust Apache Spark, PySpark, and SQL.
Hands-on AWS Glue and Databricks experience.
Experience with Delta Lake, Iceberg, or Hudi.
Production ETL/ELT pipeline development.
Commercial domain experience in Sales, Order Management, Rebates, POS, Salesforce, or Commercial Analytics.
Preferred Skills:
dbt, Unity Catalog, Databricks Workflows, Snowflake.
CI/CD, GitHub Actions, Terraform, and automated testing.
Kafka, Kinesis, CDC, Data Governance, and Observability.
📌 Senior Data Engineer – Commercial Data Products Bengaluru
🏢 Mobile Apps US
📍 Bengaluru