20 Nov
|
Mobile Apps US
|
Bengaluru
20 Nov
Mobile Apps US
Bengaluru
Job Title: Senior Data Engineer – Commercial Data Products
Location: Bengaluru (100% Onsite)
Experience: 6–9 Years
Job Summary:
We are seeking a Senior Data Engineer with strong expertise in Databricks, PySpark, Spark SQL, AWS Glue, and dbt to build and optimize scalable data pipelines and commercial data products.
Key Responsibilities:
- Build and optimize ETL/ELT pipelines using PySpark, Spark SQL, Databricks, and AWS Glue.
- Develop Delta Lake/Iceberg tables and Medallion Architecture (Bronze, Silver, Gold).
- Build data products for commercial analytics and reporting.
- Implement data quality, monitoring, reconciliation, and performance tuning.
- Integrate data from APIs, databases, Kafka, files, and CDC sources.
- Support production pipelines, code reviews,
and cross-functional collaboration.
Required Skills:
- 6–9 years of Data Engineering experience.
- Robust Apache Spark, PySpark, and SQL.
- Hands-on AWS Glue and Databricks experience.
- Experience with Delta Lake, Iceberg, or Hudi.
- Production ETL/ELT pipeline development.
- Commercial domain experience in Sales, Order Management, Rebates, POS, Salesforce, or Commercial Analytics.
Preferred Skills:
- dbt, Unity Catalog, Databricks Workflows, Snowflake.
- CI/CD, GitHub Actions, Terraform, and automated testing.
- Kafka, Kinesis, CDC, Data Governance, and Observability.
📌 Senior Data Engineer – Commercial Data Products (Bengaluru)
🏢 Mobile Apps US
📍 Bengaluru