07 Aug
|
Mississippi Consultants Pune
|
India
07 Aug
Mississippi Consultants Pune
India
Job Details:
Employment Type: Permanent Payroll of the hiring organization
Client: A Leading IT Services Company
Experience Required: 5 to 16 Years
Location: PAN India (Hybrid)
Notice Period: 0-30 days
Key Responsibilities
- Design, develop and optimize ETL/ELT pipelines using Databricks PySpark to ingest, transform and serve data for digital customer experience use cases
- Build and maintain high-quality performant SQL transformations and dimensional curated data layers for analytics and downstream consumption
- Implement best practices for Databricks engineering notebooks vs repos, modular code, cluster/job configuration, performance tuning and cost awareness
- Use Python for data processing utilities, validations, orchestration helpers and reusable libraries
- Manage source control using Git with enterprise workflows across GitHub, Bitbucket; enforce PR reviews, branching strategies and coding standards
- Build and maintain CI/CD pipelines using Azure DevOps automating testing, packaging and deployment of data code/artifacts across environments
- Ensure data quality and reliability through validations, reconciliation checks, monitoring and operational runbooks
- Collaborate with product/app teams, analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeys
- For Senior Developer: lead module-level design, mentor engineers, drive standards for CI/CD and code quality, and own delivery for critical pipelines
Primary Skills (Must-Have)
- Strong hands-on experience with:
- Python
- PySpark
- Databricks jobs, workflows, clusters, repos
- SQL advanced querying, optimization
- Solid experience with Git and repository platforms GitHub and/or Bitbucket
- Hands-on experience implementing CI/CD for data engineering workloads
- Strong working experience with Azure DevOps Boards, Repos, Pipelines, build/release workflows
Apply Now!
Share your updated resume with
[email protected]
📌 Azure Databricks (India)
🏢 Mississippi Consultants Pune
📍 India