02 Aug
|
InfoSpeed Services
|
Bangalore Urban
02 Aug
InfoSpeed Services
Bangalore Urban
Sr. Data Engineer (6 years) / Data Engineer Senior Engineer
Key Technologies / Skill Requirements & Certifications
Must Have
- A Problem-solving mindset; Willingness to learn and understand how development works, quality testing, bugs and resolutions fit into the overall system design.
- Experience in working independently on assigned work; but also, comfortable collaborating with others to get the development, testing, and issue resolution complete; comfortable sharing concepts and information with teammates
- Collaborate with teammates across regions—sharing context early, documenting decisions, and maintaining strong handoffs.
- Comfort working in a fast-paced, consulting-oriented setting where priorities shift and outcomes matter.
- Databricks (Delta Lake, notebooks, jobs, workflows)
- Azure Data Engineering (ADF, ADLS Gen2, Event Hub)
- Strong Python / PySpark / SQL
- Data ingestion frameworks (batch + CDC + streaming)
- Data quality and validation implementation
- CI/CD using Azure DevOps
- Understanding of performance optimization and scalable data pipelines
Nice to Have
- Databricks Data Engineer certification
- Experience with ingestion frameworks / accelerators
- ERP Data Integration (SAP Oracle, JDE)
- Knowledge of orchestration tools (ADF pipelines, Airflow)
- Familiarity with Unity Catalog and governance controls
- Experience working in Medallion Architecture environments
Q2: Role Expectations
- Build and enhance inventory data pipelines, transformations, and integrations for Inventory Data in Databricks
- Implement bronze ingestion and raw data staging pipelines
- Develop transformations to support downstream silver/gold layers
- Apply standardized data quality, validation, and reconciliation checks
- Optimize pipelines for performance, scalability, and cost efficiency
- Support troubleshooting of ingestion failures, data inconsistencies, and pipeline errors
- Collaborate with platform team for environment setup and with modelers for schema alignment
- Ensure code follows Stryker standards, CI/CD practices, and reusable patterns
📌 Databricks Engineer (Bangalore Urban)
🏢 InfoSpeed Services
📍 Bangalore Urban