06 Aug
|
Techservices Partners
|
Hyderabad
06 Aug
Techservices Partners
Hyderabad
We are hiring experienced **Databricks Engineers** and **Databricks Leads** for exciting **Contract opportunities** with a leading global client. If you're passionate about building scalable data platforms, modernizing enterprise data ecosystems, and working with Azure Cloud technologies, we'd love to connect with you.
- ## Databricks Engineer 8 Positions
- **Experience:** 5+ Years (5+ Years Relevant Experience)
- **Employment Type:** Contract
- **Role:** Individual Contributor (IC)
### Key Responsibilities
- Design, develop, and maintain scalable ETL and ELT data pipelines using Azure Databricks.
- Build high-performance batch and streaming data pipelines using PySpark and Scala.
- Develop and optimize data ingestion frameworks from multiple sources, including APIs, databases, and streaming platforms.
- Create and maintain enterprise Data Lakes and Data Warehouses.
- Perform data cleansing, transformation, validation, and enrichment to ensure high-quality datasets.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Collaborate with Data Scientists, Data Analysts, and Business Teams to deliver reliable data solutions.
- Implement data governance, security, and compliance best practices.
- Participate in code reviews, CI/CD implementation, and DevOps activities.
### Required Skills
- Azure Databricks
- PySpark
- Scala
- Python
- SQL
- Apache Spark
- Azure Cloud
- ETL/ELT Development
- Data Pipeline Development
- Data Warehousing
- Data Lakes
- Data Modeling
- Apache Kafka
- Apache Airflow
- Hadoop Ecosystem
- GitHub
- Jira
- DevOps
- Performance Optimization
- Excellent Communication Skills
## Databricks Lead 2 Positions
- **Experience:** 6+ Years (Minimum 5+ Years Relevant Experience)
- **Current Designation:** Lead (Mandatory)
- **Employment Type:** Contract
- **Role:** Technical Lead
### Key Responsibilities
- Lead end-to-end Data Engineering initiatives using Azure Databricks.
- Drive enterprise migration projects from Hadoop to Azure Databricks.
- Design scalable, secure, and high-performance data platforms.
- Architect enterprise ETL frameworks and data integration solutions.
- Mentor and manage Data Engineering teams.
- Conduct technical design reviews and code reviews.
- Collaborate with business stakeholders and client leadership.
- Drive delivery planning, estimation, risk management, and project execution.
- Ensure implementation of data governance, security, and best engineering practices.
- Optimize Spark workloads and Azure Databricks environments for enterprise-scale performance.
### Required Skills
- Azure Databricks
- PySpark
- Scala
- Python
- SQL
- Apache Spark
- Azure Cloud
- Hadoop Migration
- ETL & ELT
- Data Engineering
- Data Warehousing
- Data Lakes
- Apache Kafka
- Apache Airflow
- GitHub
- Jira
- DevOps
- Team Leadership
- Client & Stakeholder Management
- Solid Communication & Presentation Skills
## Work Details
- **Location:** Bangalore / Hyderabad
- **Work Mode:** Hybrid (Initial 5 Days Work From Office)
- **Shift Timing:** 11:00 AM 8:00 PM IST
- **Interview Process:** 2 Technical/Internal Rounds + 1 Client Round
- **Compensation:** Industry Standards
- **Employment Type:** Contract Position
📌 Databricks Engineer - PySpark and Scala (Hyderabad)
🏢 Techservices Partners
📍 Hyderabad