11 Nov
|
DataE2E Technologies
|
India
11 Nov
DataE2E Technologies
India
Data Cloud Engineer
Employment Type: Full-Time / Permanent
Work Mode: 100% Remote
Working Hours: 3:00 PM – 11:00 PM IST
Job Overview
We are looking for a skilled and experienced Data Cloud Engineer with a strong background in Data Engineering, Cloud Engineering, Microsoft Azure, and Databricks. The ideal candidate will be responsible for designing, developing, implementing, and maintaining scalable cloud-based data engineering solutions.
The candidate should have hands-on experience building and optimizing data pipelines, managing cloud-based data platforms, implementing data integration solutions, and working with large-scale data processing technologies. Strong expertise in Azure and Databricks is essential for this role.
Key Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines and data engineering solutions.
- Build, implement, and optimize data processing workflows using Azure and Databricks.
- Develop and manage ETL/ELT pipelines for data ingestion, transformation, and integration.
- Work with Azure cloud services to design and maintain cloud-based data infrastructure.
- Develop and optimize Databricks notebooks, workflows, and Spark-based applications.
- Implement data lake and lakehouse architectures to support enterprise data requirements.
- Ensure data quality, reliability, security, and performance across data platforms.
- Monitor, troubleshoot, and optimize data pipelines and cloud-based workloads.
- Collaborate with cross-functional teams,
including data engineers, cloud engineers, architects, and business stakeholders.
- Follow best practices for cloud infrastructure management, data governance, and deployment.
Required Skills & Qualifications
- Strong experience in Data Engineering and Cloud Engineering.
- Hands-on experience with Microsoft Azure cloud services.
- Strong practical experience with Databricks and Apache Spark.
- Experience developing ETL/ELT pipelines and data integration solutions.
- Good knowledge of Python and SQL.
- Experience working with Azure Data Lake Storage (ADLS).
- Understanding of data lake, lakehouse, and modern cloud data architectures.
- Experience in data transformation, processing, performance tuning, and optimization.
- Strong troubleshooting, analytical, and problem-solving skills.
- Ability to work independently and collaborate effectively with distributed teams.
Preferred Qualifications
- Experience with Azure Data Factory (ADF).
- Knowledge of Azure Synapse Analytics.
- Experience with Delta Lake and Delta Live Tables.
- Familiarity with CI/CD pipelines and DevOps practices.
- Experience with Azure DevOps, Git, and infrastructure automation.
- Understanding of data security, governance, and access management.
Work Requirements
- Full time / Permanent employment.
- 100% Remote opportunity.
- Must be comfortable working in the 3:00 PM – 11:00 PM IST shift.
- Strong communication and collaboration skills.
📌 Data Cloud Engineer (India)
🏢 DataE2E Technologies
📍 India