14 Nov
|
Mresult Technologies
|
India
14 Nov
Mresult Technologies
India
Role : Databricks Developer
Key Responsibilities:
Design, develop, and deploy scalable data pipelines and ETL processes using Databricks.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
Optimize Spark jobs and ensure effective data processing and storage.
Develop and maintain Databricks notebooks, workflows, and dashboards.
Implement best practices for data governance, security, and quality within the Databricks environment.
Troubleshoot and resolve data pipeline issues and performance bottlenecks.
Monitor and manage data processing jobs to ensure high availability and reliability.
Work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services.
Stay current with the latest Databricks and big data technologies and trends.
Required Qualifications:
Proven experience with Databricks, Apache Spark, and big data processing frameworks.
Robust proficiency in programming languages such as Python, Scala, or SQL.
Proficient in working with PySpark.
Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and related services (e.g., S3, ADLS, Redshift, BigQuery).
Experience with Deltalake concepts.
Familiarity with data warehousing concepts and solutions.
Knowledge of data modeling, data architecture, and ETL processes.
Solid problem-solving skills and attention to detail.
Excellent communication and teamwork skills.
Preferred Qualifications:
Certifications in Databricks, Spark, or cloud platforms.
Experience with data visualization tools (e.g., Tableau, Power BI).
Knowledge of machine learning frameworks and data science principles.
Familiarity with DevOps practices and tools for CI/CD.
📌 Senior Software Development Engineer Bengaluru (India)
🏢 Mresult Technologies
📍 India