Job Summary: We are seeking a highly skilled Databricks Architect with extensive experience in designing and implementing data solutions using Databricks. The ideal candidate will have a solid background in data engineering, cloud technologies, and big data analytics. This role requires a strategic thinker who can lead projects from conception to execution while collaborating with cross-functional teams to deliver high-quality data solutions.
Responsibilities
- Design and implement scalable data architectures using Databricks.
- Collaborate with data scientists, data engineers, and business stakeholders to understand data requirements and translate them into technical specifications.
- Develop and maintain ETL processes to ensure data quality and integrity.
- Optimize data pipelines for performance and cost efficiency.
- Provide technical leadership and mentorship to junior team members.
- Stay updated with the latest Databricks features and best practices to continuously improve data solutions.
- Conduct code reviews and ensure adherence to best practices in data engineering.
- Document architecture designs, data flows,
and processes for future reference.
Mandatory Skills
- Proven experience with Databricks and its ecosystem.
- Strong knowledge of Apache Spark and big data technologies.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Proficiency in programming languages such as Python, Scala, or Java.
- Solid understanding of data modeling, data warehousing, and ETL processes.
- Excellent problem-solving skills and ability to work under pressure.
Preferred Skills
- Experience with machine learning frameworks and libraries.
- Familiarity with data visualization tools like Tableau or Power BI.
- Knowledge of DevOps practices and CI/CD pipelines.
- Experience in Agile methodologies and project management.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 10-13 years of experience in data architecture, data engineering, or related roles.
- Relevant certifications in Databricks or cloud platforms are a plus.
If you are a passionate Databricks Architect looking to make a significant impact in a dynamic environment, we encourage you to apply.