27 Aug
|
Artmac Soft
|
Hyderabad
27 Aug
Artmac Soft
Hyderabad
Who we are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description:
Job Title : Databricks Data Architect
Job Type : Full time / Contract
Experience : 10-15 years
Location : Hyderabad, Telangana
Responsibilities:
- 10+ years of experience in Data Engineering, Data Architecture, or Solution Architecture.
- Strong expertise in Data Architecture and End-to-End Solution Design.
- Hands-on experience with Databricks, Delta Lake, PySpark, and SQL.
- Experience in the US or UK Insurance domain is an added advantage.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Experience with enterprise data governance, data quality, security, and cataloging platforms.
- Strong understanding and implementation experience with Medallion Architecture.
- Experience in Data Migration, Legacy Modernization, and Performance Optimization.
- Strong experience designing Batch, Near Real-Time, and CDC processing solutions.
- Experience with Git/GitHub, Jenkins, CI/CD, and Databricks Asset Bundles (DABs).
- Understanding of Data Mesh and up-to-date data architecture patterns.
- Strong knowledge of data modeling, distributed processing, data integration, and scalable pipeline architecture.
- Design end-to-end data architecture and solution designs for enterprise-scale data platforms.
- Architect and implement modern Lakehouse solutions using Databricks and Delta Lake.
- Define and implement Medallion Architecture across Bronze, Silver, and Gold data layers.
- Lead data migration and legacy modernization initiatives from traditional platforms to modern cloud data architectures.
- Design scalable batch, near-real-time, and Change Data Capture (CDC) data processing solutions.
- Develop and optimize data pipelines using PySpark, SQL, Databricks, and Delta Lake.
- Identify and resolve performance bottlenecks across data pipelines, queries, storage, and compute workloads.
- Establish architecture patterns for data quality, governance, security, scalability, and reliability.
- Implement CI/CD practices using Git, GitHub, Jenkins, and Databricks Asset Bundles (DABs).
- Provide technical leadership and architectural guidance to data engineering teams.
- Evaluate and implement modern architecture patterns including Data Mesh, Lakehouse, and domain-oriented data platforms.
Qualification:
- Bachelor's degree or equivalent combination of education and experience.
📌 Databricks Data Architect (Hyderabad)
🏢 Artmac Soft
📍 Hyderabad