To lead the design, development, and implementation of scalable data solutions using Databricks on cloud platforms. The role involves architecting data pipelines, optimizing performance, and ensuring data governance and security across enterprise-level analytics initiative
s
Key Result Areas and Activities
: Architecture Desi gn: Develop and maintain scalable, secure, and high-performance data architecture using Databric
ks.Data Pipeline Developme nt: Lead the creation and optimization of ETL/ELT pipelines for structured and unstructured da
ta.Cloud Integrati on: Ensure seamless integration of Databricks with cloud platforms like Azure, A
WS.Performance Optimizati on: Monitor and enhance the performance of data workflows and Spark jo
bs.Stakeholder Collaborati on: Work closely with data engineers, analysts, and business stakeholders to translate requirements into technical solutio
ns.
Must Have Ski
lls Robust expertis e in Apache Spark and Datab ricks plat
form.Hands-on experience with P ytho n or Scala for data engineering t
asks.Positive expertise in Gen AI/LLM automation/modernization proj
ects.Proficienc y i n SQL for data manipulation and quer
ying.Hands on experience and awareness about latest features in databricks like AI/BI G e nie, Agentbricks, Databricks
Apps.Experience with Delta L ake, Lakehouse archite cture, and data versi o
ning.Knowledg e of CI/CD pipe lines and DevOps prac tices in data enginee
ring.Familiarity with cloud plat forms (Azure/AWS) and their data serv
ices.Understandin g of data gover na nce, sec urity, and compl iance framew
orks.Contribute to presales and
RFPs.
Valuable To Have
Skill Experienc e with MLfl ow and machine learning model dep l
oyment.Knowle dge of Apache Airflow or other orchestration
tools.Expos ure to real-time data pro cessing using Kafka or similar
tools.Familiarit y with P ow er BI, Tableau, or other BI
tools.Certificat ion in Dat abricks or relevant cloud techno
logies.
📌 Databricks Architect Pune (India)
🏢 InfoCepts
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.