Job description:
Minimum 5 to 7 years of IT experience with handson expertise in Databricks on AWS

Proficient in leveraging Databricks features such as

oDelta Lake

oUnity Catalog

oScalable data processing frameworks

Strong understanding of AWS cloud services including

oAmazon S3

oAWS Lambda

oAmazon SNS

oAWS Step Functions

oAWS Glue

Skilled in job cost optimization techniques to

oMinimize runtimes

oImprove system performance

Experience with

oPython core libraries

oPySpark for data engineering tasks

Positive analytical and problemsolving skills with expertise in

oSQL query development

oStored procedures

oCreating data marts and views in RDBMS

Strong understanding of

oETL concepts

oEndtoend data pipeline architecture

oData warehouse and reporting layers

Familiarity with CICD pipelines and deployment tools such as

oTerraform

Experience with version control systems

oGitHub or equivalent platforms

Understanding of

oAgile methodology

oSoftware Development Life Cycle SDLC





Excellent communication and presentation skills with the ability to collaborate effectively with stakeholders

Roles Responsibilities

Collaborate with business users and stakeholders to understand challenges and provide effective Databricksbased solutions

Research and evaluate new Databricks features conduct Proof of Concepts POCs and develop best practice documentation

Provide support for Sparkrelated issues and participate in code reviews offering recommendations for improvement

Lead and mentor junior team members guiding them in development and troubleshooting activities

Manage midsized teams and oversee delivery of work ensuring quality and timely completion

Take ownership of assigned tasks and contribute effectively in an Agile environment

Participate in solution design discussions and prepare designdocumentation artifacts based on requirements

Drive job cost optimization and performance tuning initiatives to enhance system efficiency

Support CICD processes and inf

📌 SPECIALIST – DATA ENGINEERING | DATABRICKS (Pune)
🏢 LTIMindtree
📍 Pune