We are looking for an experienced Databricks Engineer / Data Engineer with strong hands-on expertise in Databricks, PySpark, SQL, and Snowflake. The ideal candidate should have experience building and optimizing scalable data pipelines and working with modern cloud data platforms.
Exposure to Databricks Genie and Snowflake CoCo is preferred. Candidates without hands-on experience in these tools can also be considered if they demonstrate strong fundamentals, a positive attitude, and willingness to learn.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Databricks, PySpark, and SQL.
Develop and optimize ETL/ELT processes for large-scale data processing.
Work extensively with Apache Spark / PySpark for data transformation and processing.
Develop complex and optimized SQL queries, stored procedures, and data transformations.
Work with Snowflake for data warehousing, data loading, transformation, and performance optimization.
Integrate Databricks with Snowflake and other enterprise data sources.
Implement data quality, validation, monitoring,
and performance optimization.
Troubleshoot production data pipeline issues and ensure reliable data processing.
Collaborate with data engineers, architects, analysts, and business stakeholders.
Explore and leverage AI-powered capabilities such as Databricks Genie and Snowflake CoCo where applicable.
Mandatory Skills
Databricks
PySpark
SQL
Snowflake
Apache Spark
ETL / ELT
Data Engineering concepts
Strong analytical and problem-solving skills
Positive to Have
Databricks Genie experience or knowledge
Snowflake CoCo experience or knowledge
Experience integrating Databricks and Snowflake
Delta Lake
Databricks Workflows / Jobs
Cloud platforms such as Azure / AWS / GCP
Data pipeline optimization and performance tuning
AI/GenAI-assisted data engineering capabilities
Candidate Profile
We Are Looking For Candidates Who
Have strong practical experience in Databricks + PySpark + SQL + Snowf