22 Aug
|
GyanSys
|
Bengaluru
Job Description
Databricks Engineer / Consultant
n
About GyanSys
n
GyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver creative, scalable, and business-driven solutions across diverse industries worldwide.
n
Databricks Engineer / Consultant
n
Location: Bengaluru | Pune | Hyderabad
n
Employment Type: Full-Time
n
Job Summary
n
GyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.
n
Key Responsibilities
n
n
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
n
- Build and optimize data pipelines for structured, semi-structured, and unstructured data.
n
- Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.
n
- Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
n
- Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.
n
- Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.
n
- Ensure data quality, governance, security, and compliance across data platforms.
n
- Implement CI/CD best practices and support deployment of Databricks solutions.
n
- Troubleshoot production issues and continuously improve platform performance.
n
- Create technical documentation and support knowledge-sharing initiatives.
n
n
Required Technical Skills
n
n
- Hands-on experience with Databricks Lakehouse Platform
n
- Robust expertise in PySpark, Apache Spark, Spark SQL, and Python
n
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
n
- Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling
n
- Experience with Azure, AWS, or GCP cloud platforms
n
- Knowledge of Git, Azure DevOps/GitHub, and CI/CD practices
n
- Experience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases
n
n
Preferred Skills
n
n
- Experience with Medallion Architecture and Lakehouse concepts
n
- Exposure to Kafka, Event Hubs, or other streaming technologies
n
- Knowledge of Power BI or Tableau
n
- Understanding of Agile/Scrum methodologies
n
- Exposure to Microsoft Fabric is an added advantage
n
n
Qualifications
n
n
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
n
n
Experience
n
n
- Domain Experience: 3–5 Years
n
- Relevant Experience: 0–8+ Years
n
n
Preferred Certifications
n
n
- Databricks Certified Data Engineer (Associate/Professional)
n
- Microsoft Azure Data Engineer Associate
n
- AWS Certified Data Analytics – Specialty
n
- Google Professional Data Engineer
n
n
Why Join GyanSys?
n
At GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your qualified growth.
📌 Databricks Engineer (Immediate Joiners Only- 3 to 15 Years) (Bengaluru)
🏢 GyanSys
📍 Bengaluru