04 Aug
|
GyanSys
|
Bengaluru
Databricks Engineer / Consultant About GyanSys GyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver innovative, scalable, and business-driven solutions across diverse industries worldwide.
Databricks Engineer / Consultant Location: Bengaluru | Pune | Hyderabad Employment Type: Full-Time Job Summary GyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.
Key Responsibilities - Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
- Build and optimize data pipelines for structured, semi-structured, and unstructured data.
- Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.
- Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
- Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.
- Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.
- Ensure data quality, governance, security, and compliance across data platforms.
- Implement CI/CD best practices and support deployment of Databricks solutions.
- Troubleshoot production issues and continuously improve platform performance.
- Create technical documentation and support knowledge-sharing initiatives.
Required Technical
Skills - Hands-on experience with Databricks Lakehouse Platform
- Strong expertise in PySpark, Apache Spark, Spark SQL, and Python
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling
- Experience with Azure, AWS, or GCP cloud platforms
- Knowledge of Git, Azure DevOps/GitHub, and CI/CD practices
- Experience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases Preferred Skills - Experience with Medallion Architecture and Lakehouse concepts
- Exposure to Kafka, Event Hubs, or other streaming technologies
- Knowledge of Power BI or Tableau
- Understanding of Agile/Scrum methodologies
- Exposure to Microsoft Fabric is an added advantage Qualifications - Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Experience - Domain Experience: 3–5 Years
- Relevant Experience: 0–8+ Years Preferred Certifications - Databricks Certified Data Engineer (Associate/Professional)
- Microsoft Azure Data Engineer Associate
- AWS Certified Data Analytics – Specialty
- Google Professional Data Engineer Why Join GyanSys? At GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your skilled growth.
📌 Databricks Engineer (Immediate Joiners Only- 3 To 15 Years) (Bengaluru)
🏢 GyanSys
📍 Bengaluru