29 Aug
|
GyanSys
|
Bengaluru
About This Job
GyanSys Inc.
Location: Bengaluru, Karnataka, India
Work Mode: On-site
Industry: IT Services and IT Consulting
Databricks Engineer / Consultant
About GyanSys
GyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver innovative, scalable, and business-driven solutions across diverse industries worldwide.
Databricks Engineer / Consultant
Location: Bengaluru | Pune | Hyderabad
Employment Type: Full time
Job Summary
GyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.Build and optimize data pipelines for structured, semi-structured, and unstructured data.Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.Optimize Spark jobs and Databricks clusters for performance and cost efficiency.Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.Ensure data quality, governance, security,
and compliance across data platforms.Implement CI/CD best practices and support deployment of Databricks solutions.Troubleshoot production issues and continuously improve platform performance.Create technical documentation and support knowledge-sharing initiatives.
Required Technical Skills
Hands-on experience with Databricks Lakehouse PlatformStrong expertise in PySpark, Apache Spark, Spark SQL, and PythonExperience with Delta Lake, Databricks Workflows, and Unity CatalogStrong understanding of ETL/ELT, Data Warehousing, and Data ModelingExperience with Azure, AWS, or GCP cloud platformsKnowledge of Git, Azure DevOps/GitHub, and CI/CD practicesExperience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases
Preferred Skills
Experience with Medallion Architecture and Lakehouse conceptsExposure to Kafka, Event Hubs, or other streaming technologiesKnowledge of Power BI or TableauUnderstanding of Agile/Scrum methodologiesExposure to Microsoft Fabric is an added advantage
Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Experience
Domain Experience: 3–5 YearsRelevant Experience: 0–8+ Years
Preferred Certifications
Databricks Certified Data Engineer (Associate/Professional)Microsoft Azure Data Engineer AssociateAWS Certified Data Analytics – SpecialtyGoogle Professional Data Engineer
Why Join GyanSys?
At GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your professional growth.
📌 Databricks Engineer (Immediate Joiners Only- 3 to 15 Years) (Bengaluru)
🏢 GyanSys
📍 Bengaluru