04 Aug
|
GyanSys
|
Bengaluru
Job Description Databricks Engineer / Consultant
n About GyanSys
n GyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver innovative, scalable, and business-driven solutions across diverse industries worldwide.
n Databricks Engineer / Consultant
n Location: Bengaluru | Pune | Hyderabad
n Employment Type: Full-Time
n Job Summary
n GyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.
n Key Responsibilities
n n Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
n Build and optimize data pipelines for structured, semi-structured, and unstructured data.
n Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.
n Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
n Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.
n Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.
n Ensure data quality, governance, security, and compliance across data platforms.
n Implement CI/CD best practices and support deployment of Databricks solutions.
n Troubleshoot production issues and continuously improve platform performance.
n Create technical documentation and support knowledge-sharing initiatives.
n n Required Technical Skills
n n Hands-on experience with Databricks Lakehouse Platform
n Strong expertise in PySpark, Apache Spark, Spark SQL, and Python
n Experience with Delta Lake, Databricks Workflows, and Unity Catalog
n Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling
n Experience with Azure, AWS, or GCP cloud platforms
n Knowledge of Git, Azure DevOps/GitHub, and CI/CD practices
n Experience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases
n n Preferred Skills
n n Experience with Medallion Architecture and Lakehouse concepts
n Exposure to Kafka, Event Hubs, or other streaming technologies
n Knowledge of Power BI or Tableau
n Understanding of Agile/Scrum methodologies
n Exposure to Microsoft Fabric is an added advantage
n n Qualifications
n n Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
n n Experience
n n Domain Experience: 3–5 Years
n Relevant Experience: 0–8+ Years
n n Preferred Certifications
n n Databricks Certified Data Engineer (Associate/Qualified)
n Microsoft Azure Data Engineer Associate
n AWS Certified Data Analytics – Specialty
n Google Professional Data Engineer
n n Why Join GyanSys?
n At GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your professional growth.
📌 Databricks Engineer (Immediate Joiners Only- 3 to 15 Years) (Bengaluru)
🏢 GyanSys
📍 Bengaluru