Join our multinational corporation as a Developer focusing on PySpark and Python to design and implement scalable data solutions using Databricks platforms. This role demands expertise in managing workflows and SQL in Databricks to support data analytics initiatives in a hybrid work workplace during daytime shifts with no travel requirements.
Responsibilities
Develop test and deploy robust PySpark scripts and Python code to process large-scale datasets efficiently in conjunction with cloud-based data lake infrastructure.
Design and implement Databricks Workflows to automate data pipeline orchestration ensuring timely data availability for analytics and reporting purposes.
Create optimized SQL queries using Databricks SQL tools to extract transform and load data while maintaining accuracy and performance.
Utilize Databricks CLI to manage workspace resources automate routine tasks and enhance productivity throughout the development lifecycle.
Collaborate closely with data engineers and data scientists to integrate new data sources and refine existing pipelines for meeting evolving business requirements.
Troubleshoot and resolve performance bottlenecks within data processing workflows by analyzing runtime metrics and applying optimization techniques.
Apply data validation and quality assurance checks within pipelines to uphold data integrity and compliance with organizational standards.
Participate in code reviews and contribute to maintaining coding standards documentation and best practices for sustainable development.
Continuously monitor system activity and usage to proactively identify risks or opportunities for improvements in data infrastructure.
Support cross-functional teams by delivering data-driven insights and technical expertise to accelerate the achievement of strategic goals.
Adhere to internal security protocols and data privacy regulations while handling sensit
📌 Databricks+spark (Indore)
🏢 Cognizant
📍 Indore
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.