Design and develop scalable and effective ETL/ Data Engineering Pipelines using PySpark.
Collaborate with cross-functional teams to identify and prioritize project requirements.
Develop and maintain large-scale data pipelines using Airflow, Kafka, and EMR/Databricks.
Ensure seamless integration of data from various sources into a unified platform.
Optimize data modeling and querying performance using SQL and other relevant tools.
Implement CI/CD pipelines for automated testing and deployment of data pipelines.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Pyspark Lead Bengaluru (India)
🏢 Krazy Mantra It
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.