We are seeking a highly skilled and passionate Senior Software Engineer (Data) to join our agile team. In this role, you will be instrumental in designing, developing, and maintaining robust and scalable data pipelines and infrastructure. If you’re a data enthusiast with a strong engineering mindset and a knack for solving complex data challenges, we encourage you to apply!
Roles and Responsibilities
- Design, build, and optimize scalable data pipelines for ingestion, transformation, and loading of large datasets.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
- Implement data quality checks and monitoring to ensure data integrity and reliability.
- Develop and maintain data models, ensuring efficient storage and retrieval.
- Troubleshoot and resolve issues related to data pipelines and data infrastructure.
- Contribute to the continuous improvement of our data platform and best practices.
Required Skills & Qualifications
- Bachelor’s or Master’s degree in Computer Science,
Information Technology, or a related field.
- 4-7 years of dedicated experience in data engineering.
- Strong proficiency in Python with a deep understanding of Object-Oriented Programming (OOP) concepts
- Expertise in SQL for complex data querying, manipulation, and optimization.
- Solid grasp of data engineering concepts, including data warehousing, ETL/ELT, data modeling, and distributed systems.
- Hands-on experience with Databricks, including familiarity with Unity Catalog and key features like Delta Lake, notebooks, and job orchestration.
- Proven hands-on experience with PySpark for large-scale data processing and analysis.
- Basic understanding of Azure Cloud Services, particularly those relevant to data storage and processing.
Preferred Qualifications
- - Experience with Spark streaming frameworks (e.g., Structured Streaming).
- Familiarity with Kafka for real-time data ingestion and processing is a plus.
- Experience with Azure Data Factory is a plus.
📌 Software Engineer – Data (India)
🏢 TechVariable
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.