Client is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.
About The Job:
- We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data science use cases. The ideal candidate will have strong expertise in Python or Scala, Spark (Databricks), and SQL, building scalable and efficient data pipelines on Azure.
Essential Job Functions:
- Design, build, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Spark.
- Develop and optimize data workflows using SQL and Python or Scala for large-scale data processing and transformation.
- Implement performance tuning and optimization strategies for data pipelines and Spark jobs to ensure efficient data handling.
- Collaborate with data engineers to support feature engineering, model deployment, and end-to-end data engineering workflows.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions
- Ensure data quality and integrity by implementing validation, error-handling, and monitoring mechanisms.
- Work with structured and unstructured data using technologies such as Delta Lake and Parquet within a Big Data ecosystem.
Qualifications:
- Total years : 5+ Years
Primary Skills:
- Data Engineering & Cloud:
- Proficiency in Azure Data Platform (Data Factory, Databricks).
- Robust skills in SQL and [Python or Scala] for data manipulation.
- Experience with ETL/ELT pipelines and data transformations.
- Familiarity with Big Data technologies (Spark, Delta Lake, Parquet).
- Architect and implement data solutions using Azure services such as Azure Data Factory, Azure Databricks, and Azure Blob Storage, ADLS
- Data Optimization & Performance:
- Expertise in data pipeline optimizati
📌 Data Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.