03 Aug
|
Avp Vigilant Technology
|
Gurugram
03 Aug
Avp Vigilant Technology
Gurugram
Job Title: Data Engineer Experience: 2–10 Years Employment Type: Full-Time Location: Bangalore / Mumbai / Gurgaon Salary: ₹12–45 LPA Job Summary We are looking for a skilled Data Engineer to design, build, and optimize scalable data pipelines and modern data platforms. The ideal candidate should have strong expertise in Apache Spark, SQL, and Databricks, with experience handling large-scale data processing, ETL development, and cloud-based data engineering solutions.
Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines.
Build and optimize data processing workflows using Apache Spark.
Develop and manage data solutions on Databricks.
Write efficient SQL queries for data extraction, transformation, and analysis.
Integrate data from multiple structured and unstructured sources.
Optimize data models, storage, and pipeline performance.
Ensure high data quality, integrity, and security across platforms.
Collaborate with Data Scientists, Analysts, and Software Engineers.
Troubleshoot production issues and improve system reliability.
Participate in architecture discussions and implement best engineering practices.
Required Skills Solid experience with Apache Spark
Advanced SQL programming
Hands-on experience with Databricks
ETL/ELT pipeline development
Data Warehousing concepts
Python or Scala (preferred)
Experience with cloud platforms (AWS, Azure, or GCP)
Git and CI/CD fundamentals
Data Lake and Delta Lake concepts
Performance tuning and query optimization Preferred Qualifications Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Experience working with large-scale distributed data processing.
Knowledge of Airflow, Kafka, Snowflake, or Azure Data Factory is an added advantage.
Familiarity with Agile/Scrum development methodologies.
What We Offer Market-competitive salary of ₹12–45 LPA
Prospect to work on enterprise-scale data platforms
Exposure to up-to-date cloud and big data technologies
Learning and certification support
Collaborative and innovative work environment
Growth opportunities opportunities with leading organizations Hiring Process Resume Screening
Technical Assessment
Technical Interview(s)
Managerial Discussion
HR Interview
Offer & Onboarding Skills: databricks,etl,python,ci/cd,apache spark,aws, azure, or gcp
📌 Data Engineer Gurugram
🏢 Avp Vigilant Technology
📍 Gurugram