Job Title: Data Engineer

Experience: 2–10 Years

Employment Type: Full-Time

Location: Bangalore / Mumbai / Gurgaon

Salary: ₹12–45 LPA

Job Summary We are looking for a skilled Data Engineer to design, build, and optimize scalable data pipelines and modern data platforms. The ideal candidate should have strong expertise in Apache Spark, SQL, and Databricks , with experience handling large-scale data processing, ETL development, and cloud-based data engineering solutions.

Key Responsibilities

- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build and optimize data processing workflows using Apache Spark.
- Develop and manage data solutions on Databricks.
- Write productive SQL queries for data extraction, transformation, and analysis.
- Integrate data from multiple structured and unstructured sources.
- Optimize data models, storage, and pipeline performance.
- Ensure high data quality, integrity, and security across platforms.
- Collaborate with Data Scientists, Analysts, and Software Engineers.
- Troubleshoot production issues and improve system reliability.
- Participate in architecture discussions and implement best engineering practices.

Required Skills

- Strong experience with Apache Spark
- Advanced SQL programming




- Hands-on experience with Databricks
- ETL/ELT pipeline development
- Data Warehousing concepts
- Python or Scala (preferred)
- Experience with cloud platforms (AWS, Azure, or GCP)
- Git and CI/CD fundamentals
- Data Lake and Delta Lake concepts
- Performance tuning and query optimization

Preferred Qualifications

- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience working with large-scale distributed data processing.
- Knowledge of Airflow, Kafka, Snowflake, or Azure Data Factory is an added advantage.
- Familiarity with Agile/Scrum development methodologies.

What We Offer
- Competitive salary of ₹12–45 LPA
- Opportunity to work on enterprise-scale data platforms
- Exposure to modern cloud and big data technologies
- Learning and certification support
- Team-oriented and innovative work environment
- Career growth opportunities with leading organizations

Hiring Process
- Resume Screening
- Technical Assessment
- Technical Interview(s)
- Managerial Discussion
- HR Interview
- Offer & Onboarding

Skills: databricks,etl,python,ci/cd,apache spark,aws, azure, or gcp

📌 Data Engineer (Pune)
🏢 AVP Vigilant Technology
📍 Pune