14 Aug
|
AVP Vigilant Technology
|
Gurugram
14 Aug
AVP Vigilant Technology
Gurugram
Experience: 1–8 Years
Employment Type: Full-Time Contract
Contract Duration: 6 Months
Salary: ₹6–20 LPA
Job Type: Contract / Fixed-Term
Job Summary We are looking for a skilled Big Data Engineer to design, develop, and maintain scalable data processing solutions. The ideal candidate should have hands-on experience with big data technologies, data pipelines, distributed computing, and cloud/data platforms.
Key Responsibilities
- Design and develop scalable big data pipelines and ETL/ELT workflows.
- Process and analyze large volumes of structured and unstructured data.
- Develop data solutions using Hadoop, Spark, Kafka, or similar technologies.
- Build and optimize batch and real-time data processing pipelines.
- Work with data engineers, analysts, developers, and business teams.
- Optimize data processing jobs for performance, reliability, and scalability.
- Implement data quality, validation, and monitoring processes.
- Troubleshoot pipeline failures and production data issues.
- Work with cloud-based data platforms and storage solutions.
- Maintain technical documentation and follow data engineering best practices.
Required Skills
- Strong programming experience in Python, Java, or Scala.
- Hands-on experience with Apache Spark / PySpark.
- Knowledge of Hadoop, HDFS, Hive, or similar big data technologies.
- Experience building ETL/ELT pipelines.
- Knowledge of SQL and relational databases.
- Experience with Apache Kafka or other streaming technologies.
- Understanding of distributed computing and data processing concepts.
- Familiarity with AWS, Azure, or GCP is preferred.
- Positive understanding of data warehousing and data modeling.
Preferred Skills
- Databricks
- Snowflake
- Airflow
- AWS EMR / Glue
- Azure Data Factory
- Google BigQuery
- Docker / Kubernetes
- CI/CD
- Git
Experience Levels
- 1–3 Years: Junior/Mid-Level Big Data Engineer
- 3–5 Years: Big Data Engineer
- 5–8 Years: Senior Big Data Engineer
Contract Details
- Contract: 6 Months
- Employment: Full-Time
- Salary: ₹6–20 LPA
- Candidates should be comfortable working on a 6-month contractual assignment.
- Contract extension or conversion may be subject to project requirements and performance.
Apply Now: (phone hidden) (WhatsApp) Skills: aws,azure,big data,cloud,pipelines
📌 Big Data Engineer (Gurugram)
🏢 AVP Vigilant Technology
📍 Gurugram