: Data Engineer

Position Overview:

We are seeking a talented Data Engineer with a strong background in building and maintaining large-scale data engineering pipelines, data marts, and warehouses. The ideal candidate will have proficiency in programming languages such as Python and SQL, along with experience in Apache Spark, Apache Airflow, Docker, Bash, and cloud-based data engineering platforms like Azure Data Factory, Google Cloud Dataflow/Data Fusion, AWS Data Pipeline/Glue, and Stitch/Snowflake.

Additionally, experience with data streaming technologies such as Kafka/Kinesis is highly desirable. The candidate should also have working knowledge of data visualization tools like Tableau or PowerBI.

Responsibilities:

- Design, develop, and maintain scalable data engineering pipelines, data marts, and warehouses to support business analytics and reporting needs.
- Utilize programming languages such as Python and SQL to extract, transform, and load (ETL) data from various sources into structured formats suitable for analysis.
- Implement and manage Apache Spark jobs for processing large volumes of data efficiently.
- Orchestrate and schedule data workflows using Apache Airflow for automation and monitoring purposes.
- Containerize data processing tasks using Docker for portability and consistency across different environments.
- Implement and manage data pipelines on cloud platforms such as Azure, Google Cloud, or AWS, leveraging services like Azure Data Factory, Google Cloud Dataflow/Data Fusion, AWS Data Pipeline/Glue, or Stitch/Snowflake.




- Work with data streaming technologies such as Kafka or Kinesis to process real-time data streams and build streaming analytics solutions.
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable solutions.
- Develop and maintain data APIs for seamless integration with other systems and applications.
- Optimize data pipelines for performance, scalability, and reliability to handle complex, high-volume, multi-dimensional datasets.
- Conduct thorough testing and debugging of data pipelines to ensure accuracy, completeness, and data quality.
- Stay abreast of emerging trends and technologies in data engineering and contribute to the continuous improvement of data processes and infrastructure.

Qualifications:

- Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
- 2-3 years of experience in data engineering, with a focus on building scalable data pipelines and warehouses.
- Proficiency in programming languages such as Python and SQL for data manipulation and analysis.
- Strong experience with Apache Spark for distributed data processing.




- Familiarity with workflow orchestration tools like Apache Airflow.
- Experience with containerization tools like Docker and shell scripting with Bash.
- Hands-on experience with cloud-based data engineering platforms such as Azure Data Factory, Google Cloud Dataflow/Data Fusion, AWS Data Pipeline/Glue, or Stitch/Snowflake.
- Knowledge of data streaming technologies such as Kafka or Kinesis.
- Experience in developing and using data APIs for data access and integration.
- Strong problem-solving skills and attention to detail in handling complex, high-volume, multi-dimensional datasets.
- Positive communication skills and ability to collaborate effectively with cross-functional teams.
- Good to have experience with data visualization tools like Tableau or PowerBI.

How to Apply: Please submit your resume and a cover letter (optional) outlining your relevant experience and why you are interested in this position. Additionally, include any relevant work samples or projects showcasing your data engineering skills. We look forward to reviewing your application!

Pay: Up to ₹1,000,000.00 per year

Benefits

- Health insurance
- Provident Fund

Ability to commute/relocate:
- Mohali, Punjab: Reliably commute or planning to relocate before starting work (Required)

Experience:
- Python: 2 years (Required)
- SQL: 2 years (Required)
- Tableau / PowerBI: 2 years (Required)
- AWS/ Azure/ Google Cloud: 2 years (Required)

Location:
- Mohali, Punjab (Required)

Work Location: In person

📌 Data Engineer (Sahibzada Ajit Singh Nagar)
🏢 Growth Natives
📍 Sahibzada Ajit Singh Nagar