19 Nov
|
Bsri Solutions
|
Chennai
19 Nov
Bsri Solutions
Chennai
Job Description Data Engineer
Job Title: Data Engineer
Location: Chennai
Employment Type: Full time
Job Summary
We are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate should have robust experience in PySpark, SQL, Python, cloud platforms (AWS/Azure/GCP), and ETL pipeline development. The candidate will be responsible for transforming raw data into reliable, high-quality datasets to support analytics and business intelligence.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Python.
Write, optimize, and troubleshoot complex SQL queries.
Develop and maintain ETL/ELT pipelines for data extraction, transformation, and loading.
Work with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
Perform data cleansing, transformation, validation, and quality checks.
Optimize data processing workflows for performance, scalability, and reliability.
Collaborate with data analysts, data scientists, and other technical teams to understand data requirements.
Monitor pipeline performance, troubleshoot failures, and implement solutions.
Maintain technical documentation for data workflows, processes, and architecture.
Follow best practices for data security, governance, and access management.
Required Skills & Relevant Experience
Skill SetRelevant Experience (Years)PySpark yearsSQL yearsPython yearsAWS / Azure / GCP yearsETL Pipeline Development_ years
Required Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Strong hands-on experience in PySpark, SQL, Python, and ETL pipeline development.
Practical experience with at least one cloud platform: AWS, Azure, or GCP.
Understanding of data warehousing, data modelling, and distributed data processing.
Solid analytical, problem-solving, and debugging skills.
Ability to work collaboratively in a team-oriented environment.
Preferred Skills
Experience with Apache Spark and distributed computing.
Familiarity with cloud-based data services and storage solutions.
Knowledge of workflow orchestration tools and scheduling frameworks.
Experience with Git, CI/CD, and data pipeline monitoring tools.
How to Apply
Interested candidates can share their updated resume along with their relevant experience in the required skill sets listed above.
📌 Data Engineer Chennai
🏢 Bsri Solutions
📍 Chennai