23 Oct
|
Bsri Solutions
|
Bengaluru
23 Oct
Bsri Solutions
Bengaluru
Data Engineer
Job Title: Data Engineer
Location: Chennai
Employment Type: Full-Time
Job Summary
We are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate should have solid experience in PySpark, SQL, Python, cloud platforms (AWS/Azure/GCP), and ETL pipeline development. The candidate will be responsible for transforming raw data into reliable, high-quality datasets to support analytics and business intelligence.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Python.
Write, optimize, and troubleshoot complex SQL queries.
Develop and maintain ETL/ELT pipelines for data extraction, transformation, and loading.
Work with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
Perform data cleansing, transformation, validation, and quality checks.
Optimize data processing workflows for performance, scalability, and reliability.
Collaborate with data analysts, data scientists, and other technical teams to understand data requirements.
Monitor pipeline performance, troubleshoot failures, and implement solutions.
Maintain technical documentation for data workflows, processes, and architecture.
Follow best practices for data security, governance, and access management.
Required Skills & Relevant Experience Skill SetRelevant Experience (Years)PySpark yearsSQL yearsPython yearsAWS / Azure / GCP yearsETL Pipeline Development_ years
Required Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Strong hands-on experience in PySpark, SQL, Python, and ETL pipeline development.
Practical experience with at least one cloud platform: AWS, Azure, or GCP.
Understanding of data warehousing, data modelling, and distributed data processing.
Robust analytical, problem-solving, and debugging skills.
Ability to work collaboratively in a team-oriented setting.
Preferred Skills
Experience with Apache Spark and distributed computing.
Familiarity with cloud-based data services and storage solutions.
Knowledge of workflow orchestration tools and scheduling frameworks.
Experience with Git, CI/CD, and data pipeline monitoring tools.
How to Apply Interested candidates can share their updated resume along with their relevant experience in the required skill sets listed above.
📌 Data Engineer Bengaluru
🏢 Bsri Solutions
📍 Bengaluru