13 Sep
|
Bsri Solutions
|
Chennai
13 Sep
Bsri Solutions
Chennai
Job openings for Data Engineer in Chennai
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Build and optimize data ingestion processes from multiple structured and unstructured
data sources.
- Develop robust data models and data warehouses for analytics and reporting.
- Design and optimize SQL queries for high-performance data processing.
- Build and maintain data lakes using cloud storage solutions.
- Implement data validation, cleansing, transformation, and quality checks.
- Integrate data solutions with cloud platforms such as AWS, Azure, or Google Cloud
Platform.
- Develop batch and real-time data processing pipelines using modern data processing
frameworks.
- Collaborate with data scientists, analysts, and application teams to deliver reliable data
solutions.
- Follow software engineering best practices, including Git, CI/CD pipelines, testing,
monitoring, and technical documentation.
Required Skills
- 5+ years of experience in Data Engineering.
- Strong programming experience in Python.
- Hands-on experience with PySpark and Apache Spark.
- Advanced SQL skills, including query optimization and performance tuning.
- Experience with AWS services/ Azure/ GCP.
- Experience building scalable ETL/ELT pipelines.
- Strong exp in Generative AI and Large Language Models (LLMs)
- Knowledge of data warehousing concepts and dimensional modeling.
- Experience working with large-scale distributed datasets.
- Familiarity with Git and CI/CD pipelines.
- Understanding Agile/Scrum methodologies.
Preferred Qualifications
- Experience with Apache Airflow or similar workflow orchestration tools.
- Knowledge of Kafka and real-time data streaming.
- Familiarity with Docker, Kubernetes, and Terraform (IaC).
- Exposure to Databricks and up-to-date data lake technologies (Delta Lake, Apache Iceberg,
or Apache Hudi).
- Understanding data governance, metadata management, and CI/CD practices.
- Strong exp in Generative AI and Large Language Models (LLMs)
- Strong analytical, problem-solving, and communication skills.
Qualifications
- Bachelor's degree in computer science, Information Technology, Engineering, or related
technical discipline.
Experience
4 - 8 Years
Salary
Not Disclosed
Industry
IT Software - Application Programming / Maintenance
Qualification
Key Skills
Python Apache Pyspark Developer SQL AWS SQL Azure LLM Engineer
📌 Hiring Data Engineer For Chennai
🏢 Bsri Solutions
📍 Chennai