15 Sep
|
Bsri Solutions
|
Chennai
15 Sep
Bsri Solutions
Chennai
Job openings for Data Engineer in Chennai
Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
Build and optimize data ingestion processes from multiple structured and unstructured
data sources.
Develop robust data models and data warehouses for analytics and reporting.
Design and optimize SQL queries for high-performance data processing.
Build and maintain data lakes using cloud storage solutions.
Implement data validation, cleansing, transformation, and quality checks.
Integrate data solutions with cloud platforms such as AWS, Azure, or Google Cloud
Platform.
Develop batch and real-time data processing pipelines using contemporary data processing
frameworks.
Collaborate with data scientists, analysts, and application teams to deliver reliable data
solutions.
Follow software engineering best practices, including Git, CI/CD pipelines, testing,
monitoring, and technical documentation.
Required Skills
5+ years of experience in Data Engineering.
Solid programming experience in Python.
Hands-on experience with PySpark and Apache Spark.
Advanced SQL skills, including query optimization and performance tuning.
Experience with AWS services/ Azure/ GCP.
Experience building scalable ETL/ELT pipelines.
Strong exp in Generative AI and Large Language Models (LLMs)
Knowledge of data warehousing concepts and dimensional modeling.
Experience working with large-scale distributed datasets.
Familiarity with Git and CI/CD pipelines.
Understanding Agile/Scrum methodologies.
Preferred Qualifications
Experience with Apache Airflow or similar workflow orchestration tools.
Knowledge of Kafka and real-time data streaming.
Familiarity with Docker, Kubernetes, and Terraform (IaC).
Exposure to Databricks and modern data lake technologies (Delta Lake, Apache Iceberg,
or Apache Hudi).
Understanding data governance, metadata management, and CI/CD practices.
Strong exp in Generative AI and Large Language Models (LLMs)
Robust analytical, problem-solving, and communication skills.
Qualifications
Bachelor's degree in computer science, Information Technology, Engineering, or related
technical discipline.
Experience
4 - 8 Years
Salary
Not Disclosed
Industry
IT Software - Application Programming / Maintenance
Qualification
Key Skills
Python Apache Pyspark Developer SQL AWS SQL Azure LLM Engineer
📌 Hiring Data Engineer For Chennai
🏢 Bsri Solutions
📍 Chennai