19 Aug
|
PERMEVO
|
Chennai
??? ?????: Sr. Data Engineer
??? ????????: Chennai, Tamil Nadu, India
???? ????: Hybrid (WFO: Tuesday, Wednesday & Thursday)
??? ????: Full-Time
?????????? ????????: 5-8 Years
??? ?????????
We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data platforms and pipelines that support analytics, reporting, and business intelligence initiatives.
In this role, you will work with diverse data sources, real-time streaming platforms, cloud-based data warehouses, and large-scale datasets to develop reliable and high-performance data solutions. You will collaborate closely with cross-functional teams to transform business requirements into robust data architectures that drive informed decision-making.
This chance is ideal for professionals passionate about modern data engineering, cloud technologies, distributed processing, and real-time data systems.
????? & ????????????????
- Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and integration across multiple data sources.
- Build and optimize ETL/ELT workflows to ensure efficient and reliable data movement.
- Work with relational and NoSQL databases to manage large-scale datasets and support business applications.
- Develop solutions leveraging cloud data warehouses such as Snowflake and Amazon Redshift.
- Process and analyze structured, semi-structured, and unstructured data stored in Amazon S3 using services such as AWS Athena and AWS Glue.
- Implement and manage real-time data streaming architectures using Apache Kafka.
- Utilize Apache Spark for distributed data processing and large-scale analytics when required.
- Monitor, troubleshoot, and optimize data pipeline performance to ensure scalability, reliability, and high availability.
- Ensure data quality, consistency, governance, and integrity across data ecosystems.
- Collaborate with business stakeholders, analysts, and engineering teams to translate requirements into technical solutions.
- Participate in architecture discussions and contribute to best practices in data engineering and platform design.
- Stay current with emerging data technologies and industry trends to continuously improve data infrastructure.
????????? ?????? & ????????????
????-???? ??????????????
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- 5-8 years of hands-on experience in Data Engineering.
- Strong experience designing and managing data pipelines and data integration solutions.
- Expertise in relational databases, including:
o MySQL o PostgreSQL
- Experience working with NoSQL databases such as:
o MongoDB o Cassandra
- Hands-on experience with cloud data warehouses:
o Snowflake o Amazon Redshift
- Experience processing data stored in Amazon S3 using:
o AWS Athena o AWS Glue
- Strong experience implementing real-time data streaming solutions using Apache Kafka.
- Solid understanding of ETL/ELT frameworks, data transformation, and pipeline optimization.
- Proficiency in at least one programming language:
o Python o Java o Scala
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and collaboration abilities.
????????? ??????????????
- Experience using Apache Spark for large-scale data processing and analytics.
- Exposure to cloud platforms such as:
o AWS o Google Cloud Platform (GCP)
o Microsoft Azure
- Experience with big data technologies and distributed processing frameworks.
- Familiarity with data lake and cloud-native data architectures.
- Knowledge of performance tuning and optimization techniques for large datasets.
- Experience working in Agile development environments.
????????? ??????
???? ???????????
- ETL / ELT Development
- Data Integration
- Data Pipeline Design
- Data Warehousing
- Data Modeling
?????????
- MySQL
- PostgreSQL
- MongoDB
- Cassandra
????????? & ????-???? ??????????
- Apache Kafka
??? ???? & ?????????
- Apache Spark
- Distributed Data Processing
????? & ???? ?????????
- AWS
- Amazon S3
- AWS Athena
- AWS Glue
- Snowflake
- Amazon Redshift
??????????? ?????????
- Python
- Java
- Scala
📌 Sr. Data Engineer (Chennai)
🏢 PERMEVO
📍 Chennai