Job Summary
- Lead the design and implementation of scalable ETL/ELT data pipelines using Python or C# for efficient data processing.
- Architect data solutions for large-scale batch and real-time processing using cloud services (AWS, Azure, Google Cloud).
- Craft and manage cloud-based data architectures with services like AWS Redshift, Google BigQuery, Azure Data Lake, and Snowflake.
- Implement cloud data solutions using Azure services such as Azure Data Lake, Blob Storage, SQL Database, Synapse Analytics, and Data Factory. Develop and automate data workflows for seamless integration into Azure platforms for analysis and reporting.
- Manage and optimize Azure SQL Database, Cosmos DB, and other databases for high availability and performance. Supervise and optimize data pipelines for performance and cost efficiency.
- Implement data security and governance practices in compliance with regulations (GDPR, HIPAA) using Azure security features.
- Collaborate with data scientists and analysts to deliver data solutions that meet business analytics needs.
Mentor junior data engineers on standard processes in data engineering and pipeline design. Set up supervising and alerting systems for data pipeline reliability.
- Ensure data accuracy and security through strong governance policies and access controls. Maintain documentation for data pipelines and workflows for transparency and onboarding.
What You Bring
- 8-10 years of proven experience in data engineering with a focus on large-scale data pipelines and cloud infrastructure.
- Solid expertise in Python (Pandas, NumPy, ETL frameworks) or C# for efficient data processing solutions. Extensive experience with cloud platforms (AWS, Azure, Google Cloud) and their data services.
- Sophisticated knowledge of relational (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Cassandra). Familiarity with big data technologies (Apache Spark, Hadoop, Kafka).
- Strong background in data modeling and ETL/ELT development for large datas
📌 Data Engineer (Bengaluru)
🏢 Siemens Energy
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.