24 Sep
|
Cerebra
|
Bengaluru
Role & responsibilities :
Position: Data Engineer
:
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data platforms. The candidate will work with large datasets, develop ETL/ELT processes, and support data analytics and business intelligence requirements.
Key Responsibilities:
- Design and develop scalable data pipelines and ETL/ELT workflows.
- Develop data ingestion, transformation, and integration processes.
- Work with structured and unstructured data from multiple sources.
- Build and optimize data warehouses, data lakes, and databases.
- Perform data cleansing, validation, and quality checks.
- Optimize SQL queries and data processing jobs for performance.
- Work with cloud data platforms and distributed processing technologies.
- Collaborate with Data Scientists, Analysts, Developers, and Business teams.
- Monitor and troubleshoot data pipelines and production issues.
- Implement data security, governance,
and best practices.
Must-Have Skills:
- Strong SQL skills.
- Valuable experience with Python.
- Experience in ETL/ELT and data pipeline development.
- Knowledge of Data Warehousing concepts.
- Experience with Spark / PySpark.
- Experience with databases such as SQL Server, PostgreSQL, MySQL, or Oracle.
- Knowledge of cloud platforms such as AWS, Azure, or GCP.
- Experience with tools such as Airflow, Databricks, Kafka, or similar technologies.
- Understanding of data modeling and performance optimization.
Good-to-Have Skills:
- AWS: S3, Glue, Redshift, Lambda
- Azure: Data Factory, Synapse, Databricks
- GCP: BigQuery, Dataflow, Cloud Storage
- Kafka / Event Streaming
- Docker / Kubernetes
- CI/CD and Git
- Data Lake / Lakehouse architecture
- Power BI or Tableau exposure
📌 Data Engineer (Bengaluru)
🏢 Cerebra
📍 Bengaluru