About the Role

In this role, you will play a pivotal part in designing and implementing robust data pipelines that drive our analytics initiatives. Your day-to-day activities will include developing ETL and ELT processes that ensure high-quality data for analysis and reporting. You will collaborate closely with data scientists and analysts, providing them with the data infrastructure they need to derive insights from our information landscape.

What You'll Do
Design and construct scalable data pipelines using Spark, PySpark, and Databricks.
Develop and maintain ETL and ELT processes to manage complex data flows efficiently.
Optimize data workflows to enhance performance and reliability.
Manage and maintain cloud-based data storage solutions like Snowflake, Redshift, and BigQuery.
Ensure compliance with best practices in data quality, governance, and security.




Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
Monitor pipeline performance, troubleshoot issues, and implement improvements as needed.

What We're Looking For
Robust experience in ETL/ELT processes with a focus on building effective data pipelines.
Proficiency in Spark and PySpark for large-scale data processing.
Familiarity with cloud data platforms including Snowflake, Redshift, and BigQuery.
Solid understanding of data modeling concepts and data warehousing practices.
Experience in designing high-performance architectures for data management.
Ability to communicate effectively with both technical and non-technical stakeholders.
A proactive approach to problem-solving and a commitment to delivering quality results.

📌 Data Engineer Etl, Elt, Data Pipeline Hyderabad
🏢 Albireo Recruiters
📍 Hyderabad