As a SDE 3 - Data Engineer, you will play a crucial role in
overseeing the design, development, and maintenance of our organization's data
architecture and infrastructure. You will be responsible for designing and
developing the architecture for the data platform that ensures the efficient
and effective processing of large volumes of data, enabling the business to
make informed decisions based on reliable and high-quality data.
The ideal candidate will have a strong background in data
engineering, excellent leadership skills, and a proven track record of
successfully managing complex data projects.
Responsibilities:
â Data Architecture and Design:
â Design and implement scalable
and productive data architectures to support the organization's data processing
needs
â Work closely with
cross-functional teams to understand data requirements and ensure that data
solutions align with business objectives
â ETL Development:
â Oversee the development of
robust ETL processes to extract, transform, and load data from various sources
into the data warehouse
â Ensure data quality and
integrity throughout the ETL process, implementing best practices for data
cleansing and validation
â Big Data Technologies:
â Stay abreast of emerging trends
and technologies in big data and analytics, and assess their applicability to
the organization's data strategy
â Implement and optimize big data
technologies to process and analyze large datasets efficiently
â Cloud Integration:
â Collaborate with the IT
infrastructure team to integrate data engineering solutions with cloud
platforms, ensuring scalability, security, and performance
â Performance Monitoring and Optimization:
â Implement monitoring tools and
processes to track the performance of data pipelines and proactively address
any issues
â Optimize data processing
workflows for improved efficiency and resource utilization
â Documentation:
â Maintain comprehensive
documentation for data engineering proce