Staff Software Engineer (Data Platform)
Join our dynamic team at the forefront of cutting-edge technology as we seek a
seasoned Staff Data Engineer. Embark on a journey where your deep-rooted
expertise in distributed systems, data architectures, and large-scale processing
becomes the cornerstone of building high-performance data platforms. This
pivotal role demands proficiency in designing and scaling compute and
I/O-intensive data systems, ensuring reliability, efficiency, and cost
optimization across the data lifecycle.
Responsibilities:
● Design and build scalable data platform components for batch and real-time
data processing.
● Architect, develop, and operationalize large-scale data systems across
ingestion, transformation, and serving layers.
● Build and manage robust data pipelines ensuring high reliability, scalability,
and cost efficiency.
● Develop reusable frameworks and tooling to accelerate productivity for data
engineers and data scientists.
● Leverage expertise in Python, Airflow, SQL, and cloud platforms to build
production-grade data solutions.
● Optimize query performance and data models using strong understanding of
columnar OLAP systems such as ClickHouse, Doris, and StarRocks.
● Implement streaming and near real-time data processing systems.
● Translate complex business requirements into scalable and effective data
platform solutions.
● Work collaboratively with cross-functional teams and provide technical
leadership and mentorship.
● Drive architectural decisions by evaluating tradeoffs and selecting the right
tools for the problem.
Requirements:
● Bachelor's Degree in Computer Science, Information Technology, or a similar
discipline.
● 8+ years of professional experience in data engineering, backend systems, or
distributed systems.
● Proven experience building scalable data platforms and large-scale data
systems.
● Strong experience with ETL pipelines, data integration, and workflow
orchestration systems such as Airflow or Temporal.
● Hands