Job Description
Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of cutting-edge solutions. This pivotal role not only demands your proficiency in developing and elevating compute and I/O-intensive applications but also ensures their peak performance and unwavering reliability.
n
n Responsibilities:
n
- n
- Develop and implement real-time data ingestion and processing systems.n
- Design, build, and operationalize large-scale enterprise data solutions and applications.n
- Create and manage production data pipelines, from ingestion to consumption, within a big data architecture using PySpark.n
- Leverage expertise in Python, Airflow, SQL, and cloud platforms to build robust solutions (strong knowledge of these is essential).n
- Translate complex business challenges into scalable and efficient technical solutions.n




- Work collaboratively with a high-performing data engineering team, owning the full lifecycle of solution implementation.n

n
n Requirements :
n
- n
- Bachelor's Degree in Computer Science, Information Technology, or a similar discipline.n
- 3 - 8 years of professional experience in data engineering or related fields.n
- Proven experience with ETL processes, data integration, and handling large-scale datasets using PySpark.n
- Strong understanding of data engineering concepts like ETL, near/real-time streaming, data structures, and workflow management.n
- Experience with version control tools like Git/GitHub.n
- Proficiency in SQL and Data Warehouse concepts.n
- Experience working with SQL or NoSQL databases like Cassandra, MongoDB, or HBase.n
- Knowledge of AWS technologies such as EMR, RedShift, Kinesis, Lambda, Glue, S3 IAM, CloudWatch, and big data tools like Hadoop/EMR, Hive, an

📌 Senior Data Engineer (Bengaluru)
🏢 Arcana
📍 Bengaluru