Objectives of this role
Designing, developing, and implementing scalable and effective data processing pipelines using Big Data technologies.
Collaborating with data architects, data scientists, and business analysts to understand and translate data requirements into technical solutions.
Developing and optimizing ETL (Extract, Transform, Load) processes to ingest and transform large volumes of data from multiple sources.
Implementing data integration solutions to ensure seamless data flow and accessibility across different platforms and systems.
Building and maintaining data warehouses, data lakes, and data marts to store and organise structured and unstructured data.
Designing and developing data models, schemas, and structures to support business analytics and reporting requirements.
Monitoring and optimizing the performance of Big Data applications and infrastructure to ensure reliability, scalability, and efficiency.
Troubleshooting and resolving data processing, quality, and system performance issues.
Your tasks




Develop and deploy data processing applications using Big Data frameworks such as Hadoop, Spark, Kafka, or similar technologies.
Write efficient and optimized code in programming languages like Java, Scala, Python, or SQL to manipulate and analyse data.
Implement data security and privacy measures to protect sensitive information and comply with regulatory requirements.
Collaborate with cross-functional teams to integrate data solutions with existing systems and applications.
Conduct testing and validation of data pipelines and analytical solutions to ensure accuracy, reliability, and performance.
Document technical specifications, deployment procedures, and operational guidelines for data solutions.
Stay updated on industry trends, emerging technologies, and Big Data development and analytics best practices.

Experience - 6-10 yrs

📌 Bigdata Developer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru