Job DescriptionDescription:
n
- n
- Data Pipeline Development: Designing and building scalable, productive, and reliable data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems, such as data lakes or data warehouses.n
- Provide leadership on the migration from Hadoop to Azure and on how we leverage data in multiple portfoliosn
- Data Modeling: Developing and implementing data models that optimize data storage, retrieval, and analysis, considering factors such as data volume, variety, and velocity.n
- Data Integration: Integrating data from different sources, including databases, APIs, streaming platforms, and third-party systems, to ensure data consistency and accuracy.n
- Data Transformation and Cleansing: Applying data transformation techniques to clean, preprocess, and enrich data, ensuring its quality and readiness for analysis and reporting.n
- Data Warehousing and Storage: Designing and maintaining data warehouses or data lakes to efficiently store and manage large volumes of structured and unstructured data.n




- Data Governance and Security: Implementing data governance practices and security measures to protect sensitive data, ensure data privacy, and comply with regulations such as GDPR or CCPA.n
- Performance Optimization: Monitoring and optimizing data processing and query performance, identifying and resolving bottlenecks to improve data retrieval and analysis efficiency.n
- Collaboration with Data Analysts and Scientists: Collaborating with data analysts and data scientists to understand their requirements and provide them with reliable, accurate, and well-organized data sets for analysis and modeling.n

nKey Skillsets :
n
- n
- Strong Programming and Scripting Skills: Proficiency in programming languages such as Python, SQL, or Scala, as well as experience with scripting and automation tools, for data manipulation, ETL processes, and pipeline development.n
- Experience with Azure cloud, Azur

📌 Databricks Technical lead (Hyderabad)
🏢 Quess Corp
📍 Hyderabad