We are seeking a highly skilled Data Engineer with over 8 years of experience to join our energetic team. The ideal candidate will have a strong background in data engineering, with a focus on building and maintaining scalable data pipelines and architectures. You will work closely with data scientists and analysts to ensure the availability and reliability of data for analysis and reporting.
Responsibilities
- Design, develop, and maintain robust data pipelines to support data ingestion, transformation, and storage.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
- Implement data models and architectures that support business intelligence and analytics initiatives.
- Optimize data processing workflows for performance and scalability.
- Monitor and troubleshoot data pipeline issues, ensuring data quality and integrity.
- Document data engineering processes and maintain best practices for data management.
- Stay updated with industry trends and emerging technologies in data engineering.
Mandatory Skills
- Proficiency in Python for data manipulation and pipeline development.
- Strong experience with SQL and relational databases.
- Hands-on experience with data warehousing solutions and ETL processes.
- Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks.
- Experience with cloud platforms (AWS, Azure, or Google Cloud) for data storage and processing.
Preferred Skills
- Knowledge of data visualization tools (Tableau, Power BI, etc.).
- Experience with NoSQL databases (MongoDB, Cassandra, etc.).
- Understanding of machine learning concepts and frameworks.
- Familiarity with containerization technologies (Docker, Kubernetes).
Qualifications
- Bachelors degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in data engineering or related roles.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.