Job Summary: We are seeking a highly skilled Data Engineer with over 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on building and maintaining scalable data pipelines and architectures. You will work closely with data scientists and analysts to ensure the availability and reliability of data for analysis and reporting.
Responsibilities:
- Design, develop, and maintain robust data pipelines to support data ingestion, transformation, and storage.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
- Implement data models and architectures that support business intelligence and analytics initiatives.
- Optimize data processing workflows for performance and scalability.
- Monitor and troubleshoot data pipeline issues, ensuring data quality and integrity.
- Document data engineering processes and maintain best practices for data management.
- Stay updated with industry trends and emerging technologies in data engineering.
Mandatory Skills:
- Proficiency in Python for data manipulation and pipeline development.
- Strong experience with SQL and relational databases.
- Hands-on experience with data warehousing solutions and ETL processes.
- Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks.
- Experience with cloud platforms (AWS, Azure, or Google Cloud) for data storage and processing.
Preferred Skills:
- Knowledge of data visualization tools (Tableau, Power BI, etc.).
- Experience with NoSQL databases (MongoDB, Cassandra, etc.).
- Understanding of machine learning concepts and frameworks.
- Familiarity with containerization technologies (Docker, Kubernetes).
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in data engineering or related roles.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
If you are passionate about data and have the required skills, we encourage you to apply and join our creative team!