We're seeking a passionate and experienced Data Engineer to join our dynamic team at Central Lobão S.A.!
If you are eager to drive innovation by developing high-quality data solutions, then you might be the person we're looking for.
Key Responsibilities:
1. Data Architecture & Management:
• Design and maintain large-scale processing systems.
• Optimize databases for performance.
2. ETL & Pipeline Development:
• Develop and optimize ETL processes for data transformation.
• Build scalable data pipelines to meet business needs.
3. Performance & Scalability:
• Fine-tune systems and databases for optimal performance.
• Monitor usage and plan for capacity enhancements.
4. Data Security & Compliance:
• Implement robust security measures for data privacy.
• Ensure compliance with data privacy regulations.
5. Collaboration & Stakeholder Engagement:
• Collaborate with internal stakeholders, including Business Intelligence and Data Scientists, to understand data needs.
• Gather requirements and engage with non-technical stakeholders.
6. Data Quality & Validation:
• Monitor data quality and implement validation procedures.
7. Technology Integration:
• Stay updated on industry trends and integrate new tools.
8. Documentation & Training:
• Document systems and provide training on tools and best practices.
Requisites:
• Bachelor's degree in Computer Science, Engineering, or related field.
• 3+ years of experience in data engineering roles.
• Proficiency with Python, SQL, and ETL tools.
• Strong understanding of data security and compliance.
Previous Experience:
• Proven track record of designing and managing data pipelines.
• Experience with Apache Airflow for workflow automation.
• Background in data warehousing and governance.
Nice to Have:
• Experience with API integrations and data extraction.
• Knowledge of real-time data processing systems.
• Familiarity with Apache MLflow for model management.
Benefits:
• Competitive salary package.
• Exciting projects within a passionate team.
• Collaborate with internal stakeholders such as BI and Data Scientists.
• Professional development opportunities.
• Other benefits specific to our company.
The response should be sent to the following email: rh@centrallobao.pt