We are looking for an experienced Data Engineer consultant to design and govern complex, end-to-end data architectures. The role covers data ingestion, integration, processing, storage, governance and consumption, with responsibility for evaluating architectural alternatives and guiding technical decisions.
Main Responsibilities
- Design scalable, resilient and secure end-to-end data architectures aligned with business, functional and non-functional requirements.
- Define data models and architectures for Data Warehouses, Data Lakes, Lakehouses and analytical platforms.
- Design data integration approaches covering ETL/ELT, batch, streaming, CDC, APIs and event-driven patterns.
- Evaluate architectural and technology alternatives, document trade-offs and decisions through ADRs or equivalent mechanisms.
- Define and evolve reference architectures, blueprints, standards and data architecture principles.
- Embed Data Governance, Data Quality, Data Lineage, Metadata Management, Data Catalog, Master Data Management, security and GDPR considerations into architecture.
- Address performance, scalability, availability, recoverability, observability and cost optimisation requirements.
- Provide architecture governance and technical guidance to architects, data engineers and implementation teams.
- Produce architecture documentation and communicate recommendations to technical and business stakeholders.
- Minimum 15 years of professional IT experience, including proven experience in Data Architecture, Solution Architecture and complex data solution design.
- Degree in Computer Engineering, Software Engineering or a related field.
- Advanced knowledge of relational and NoSQL databases, data modelling, Data Warehouse, Data Lake, Lakehouse and Big Data technologies.
- Experience with Azure, AWS or Google Cloud.
- Strong experience with data integration architectures and patterns.
- Solid knowledge of data governance, security, quality, lineage, metadata, data catalogues, Master Data Management and GDPR.
- Experience with reference architectures, technology standards and Enterprise Architecture principles.
- Ability to analyse complex requirements, evaluate trade-offs and make architectural decisions autonomously.
- Technical leadership and the ability to influence architectural decisions across multidisciplinary and global teams.
- Knowledge of the Energy & Utilities sector.
- Strong written and verbal communication skills in English and Portuguese.
Additional Valued Experience
- Microsoft Fabric, Azure Databricks, Azure Synapse, BigQuery or Amazon Redshift.
- Strategic projects, Agile methodologies, JIRA and Confluence.
- Data architectures for Analytics, Machine Learning and AI.
- Portuguese and Spanish.