Senior Consultant - AI Data and Solution Architect

About the job Project info: Ready to shape the future of AI in finance? We’re looking for a talented AI Data and Solution Architect to join one of the world's most renowned banking brands. Serving over 100 million customers across diverse businesses, you'll be a key player on a dynamic, remote team spanning the UK and Spain. This project governs the large-scale legacy migration and modernization of data infrastructure. The primary objective is to convert their legacy Ab Initio ETL (Extract, Transform, Load) platform to a modern, cloud-native AWS Glue and PySpark environment. To accelerate this migration and optimize code generation, the team will leverage advanced generative AI patterns, specifically incorporating Claude Code and agentic/multi-agent workflows to automate and validate pipeline conversions. Responsibilities: Architectural Leadership: Design, build, and oversee highly scalable, future-proof enterprise data architectures and solution designs tailored for complex financial environments. Large-Scale Migrations: Lead and execute complex, high-volume enterprise data platform migrations (overseeing scopes of 3,000+ jobs), ensuring seamless transitions and optimal performance. Cloud Data Engineering: Architect and optimize robust data pipelines and workflows utilizing AWS native services (Glue, Athena, Lake Formation, S3) and expert-level Apache Spark/PySpark tuning. ETL & Data Warehousing: Establish and implement advanced ETL/ELT patterns, modern data warehousing strategies, and reliable data pipeline orchestration. Governance & Security: Design secure architectures and metadata management strategies that ensure strict adherence to industry compliance and regulatory frameworks (PCI-DSS, FCA, SOX, GDPR). Executive Strategy & Roadmapping: Develop strategic data roadmaps and act as the bridge between technical execution and business goals, presenting architectural decisions and solutions directly to C-level executives. Team Mentorship & Problem Solving: Lead technical teams, drive critical architectural decisions, and navigate complex engineering challenges with decisive problem-solving skills. Job requirements: 10+ years in data architecture and solution design 7+ years leading enterprise data platform migrations (minimum 2 engagements) 5+ years with AWS data services (Glue, Athena, Lake Formation, S3) Expert-level knowledge of ETL/ELT patterns and data warehousing 3+ years in financial services or regulated industries Technical Expertise: Expert-level AWS Glue and Apache Spark knowledge Deep expertise in PySpark optimization and performance tuning Experience with data governance and metadata management Understanding of security architecture and compliance frameworks Experience with data pipeline orchestration and workflow management Industry Experience (Nice to Have): Financial services background Experience with large-scale data migrations (3,000+ jobs) Knowledge of regulatory compliance (PCI-DSS, FCA, SOX, GDPR) Proven ability to lead technical teams and drive architectural decisions Strong communication with both technical and non-technical stakeholders Strategic thinking and roadmap development Ability to work with C-level executives Problem-solving and decision-making skills Benefits: General benefits Remote work model Referral program with financial bonus Budget for development (including language courses and others), clear career path with the possibility to gain experience in international environment Access to internal Learning Platform with multiple trainings oriented for professional growth Lifestyle benefits: Team Building activities Charity initiatives Working environment promoting diversity and inclusion