Description
The Model Validation (MV) group is a centralized Model Risk Management function within the Bank. It has seen fast growth in the past few years reflecting global regulators’ increasing attention on model risk.
The Artificial Intelligence / Machine Learning (AI / ML) Model Validation (MV) group is responsible for the review / vetting and approval of AI / ML models developed and used across the enterprise (e.
g., Fraud, Retail Credit Risk, Marketing, NLP, TD Wealth, TD Asset Management, Treasury Balance Sheet Management, TD Insurance, TD Securities), including Generative AI and other contemporary Deep Learning models.
The position reports to the AVP, AI / ML Model Validation group and is primarily focused on leading the team responsible for the review / vetting of Generative AI, NLP and other Deep Learning models.
Detailed accountabilities include :
Lead a team of Machine Learning Scientists to perform validation of complex AI / ML models, particularly Generative AI, LLMs / NLP and Deep Learning models.
Validate (review, test / evaluate, and provide effective challenge to the model developers) AI / ML models, particularly Generative AI and Deep Learning models.
Recommend the approval of models or other corrective actions based on the independent validation.
Lead and support a team of model validators.
Ensure performance objectives are set for all staff and that performance feedback is provided on a regular basis.
Communicate group objectives and strategies and align group activities in support of business objectives.
Support employee development activities, coach and support direct reports in meeting their personal development objectives.
Assume a leadership role in developing standards and procedures for vetting and validation of Generative AI, NLP and diverse Deep Learning models that are compliant with the Bank’s internal Model Risk Policy, adhere with industry and academic best practices, and meet regulatory requirements.
Respond to requests from both Canadian and U.S. regulators, internal and external audit in their review / audit of models and vetting / validation process and procedures.
Provide information and assistance as required.
Work effectively with internal Model Development groups, Audit, and other internal partners to ensure models meet required Bank standards for use.
Play a key role in ensuring the appropriate use of AI / ML models. Identify the need to implement new models / techniques as industry standards evolve and regulatory requirements change.
Maintain full professional knowledge of techniques and developments in the field of AI and Machine Learning, and share knowledge with business partners and senior management.
Provide subject matter expertise to business units on Generative AI, LLMs / NLP and other Deep Learning modeling and validation.
Stay up to date with advancements in the field of Generative AI including major publications, important Large Language Models (LLMs), evaluation metrics, technology stacks, and datasets.
Communicate findings and recommendations to both technical and non-technical stakeholders.
The position involves working effectively with internal partners from different model development groups and other relevant 2nd line risk control functions.
Advanced quantitative and AI / ML skills with post-secondary degree in one or more of the following areas : computer science, machine learning / AI, engineering, statistics, mathematics, etc.
4+ years of experience in either developing or validating Generative AI, LLMs, NLP and other Deep Learning models; and 2+ years of experience in leading a small team of machine learning scientists.
In-depth knowledge of AI / ML methodologies, concepts and theory including Generative AI, Deep Learning, modern Natural Language Processing (NLP), Retrieval-Augmented Generation (RAG), Transformers, Diffusion models, and etc.
Experience with Deep Learning and Generative AI technology stacks and libraries such as PyTorch, Tensorflow / Keras, LangChain, HuggingFace, etc.
Motivated to stay up to date with the latest advancements in Generative AI, machine learning, and cloud technologies.
Proficient in one or more scripting / programming languages such as Python.
Familiarity with cloud platforms (e.g., Azure, AWS) and big data technologies (e.g., PySpark, Hadoop).
Familiarity with Data Structures, Algorithm design, and principles of Object-Oriented Programming (OOP).
Knowledge of machine learning explain-ability / interpretability algorithms.
Excellent verbal and written communication skills. and stakeholder management abilities (position requires writing and reviewing reports of technical nature).
Strong critical and analytic thinking skills.
Excellent time / project management and multitasking skills with minimal supervision.
Ability to work independently and collaboratively in a fast-paced, dynamic environment. Great time management and multitasking skills with minimal supervision.
Publications in the relevant conference and journals is a plus.
Ability to implement AI / ML algorithms from academic research papers is a plus.
Who We Are :
TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches / stores.
Every day, we deliver legendary customer experiences to over 27 million households and businesses in Canada, the United States and around the world.
More than 95,000 TD colleagues bring their skills, talent, and creativity to the Bank, those we serve, and the economies we support.
We are guided by our vision to Be the Better Bank and our purpose to enrich the lives of our customers, communities and colleagues.
TD is deeply committed to being a leader in customer experience, that is why we believe that all colleagues, no matter where they work, are customer facing.
As we build our business and deliver on our strategy, we are innovating to enhance the customer experience and build capabilities to shape the future of banking.
Whether you’ve got years of banking experience or are just starting your career in financial services, we can help you realize your potential.
Through regular leadership and development conversations to mentorship and training programs, we’re here to support you towards your goals.
As an organization, we keep growing and so will you.
Our Total Rewards Package
Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals.
Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs.
Additional Information :
We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.
Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations, requirements.
Colleague Development
If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities.
Whether you have a passion for helping customers and want to expand your experience, or you want to coach and inspire your colleagues, there are many different career paths within our organization at TD and we’re committed to helping you identify opportunities that support your goals.
Training & Onboarding
We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.
Interview Process
We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.
Accommodation
Your accessibility is important to us. Please let us know if you’d like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.
to help us remove barriers so that you can participate throughout the interview process.
We look forward to hearing from you!
Language Requirement (Quebec only) :
Maîtrise d’une langue autre que le français pour offrir du soutien ou traiter avec des employés ou des collègues qui ont besoin de services et de soutien dans une langue autre que le français.
Senior Applied Machine Learning Scientist
Lead a team of Machine Learning Scientists to perform validation of complex AI/ML models, particularly Generative AI, LLMs / NLP and Deep Learning models. Generative AI, LLMs, NLP and other Deep Learning models; and 2+ years of experience in leading a small team of machine learning scientists. Maint...
Senior Research Scientist (Foundational Research, Machine Learning)
Are you a curious and open-minded individual with an interest in state-of-the-art foundational machine learning research? Thomson Reuters Labs is seeking a Senior Research Scientist with a passion for solving challenging machine learning problems in a data-rich, complex academic environment. As a Se...
Senior Machine Learning Engineer (Remote)
We are looking for a Senior Machine Learning Engineer to join our Knowledge Enrichment team at BenchSci. Experience with graph machine learning ( graph neural networks, graph data science) and practical applications thereof. You have experience working in cross-functional teams with product managers...
Senior / Staff Machine Learning Engineer, Computer Vision
Our Machine Learning Engineers will define how machine learning is applied to the vast amounts of data collected from our labor marketplaceto generate business value for Shiftsmart. Machine learning expert: 5+ years of machine learning and software engineering experience, including the end-to-end, g...
Senior Applied Scientist
Senior Applied Scientists are experts in Machine Learning / NLP, responsible for the design and delivery of AI solutions that enhance Thomson Reuters' products. Are you excited about working at the forefront of applied research in an industry setting? Thomson Reuters Labs in. We support the organiza...
Senior Machine Learning Platform Engineer
Faire is searching for a top-notch senior engineer to lead design and execution as we continue to build our machine learning platform that will power our wholesale marketplace. From the mobile checkout process, to personalized search ranking, to the intelligent underwriting engine that determines cr...
Senior Machine Learning Engineer
As a Senior Machine Learning Engineer at Wave, you will help shape the future of our AI capabilities by combining traditional machine learning with cutting-edge Generative AI technologies. Understanding of modern deep learning architectures, including transformers and Mamba. You will also be support...
Senior Distributed Systems Engineer (Machine Learning)
As Senior Distributed Systems Engineer (Machine Learning), you will play an instrumental role in advancing the services and systems comprising our Machine Learning Platform. This is an opportunity to work end-to-end on a large-scale machine-learning system that touches millions of customers, and a c...
Senior Machine Learning Software Engineer, Search
You will work within the Machine Learning Team to design, code, train, test, deploy and iterate on large scale machine learning systems. At Dropbox, our pursuit of excellence in Machine Learning and Artificial Intelligence fuels our mission to empower users worldwide. As a Senior Machine Leaning Eng...
Senior Machine Learning & Optimization Engineer
Senior Machine Learning & Optimization Engineer. Index-wide technology strategy for machine learning and optimization, and to drive pragmatic execution and iterative improvement of the same. Productionalize and support scalable and efficient Machine Learning models and solutions. Mentor teams and pr...