At EY, we're all in to shape your future with confidence.
We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.
EY is the only professional services firm with a separate business unit ("FSO") that is dedicated to the financial services marketplace. Our FSO teams have been at the forefront of every event that has reshaped and redefined the financial services industry. This practice also has several Service Delivery Centers that are made up of high-performing US-based resources who work closely with our experienced client-serving professionals to deliver project-based work and managed services to our US-based Financial Services clients. If you have a passion for rallying together to solve the most complex challenges in the financial services industry, come join our dynamic FSO team!
The Opportunity
Data has yet to be utilized to its fullest potential. Financial institutions are looking to build smarter and more efficient ways to operate their business, through new opportunities uncovered by their data. You'll be solving complex problems, as well as giving deliverables to our clients in the AI and data space. With support from a highly talented team, you'll have tremendous growth opportunities, with a focus on continuous learning and skills development to become a leader that can make significant contributions to companies.
Key Responsibilities:
This role leads the design, development, and testing of advanced AI agents and multi-agent systems, ensuring scalability, security, and observability in production-grade LLM and RAG solutions. It requires expertise in agentic frameworks, prompt engineering, evaluation pipelines, and safety testing, with hands-on experience in Google-ADK, LangChain/LangGraph, and vector databases. Candidates must have a bachelor's or master's degree, 10+ years of software engineering experience, and strong leadership skills in delivering AI/ML projects.
Skills & Attributes for Success:
* Exceptional command in the architecture, development, and testing of AI agents.
* Build multi-agent systems with proper state and memory management, evaluation, and concurrent orchestration.
* Design systems that allow for human oversight and feedback to improve agent performance.
* Develop explainable AI frameworks to ensure model decisions are transparent and auditable.
* Architect scalable, secure, and observable production-grade LLM systems.
* Set up observability (tracing, logging, evaluation, service level indicators) for AI agents and establish mandatory evaluation gates in CI/CD pipelines.
* Integrate LLMs into systems, apply advanced prompt engineering, and fine-tune pre-trained models.
* Design, build, and implement Retrieval-Augmented Generation (RAG) systems, including vector databases, embeddings, and knowledge graphs.
* Design test suites for non-deterministic AI systems, including golden datasets and human-in-the-loop review processes.
* Define and automate agent behavior metrics (task completion rate, tool-use success rate, execution trajectory efficiency, error recovery).
* Implement evaluation pipelines to assess output quality against pre-defined rubrics.
* Instrument and analyze agent internal thought processes for debugging and improvement.
* Test agentic solutions for adversarial and safety scenarios, including prompt injection and jailbreaking.
* Test RAG components for contextual precision, faithfulness, and quality of retrieved documents.
Qualifications:
* Bachelor's or master's degree in computer science, Engineering, Mathematics, or a related field.
* 10+ years of experience in software engineering, with at least 5 years focused on AI/ML solution development.
* Proven track record of delivering AI/ML projects in production environments.
* Strong leadership and mentoring skills.
Technical Skills:
* Agentic AI Architecture: Multi-agent systems, state/memory management, explainable AI, human-in-the-loop design.
* Agentic Frameworks: Hands-on experience with Google-ADK and LangChain/LangGraph.
* MLOps/AIOps: Scalable, secure, and observable LLM systems; observability setup; CI/CD evaluation gates.
* LLMs: Integration, prompt engineering (zero-shot, few-shot, chain-of-thought, Tree-of-thought, system prompts), fine-tuning.
* RAG Systems: Vector databases (Pinecone, Weaviate, PGVector), embeddings, knowledge graphs.
* Test Strategy: Test suite design for non-deterministic AI, golden datasets, human-in-the-loop review.
* Agent Metrics: Task completion, tool-use success, trajectory efficiency, error recovery.
* Evaluation: Evaluation pipelines, output quality rubrics.
* Log Analysis: Instrumentation and analysis of agent reasoning, memory, and tool use.
* Testing Frameworks: Proficiency in Python (pytest), LLM evaluation libraries (Ragas, DeepEval).
* Safety Testing: Adversarial and safety testing, prompt injection, jailbreaking.
* RAG Testing: Contextual precision, faithfulness, and document quality metrics.
What we look for
We're interested in professionals that are passionate about technology, who already have an understanding of data and are comfortable analyzing or manipulating it while generating reports for clients. You'll also need to be able to clearly articulate both problems and proposed solutions, and have the willingness to learn and quickly adapt to changing requirements. On top of this, we're looking for team players and hard workers who are not afraid to take initiative to master their craft and produce high-quality work. If you have a proactive approach and want to be part of a group that continues to grow significantly, this role is for you.
What working at EY offers
We offer a competitive compensation package where you'll be rewarded based on your performance and recognized for the value you bring to our business. In addition, our Total Rewards package includes medical and dental coverage, both pension and 401(k) plans, a minimum of 15 days of vacation plus ten observed holidays and three paid personal days, and a range of programs and benefits designed to support your physical, financial, and social well-being. Plus, we offer:
* Opportunities to develop new skills and progress your career
* Support and coaching from some of the most engaging and knowledgeable colleagues
* A collaborative environment where everyone works together to create a better working world
* Excellent training and development prospects
About EY
As a global leader in assurance, tax, transaction, and advisory services, we hire and develop the most passionate people in their field to help build a better working world. This starts with a culture that believes in giving you the training, opportunities, and creative freedom to make things better. So that whenever you join, however long you stay, the exceptional EY experience lasts a lifetime.
Join us in building a better working world. Apply now.
What we offer you
At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.
* We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $76,200 to $174,100. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $91,400 to $197,900. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.
* Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year.
* Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
Are you ready to shape your future with confidence? Apply today.
EY accepts applications for this position on an on-going basis.
For those living in California, please click here for additional information.
EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.
EY | Building a better working world
EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.
Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.
EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.
EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.
EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY's Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com.
Read Less
