This invite-only workshop connects Columbia and Capital One researchers to exchange ideas and plan collaborations in advance of the 2025 CAIRFI Call for Proposals. This is a great way to meet colleagues in the area of responsible AI and finance, and plan future research projects.
This event is being organized in collaboration with the Digital Future Initiative at Columbia Business School.
Event Agenda
8:30 AM | Registration & Breakfast
9:00 AM | Introductory Remarks
Shih-Fu Chang, Dean, Columbia Engineering, & Co-Director, CAIRFI
9:10 AM | Session 1: LLMs and Their Pitfalls
Vishal Misra, Columbia Engineering - “Peering inside LLMs with TokenProbe"
Olivier Toubia, Columbia Business School - "Prompt Architecture Can Induce Methodological Artifacts in Large Language Models"
Stephen Rawls, Capital one
Discussion led by Ali Hirsa, Columbia Engineering
10:15 AM | Session 2: Fairness and Transparency
Eric Balkanski, Columbia Engineering - Fairness in ML-enhanced Hiring
Hannah Li, Columbia Business School - A/B Testing in Markets
Yaw Etse, Capital One
Discussion led by Furong Huang, Capital One
11:20 AM | Session 3: Recommendations and Preferences
Hong Namkoong, Columbia Business School - "LLM-driven recommendations via active data collection"
Wenpin Tang, Columbia Engineering - "RainbowPO -- in search of critical components improving preference optimization"
Nam Nguyen, Capital One
Discussion led by Ciamac Moallemi, Columbia Business School
12:10 PM | Discussion & Next Steps
12:30 PM | Workshop Adjourns