Competition
TDC 2023 (LLM Edition): The Trojan Detection Challenge
Mantas Mazeika · Andy Zou · Norman Mu · Long Phan · Zifan Wang · Chunru Yu · Adam Khoja · Fengqing Jiang · Aidan O'Gara · Zhen Xiang · Arezoo Rajabi · Dan Hendrycks · Radha Poovendran · Bo Li · David Forsyth
Room 357
The Trojan Detection Challenge (LLM Edition) aims to advance the understanding and development of methods for detecting hidden functionality in large language models (LLMs). The competition features two main tracks: the Trojan Detection Track and the Red Teaming Track. In the Trojan Detection Track, participants are given a large language model containing thousands of trojans and tasked with discovering the triggers for these trojans. In the Red Teaming Track, participants are challenged to elicit specific undesirable behaviors from a large language model fine-tuned to avoid those behaviors. TDC 2023 will include Base Model and Large Model subtracks to enable broader participation, and established trojan detection and red teaming baselines will be provided as a starting point. By uniting trojan detection and red teaming, TDC 2023 aims to foster collaboration between these communities to promote research on hidden functionality in LLMs and enhance the robustness and security of AI systems.
Schedule
Sat 11:30 a.m. - 12:00 p.m.
|
Introduction, competition summary, and what we learned
(
Intro / Talk
)
>
SlidesLive Video |
🔗 |
Sat 12:00 p.m. - 12:30 p.m.
|
Invited talk 1
(
Talk
)
>
SlidesLive Video |
🔗 |
Sat 12:30 p.m. - 12:40 p.m.
|
Break
|
🔗 |
Sat 12:40 p.m. - 12:45 p.m.
|
Announcing winners
(
Announcement
)
>
SlidesLive Video |
🔗 |
Sat 12:45 p.m. - 1:45 p.m.
|
Description of winning methods
(
Multiple Talks
)
>
SlidesLive Video |
🔗 |
Sat 1:45 p.m. - 1:55 p.m.
|
Break
|
🔗 |
Sat 1:55 p.m. - 2:25 p.m.
|
Invited talk 2
(
Talk
)
>
SlidesLive Video |
🔗 |
Sat 2:25 p.m. - 2:30 p.m.
|
Wrapping up
(
Outro
)
>
|
🔗 |