Large Language Models | SRI Lab

Publications

2024

Watermark Stealing in Large Language Models

Nikola Jovanović, Robin Staab, Martin Vechev

ICML 2024 CC BY 4.0 by @fontawesome - https://fontawesome.com

R2-FM@ICLR24 Oral

Website

Paper

Code

Instruction Tuning for Secure Code Generation

Jingxuan He*, Mark Vero*, Gabriela Krasnopolska, Martin Vechev

ICML 2024 * Equal contribution

Paper

Code

Prompt Sketching for Large Language Models

Luca Beurer-Kellner, Mark Niklas Müller, Marc Fischer, Martin Vechev

ICML 2024

Paper

Code

Guiding LLMs The Right Way: Fast, Non-Invasive Constrained Generation

Luca Beurer-Kellner, Marc Fischer, Martin Vechev

ICML 2024

Paper

Code

A Synthetic Dataset for Personal Attribute Inference

Hanna Yukhymenko, Robin Staab, Mark Vero, Martin Vechev

arXiv 2024

Paper

Code

Code Agents are State of the Art Software Testers

Niels Mündler, Mark Niklas Müller, Jingxuan He, Martin Vechev

ICML Workshop on LLMs and Cognition (also at Workshop on Foundation Models in the Wild) 2024

Poster

Paper

ConStat: Performance-Based Contamination Detection in Large Language Models

Jasper Dekoninck, Mark Niklas Müller, Martin Vechev

ArXiv 2024

Website

Paper

Code

Beyond Memorization: Violating Privacy Via Inference with Large Language Models

Robin Staab, Mark Vero, Mislav Balunović, Martin Vechev

ICLR 2024 CC BY 4.0 by @fontawesome - https://fontawesome.com

Spotlight, 2024 PPPM-Award

Website

Paper

Code

Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation

Niels Mündler, Jingxuan He, Slobodan Jenko, Martin Vechev

ICLR 2024

Paper

Code

Black-Box Detection of Language Model Watermarks

Thibaud Gloaguen, Nikola Jovanović, Robin Staab, Martin Vechev

arXiv 2024

Paper

Exploiting LLM Quantization

Kazuki Egashira, Mark Vero, Robin Staab, Jingxuan He, Martin Vechev

arXiv 2024 CC BY 4.0 by @fontawesome - https://fontawesome.com

NextGenAISafety@ICML24 Oral

Paper

Code

Controlled Text Generation via Language Model Arithmetic

Jasper Dekoninck, Marc Fischer, Luca Beurer-Kellner, Martin Vechev

ICLR 2024 CC BY 4.0 by @fontawesome - https://fontawesome.com

Spotlight

Paper

Code

Large Language Models are Advanced Anonymizers

Robin Staab, Mark Vero, Mislav Balunović, Martin Vechev

arXiv 2024

Paper

Evading Data Contamination Detection for Language Models is (too) Easy

Jasper Dekoninck, Mark Niklas Müller, Maximilian Baader, Marc Fischer, Martin Vechev

arXiv 2024

Paper

Code

2023

Large Language Models for Code: Security Hardening and Adversarial Testing

Jingxuan He, Martin Vechev

ACM CCS 2023 CC BY 4.0 by @fontawesome - https://fontawesome.com

Distinguished Paper Award

Slides

Paper

Code

LMQL Chat: Scripted Chatbot Development

Luca Beurer-Kellner*, Marc Fischer*, Martin Vechev

Neural Conversational AI Workshop, TEACH -- ICML 2023 * Equal contribution

Paper

Code

Large Language Models are Zero-Shot Multi-Tool Users

Luca Beurer-Kellner*, Marc Fischer*, Martin Vechev

Knowlege and Logical Reasoning Workshop -- ICML 2023 * Equal contribution

Paper

Code

Prompting Is Programming: A Query Language for Large Language Models

Luca Beurer-Kellner, Marc Fischer, Martin Vechev

PLDI 2023

Paper

Code