Jailbreaking and Protecting LLM Apps: A Public Wargame Experiment

🕓 12:10 pm - 12:30 pm📍 Room 5 - Black Swan (Lv 2)

This presentation captures findings from a public AI security challenge designed to evaluate the resilience of Large Language Models (LLMs) against prompt injection attacks. The experiment involved an Attack & Defence wargame where participants were tasked with securing their LLMs, specifically preventing secret phrase disclosure. They were given access to the source code of the app that interfaced with OpenAI API. Simultaneously, participants were to attack other LLMs in an attempt to exfiltrate the secret phrase. A notable aspect of this experiment was the real-time evolution of defensive strategies and offensive tactics by participants. The results indicated that all LLMs were exploited at least once, thus highlighting the complexity behind LLM security and lack of in-depth understanding of prompt injection. This underscores how there is no silver bullet for securing against prompt injection and that it remains as an open problem.

Pedram Hayati

Muhammad Hamza Ali

2024 Sponsors

Platinum

We are excited to partner with DDD as a platinum sponsor at this year’s DDD Perth Conference. As one of Perth’s largest Tech employers in WA with a focused investment in technology and digital services, Bankwest is proud to be a part of Perth’s largest community-run conference which is open to everyone to attend. We look forward to seeing you there and make sure to come and chat to the Bankwest team about career opportunities and hear more about how we are becoming Australia’s favourite digital bank.

Visit Bankwest → (opens in a new tab)

MakerX is thrilled to be a platinum sponsor for the 10-year anniversary of DDD Perth. DDD Perth holds a special place in our hearts as a conference originally founded by two of MakerX's co-founders Matt Davies and Rob Moore, which has since grown beyond our wildest imagination through the hard work of a fantastic diverse team of volunteers. We're thrilled to support and celebrate the enormous progress DDD Perth has made towards inclusively connecting the Perth tech community, supporting all those who can't normally attend or speak at a large tech conference, and look forward to helping attendees learn more about what it takes to build and launch startups of your own!

Visit MakerX → (opens in a new tab)

Gold

Insight is delighted to return as a gold sponsor of DDD Perth and celebrate its 10-year anniversary. DDD Perth is a fantastic event that showcases the diversity and talent of the Perth tech community, and we look forward to the opportunities for learning, sharing and networking

Visit Insight → (opens in a new tab)

Mantel Group are so proud to once again be sponsoring DDD Perth! Investing in community is central to our mission of changing how the world works for the better, and DDD Perth is an exceptionally awesome event that fosters inclusivity and innovation. Celebrating its 10th anniversary, DDD Perth creates valuable opportunities for underrepresented groups, early career talent, and first-time speakers. We’re excited to have the opportunity to continue our contribution to the growth of the Perth software community.

Visit Mantel Group → (opens in a new tab)

Our staff have always enjoyed attending, speaking or volunteering at DDD Perth, so we're thrilled to return as a gold sponsor for DDD's 10th anniversary. Ten years is a long time in tech - and it's amazing to see how DDD Perth has grown and evolved into the inclusive and highly-engaging conference that it is today.

Visit Qoria → (opens in a new tab)

We are excited to announce that Versent & Telstra Purple will be a Gold Sponsor for this year's DDD Perth conference, celebrating our 10th anniversary! This is a community that's passionate about innovation, and getting together to share ideas in an open forum. And that's exactly the sort of culture we like to encourage. We are excited to be back again this year

Visit Telstra | Versent → (opens in a new tab)

Visit Tricentis → (opens in a new tab)

At VGW, we are passionate about building a vibrant and inclusive tech community. DDD Perth aligns with our commitment to fostering innovation, and engaging with tech professionals and enthusiasts in our community. - Yvette Mandanas, Chief People Officer @ VGW

Visit Virtual Gaming Worlds → (opens in a new tab)

We’re thrilled to announce Woodside's partnership with DDD Perth 2024 as they celebrate their 10th anniversary and Woodside marks 70 years since its establishment. This collaboration demonstrates our dedication to fostering innovation and collaboration within Australia's tech landscape. We are proud to support the local tech community through DDD Perth and engage with diverse minds who are shaping the future of energy and technology.

Visit Woodside Energy → (opens in a new tab)

The SKA Observatory (SKAO) is excited to be supporting the Perth-based software and tech community by being a Gold Sponsor of the upcoming 10th anniversary of hashtag#DDDPerth. We are building one of the largest scientific instruments of the 21st Century, a radio telescope that will revolutionise our understanding of the Universe and the laws of fundamental physics, right here in Western Australia. Computing, software and big data will be critical in the success of this mega science project, and we’re recruiting highly motivated developers across the computing and software domains to take part.

Visit SKAO → (opens in a new tab)