This presentation captures findings from a public AI security challenge designed to evaluate the resilience of Large Language Models (LLMs) against prompt injection attacks. The experiment involved an Attack & Defence wargame where participants were tasked with securing their LLMs, specifically preventing secret phrase disclosure. They were given access to the source code of the app that interfaced with OpenAI API. Simultaneously, participants were to attack other LLMs in an attempt to exfiltrate the secret phrase. A notable aspect of this experiment was the real-time evolution of defensive strategies and offensive tactics by participants. The results indicated that all LLMs were exploited at least once, thus highlighting the complexity behind LLM security and lack of in-depth understanding of prompt injection. This underscores how there is no silver bullet for securing against prompt injection and that it remains as an open problem.
Speakers
Pedram Hayati
Founder SecDim.com, SecTalks.org
Dr. Pedram Hayati is the Founder and CEO of SecDim, where he focuses on redefining developer engagement in security through developer-oriented wargames. As a security researcher who transitioned from the offensive to the defensive side of security, he has reported thousands of vulnerabilities to Fortune 500 companies, published over 25 zero-days, and has led a global penetration testing team. Pedram lectures at the University of New South Wales, Australian Defence Force Academy. He is the founder of SecTalks.org, the largest non-profit security community in Australia. He has presented at top security conferences and hosted AppSec contests at DEF CON, BlackHat, HITB and FirstCon.
Muhammad Hamza Ali is the Project Lead at SecDim, where he plays a central role in the development of the company's core platforms such as SecDim Play. He has also assisted with the development of their Attack & Defence WarGames, especially AI WarGames. While his primary focus is on the evolution and application of AI alongside the development of SecDim platforms, he maintains a keen interest in AppSec and the security aspects of AI. Currently, he is pursuing a Master's by Research in Generative AI at Curtin University.
We are excited to partner with DDD as a platinum sponsor at this year’s DDD Perth Conference. As one of Perth’s largest Tech employers in WA with a focused investment in technology and digital services, Bankwest is proud to be a part of Perth’s largest community-run conference which is open to everyone to attend. We look forward to seeing you there and make sure to come and chat to the Bankwest team about career opportunities and hear more about how we are becoming Australia’s favourite digital bank.
MakerX is thrilled to be a platinum sponsor for the 10-year anniversary of DDD Perth. DDD Perth holds a special place in our hearts as a conference originally founded by two of MakerX's co-founders Matt Davies and Rob Moore, which has since grown beyond our wildest imagination through the hard work of a fantastic diverse team of volunteers. We're thrilled to support and celebrate the enormous progress DDD Perth has made towards inclusively connecting the Perth tech community, supporting all those who can't normally attend or speak at a large tech conference, and look forward to helping attendees learn more about what it takes to build and launch startups of your own!
Insight is delighted to return as a gold sponsor of DDD Perth and celebrate its 10-year anniversary. DDD Perth is a fantastic event that showcases the diversity and talent of the Perth tech community, and we look forward to the opportunities for learning, sharing and networking
Mantel Group are so proud to once again be sponsoring DDD Perth! Investing in community is central to our mission of changing how the world works for the better, and DDD Perth is an exceptionally awesome event that fosters inclusivity and innovation. Celebrating its 10th anniversary, DDD Perth creates valuable opportunities for underrepresented groups, early career talent, and first-time speakers. We’re excited to have the opportunity to continue our contribution to the growth of the Perth software community.
Our staff have always enjoyed attending, speaking or volunteering at DDD Perth, so we're thrilled to return as a gold sponsor for DDD's 10th anniversary. Ten years is a long time in tech - and it's amazing to see how DDD Perth has grown and evolved into the inclusive and highly-engaging conference that it is today.
We are excited to announce that Versent & Telstra Purple will be a Gold Sponsor for this year's DDD Perth conference, celebrating our 10th anniversary! This is a community that's passionate about innovation, and getting together to share ideas in an open forum. And that's exactly the sort of culture we like to encourage. We are excited to be back again this year
At VGW, we are passionate about building a vibrant and inclusive tech community. DDD Perth aligns with our commitment to fostering innovation, and engaging with tech professionals and enthusiasts in our community.
- Yvette Mandanas, Chief People Officer @ VGW
We’re thrilled to announce Woodside's partnership with DDD Perth 2024 as they celebrate their 10th anniversary and Woodside marks 70 years since its establishment. This collaboration demonstrates our dedication to fostering innovation and collaboration within Australia's tech landscape. We are proud to support the local tech community through DDD Perth and engage with diverse minds who are shaping the future of energy and technology.
The SKA Observatory (SKAO) is excited to be supporting the Perth-based software and tech community by being a Gold Sponsor of the upcoming 10th anniversary of hashtag#DDDPerth.
We are building one of the largest scientific instruments of the 21st Century, a radio telescope that will revolutionise our understanding of the Universe and the laws of fundamental physics, right here in Western Australia.
Computing, software and big data will be critical in the success of this mega science project, and we’re recruiting highly motivated developers across the computing and software domains to take part.
It's such a privilege to be able to run this conference and DDD Perth would love to acknowledge the
traditional custodians of the land in which DDD is created, presented, and shared, the
Whadjuk people of the Noongar Nation and their connections to land, sea and community.
We pay our respect to their Elders past, present and emerging, and extend that respect
to all Aboriginal and Torres Strait Islander peoples today.
