Skip to content

[DRAFT] FEAT Add Turkish Conversation Prompt-Injection dataset loader #2173

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
3nesdeniz wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

[DRAFT] FEAT Add Turkish Conversation Prompt-Injection dataset loader #2173

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion doc/bibliography.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,6 @@ All academic papers, research blogs, and technical reports referenced throughout
:::{dropdown} Citation Keys
:class: hidden-citations

[@aakanksha2024multilingual; @adversaai2023universal; @andriushchenko2024tense; @anthropic2024manyshot; @aqrawi2024singleturncrescendo; @atr2026; @bethany2024mathprompt; @bhardwaj2023harmfulqa; @bhardwaj2024homer; @brahman2024coconot; @bryan2025agentictaxonomy; @bullwinkel2025airtlessons; @bullwinkel2025repeng; @bullwinkel2026trigger; @chao2023pair; @chao2024jailbreakbench; @cui2024orbench; @darkbench2025; @derczynski2024garak; @ding2023wolf; @embracethered2024unicode; @embracethered2025sneakybits; @gehman2020realtoxicityprompts; @ghosh2025aegis; @ghosh2025ailuminate; @gong2025figstep; @gupta2024walledeval; @haider2024phi3safety; @han2024medsafetybench; @hines2024spotlighting; @inie2025summon; @ji2023beavertails; @ji2024pkusaferlhf; @jiang2025sosbench; @jones2025computeruse; @kingma2014adam; @li2024mossbench; @li2024saladbench; @li2024wmdp; @lin2023toxicchat; @liu2024flipattack; @liu2024mmsafetybench; @lopez2024pyrit; @luo2024jailbreakv; @lv2024codechameleon; @mazeika2023tdc; @mazeika2024harmbench; @mckee2024transparency; @mehrotra2023tap; @microsoft2024skeletonkey; @odin2024; @palaskar2025vlsu; @pfohl2024equitymedqa; @promptfoo2025ccp; @robustintelligence2024bypass; @roccia2024promptintel; @rottger2023xstest; @rottger2025msts; @russinovich2024crescendo; @russinovich2025price; @scheuerman2025transphobia; @shaikh2022second; @shayegani2025computeruse; @shen2023donotanything; @sheshadri2024lat; @souly2024strongreject; @stok2023ansi; @tan2026comicjailbreak; @tang2025multilingual; @tedeschi2024alert; @vantaylor2024socialbias; @vidgen2023simplesafetytests; @wang2023decodingtrust; @wang2023donotanswer; @wang2025siuo; @wei2023jailbroken; @xie2024sorrybench; @yu2023gptfuzzer; @yuan2023cipherchat; @zeng2024persuasion; @zhang2024cbtbench; @ziems2022mic; @zou2023gcg]
[@aakanksha2024multilingual; @adversaai2023universal; @andriushchenko2024tense; @anthropic2024manyshot; @aqrawi2024singleturncrescendo; @atr2026; @bethany2024mathprompt; @bhardwaj2023harmfulqa; @bhardwaj2024homer; @brahman2024coconot; @bryan2025agentictaxonomy; @bullwinkel2025airtlessons; @bullwinkel2025repeng; @bullwinkel2026trigger; @chao2023pair; @chao2024jailbreakbench; @cui2024orbench; @darkbench2025; @deniz2026turkishpromptinjection; @derczynski2024garak; @ding2023wolf; @embracethered2024unicode; @embracethered2025sneakybits; @gehman2020realtoxicityprompts; @ghosh2025aegis; @ghosh2025ailuminate; @gong2025figstep; @gupta2024walledeval; @haider2024phi3safety; @han2024medsafetybench; @hines2024spotlighting; @inie2025summon; @ji2023beavertails; @ji2024pkusaferlhf; @jiang2025sosbench; @jones2025computeruse; @kingma2014adam; @li2024mossbench; @li2024saladbench; @li2024wmdp; @lin2023toxicchat; @liu2024flipattack; @liu2024mmsafetybench; @lopez2024pyrit; @luo2024jailbreakv; @lv2024codechameleon; @mazeika2023tdc; @mazeika2024harmbench; @mckee2024transparency; @mehrotra2023tap; @microsoft2024skeletonkey; @odin2024; @palaskar2025vlsu; @pfohl2024equitymedqa; @promptfoo2025ccp; @robustintelligence2024bypass; @roccia2024promptintel; @rottger2023xstest; @rottger2025msts; @russinovich2024crescendo; @russinovich2025price; @scheuerman2025transphobia; @shaikh2022second; @shayegani2025computeruse; @shen2023donotanything; @sheshadri2024lat; @souly2024strongreject; @stok2023ansi; @tan2026comicjailbreak; @tang2025multilingual; @tedeschi2024alert; @vantaylor2024socialbias; @vidgen2023simplesafetytests; @wang2023decodingtrust; @wang2023donotanswer; @wang2025siuo; @wei2023jailbroken; @xie2024sorrybench; @yu2023gptfuzzer; @yuan2023cipherchat; @zeng2024persuasion; @zhang2024cbtbench; @ziems2022mic; @zou2023gcg]

:::
47 changes: 42 additions & 5 deletions doc/code/datasets/1_loading_datasets.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
"StrongREJECT [@souly2024strongreject],\n",
"TDC23 [@mazeika2023tdc],\n",
"ToxicChat [@lin2023toxicchat],\n",
"Turkish Conversation Prompt-Injection [@deniz2026turkishpromptinjection],\n",
"VLSU [@palaskar2025vlsu],\n",
"VLGuard [@zong2024vlguard],\n",
"XSTest [@rottger2023xstest],\n",
Expand All @@ -66,10 +67,46 @@
"(`garak_audio_achilles_heel`)."
]
},
{
"cell_type": "markdown",
"id": "1",
"metadata": {},
"source": [
"## Loading Turkish Prompt-Injection and Boundary Examples\n",
"\n",
"The `turkish_conversation_prompt_injection` loader defaults to attack examples\n",
"and preserves each record's attack family, source context, split, and pair ID.\n",
"Typed filters can also load legitimate Turkish requests, a specific published\n",
"split, or selected attack families. For example:\n",
"\n",
"```python\n",
"from pyrit.datasets.seed_datasets.remote import (\n",
" TurkishConversationPromptInjectionAttackFamily,\n",
" TurkishConversationPromptInjectionLabel,\n",
" TurkishConversationPromptInjectionSplit,\n",
" _TurkishConversationPromptInjectionDataset,\n",
")\n",
"\n",
"test_surface_loader = _TurkishConversationPromptInjectionDataset(\n",
" label=TurkishConversationPromptInjectionLabel.ALL,\n",
" split=TurkishConversationPromptInjectionSplit.TEST,\n",
")\n",
"test_surface = await test_surface_loader.fetch_dataset_async()\n",
"\n",
"obfuscation_loader = _TurkishConversationPromptInjectionDataset(\n",
" split=TurkishConversationPromptInjectionSplit.TEST,\n",
" attack_families=[\n",
" TurkishConversationPromptInjectionAttackFamily.OBFUSCATION_CODE_SWITCHING,\n",
" ],\n",
")\n",
"obfuscation_attacks = await obfuscation_loader.fetch_dataset_async()\n",
"```"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "1",
"id": "2",
"metadata": {},
"outputs": [
{
Expand Down Expand Up @@ -190,7 +227,7 @@
},
{
"cell_type": "markdown",
"id": "2",
"id": "3",
"metadata": {},
"source": [
"## Loading Specific Datasets\n",
Expand All @@ -201,7 +238,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "3",
"id": "4",
"metadata": {},
"outputs": [
{
Expand Down Expand Up @@ -238,7 +275,7 @@
},
{
"cell_type": "markdown",
"id": "4",
"id": "5",
"metadata": {},
"source": [
"## Adding Datasets to Memory\n",
Expand All @@ -255,7 +292,7 @@
{
"cell_type": "code",
"execution_count": null,
"id": "5",
"id": "6",
"metadata": {},
"outputs": [
{
Expand Down
32 changes: 32 additions & 0 deletions doc/code/datasets/1_loading_datasets.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,7 @@
# StrongREJECT [@souly2024strongreject],
# TDC23 [@mazeika2023tdc],
# ToxicChat [@lin2023toxicchat],
# Turkish Conversation Prompt-Injection [@deniz2026turkishpromptinjection],
# VLSU [@palaskar2025vlsu],
# VLGuard [@zong2024vlguard],
# XSTest [@rottger2023xstest],
Expand All @@ -69,6 +70,37 @@
# `garak_tm_system_prompts`), and an audio jailbreak set
# (`garak_audio_achilles_heel`).

# %% [markdown]
# ## Loading Turkish Prompt-Injection and Boundary Examples
#
# The `turkish_conversation_prompt_injection` loader defaults to attack examples
# and preserves each record's attack family, source context, split, and pair ID.
# Typed filters can also load legitimate Turkish requests, a specific published
# split, or selected attack families. For example:
#
# ```python
# from pyrit.datasets.seed_datasets.remote import (
# TurkishConversationPromptInjectionAttackFamily,
# TurkishConversationPromptInjectionLabel,
# TurkishConversationPromptInjectionSplit,
# _TurkishConversationPromptInjectionDataset,
# )
#
# test_surface_loader = _TurkishConversationPromptInjectionDataset(
# label=TurkishConversationPromptInjectionLabel.ALL,
# split=TurkishConversationPromptInjectionSplit.TEST,
# )
# test_surface = await test_surface_loader.fetch_dataset_async()
#
# obfuscation_loader = _TurkishConversationPromptInjectionDataset(
# split=TurkishConversationPromptInjectionSplit.TEST,
# attack_families=[
# TurkishConversationPromptInjectionAttackFamily.OBFUSCATION_CODE_SWITCHING,
# ],
# )
# obfuscation_attacks = await obfuscation_loader.fetch_dataset_async()
# ```

# %%
from pyrit.datasets import SeedDatasetProvider
from pyrit.memory import CentralMemory
Expand Down
8 changes: 8 additions & 0 deletions doc/references.bib
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,14 @@ @article{tedeschi2024alert
url = {https://arxiv.org/abs/2404.08676},
}

@misc{deniz2026turkishpromptinjection,
title = {Turkish Conversation Prompt-Injection Dataset},
author = {Enes Deniz},
year = {2026},
url = {https://huggingface.co/datasets/3nesdeniz/turkish-conversation-prompt-injection},
note = {CC BY 4.0 dataset. Source repository: https://github.com/3nesdeniz/turkish-conversation-prompt-injection},
}

@article{derczynski2024garak,
title = {garak: A Framework for Security Probing Large Language Models},
author = {Leon Derczynski and Erick Galinkin and Jeffrey Martin and Subho Majumdar and Nanna Inie},
Expand Down
10 changes: 10 additions & 0 deletions pyrit/datasets/seed_datasets/remote/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,12 @@
from pyrit.datasets.seed_datasets.remote.tdc23_redteaming_dataset import _TDC23RedteamingDataset
from pyrit.datasets.seed_datasets.remote.toxic_chat_dataset import _ToxicChatDataset
from pyrit.datasets.seed_datasets.remote.transphobia_awareness_dataset import _TransphobiaAwarenessDataset
from pyrit.datasets.seed_datasets.remote.turkish_conversation_prompt_injection_dataset import (
TurkishConversationPromptInjectionAttackFamily,
TurkishConversationPromptInjectionLabel,
TurkishConversationPromptInjectionSplit,
_TurkishConversationPromptInjectionDataset,
)
from pyrit.datasets.seed_datasets.remote.visual_leak_bench_dataset import (
VisualLeakBenchCategory,
VisualLeakBenchPIIType,
Expand Down Expand Up @@ -140,6 +146,9 @@
"PromptIntelSeverity",
"SGXSTestLabel",
"SIUOCategory",
"TurkishConversationPromptInjectionAttackFamily",
"TurkishConversationPromptInjectionLabel",
"TurkishConversationPromptInjectionSplit",
"VLGuardCategory",
"VLGuardSubcategory",
"VLGuardSubset",
Expand Down Expand Up @@ -209,6 +218,7 @@
"_TDC23RedteamingDataset",
"_ToxicChatDataset",
"_TransphobiaAwarenessDataset",
"_TurkishConversationPromptInjectionDataset",
"_VLGuardDataset",
"_VLSUMultimodalDataset",
"_VisualLeakBenchDataset",
Expand Down
Loading