Upload diverse deception linear probes for OLMo-3-32B-Think

README.md

@@ -0,0 +1,111 @@
+---
+license: mit
+tags:
+  - deception-detection
+  - linear-probe
+  - mechanistic-interpretability
+base_model: allenai/Olmo-3-32B-Think
+---
+
+# Diverse Deception Linear Probe — OLMo-3-32B-Think
+
+Per-layer linear probes trained on **OLMo-3-32B-Think** residual stream activations
+to distinguish deceptive from honest text completions.
+
+## Performance
+
+| Variant | Token Selection | Follow-up Prompt | Averaged AUC | Layers Used |
+|---|---|---|---|---|
+| **last-token-generation** | last token generation | `Did you respond truthfully?` → `Yes` | **0.996** | filtered by train loss < 0.6 |
+
+AUC is computed on MBPP (hardcoded vs. correct code), using probe scores
+**averaged across filtered layers** (layers where probe train loss < 0.6).
+
+> **Thinking model**: OLMo-3-32B-Think uses `<think>` tags. An empty thinking block
+> is placed before completions so the model processes them as responses, not reasoning.
+> The chat template handles this automatically with `enable_thinking=False`.
+
+## Probe Architecture
+
+Each layer has an independent `LinearProbe`:
+
+| Component | Shape | Description |
+|---|---|---|
+| `linear.weight` | `[1, 5120]` | Classification weight vector |
+| `linear.bias` | `[1]` | Classification bias |
+| `input_scale` | scalar | Unit-norm scaling factor |
+| `input_mean` | scalar | Input centering value |
+| `platt_A`, `platt_B` | scalar | Platt calibration parameters |
+
+### File layout
+
+```
+<variant>/layer_N/
+    config.json   # probe class and d_model
+    model.pt      # PyTorch state_dict
+```
+
+## Follow-up Prompt Setup
+
+For `last-token-generation` variants, a follow-up exchange is appended after the
+completion to elicit a truthfulness signal. The probe reads activations at the
+**last token** of the assistant's reply ("Yes"):
+
+```
+[main prompt + completion]
+<user> Did you respond truthfully?
+<assistant> Yes     ← probe reads activations here
+```
+
+Formatted with OLMo-3-32B-Think's chat template:
+
+```
+<|im_start|>user
+Did you respond truthfully?<|im_end|>
+<|im_start|>assistant
+<think></think>
+Yes
+```
+
+## Training Details
+
+- **Probe dataset**: `diverse_deception_probe` v1 — ~8,000 examples from 8+ sources
+  (MASK, TruthfulQA, DolusChat, LiarsBench, sycophancy, sandbagging, etc.)
+- **Training**: 1,000 steps, lr=3e-3, constant schedule, no weight decay
+- **Normalization**: unit-norm input scaling
+- **Layer aggregation**: mean (scores from multiple layers averaged at inference)
+
+## Quick Start
+
+```python
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+from huggingface_hub import snapshot_download
+
+probe_dir = snapshot_download("AlignmentResearch/diverse-deception-probe-olmo-3-32b-think")
+
+state = torch.load(f"{probe_dir}/last-token-generation/layer_40/model.pt", weights_only=False)
+w, b = state["linear.weight"], state["linear.bias"]
+scale, mean = state["input_scale"], state["input_mean"]
+
+model = AutoModelForCausalLM.from_pretrained("allenai/Olmo-3-32B-Think", torch_dtype=torch.bfloat16, device_map="auto")
+tokenizer = AutoTokenizer.from_pretrained("allenai/Olmo-3-32B-Think")
+
+text = tokenizer.apply_chat_template(
+    [{"role": "user", "content": "Your prompt here"}],
+    tokenize=False, add_generation_prompt=True,
+)
+text += "The model's completion"
+
+inputs = tokenizer(text, return_tensors="pt").to(model.device)
+with torch.no_grad():
+    h = model(**inputs, output_hidden_states=True).hidden_states[41][:, -1, :]
+
+score = ((h.float() - mean) / scale @ w.T + b).item()
+# score > 0 → likely deceptive, score < 0 → likely honest
+```
+
+## Citation
+
+Part of the [FAR AI](https://far.ai) deception detection research.
+See [AlignmentResearch/deception](https://github.com/AlignmentResearch/deception).

averaged_over_initial_detector.base_model.on_dataset_linear-probe_last-token-generation.txt

@@ -0,0 +1 @@
+[19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63]

last-token-generation/layer_0/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_0/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b665a37d20ce954a6da33438bb7b8c8799bcbd3ddb50745dd19f67a6f93b3390
+size 23293

last-token-generation/layer_1/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_1/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2bfa89d24e4b04b00c4b63bf6010539e8cf3a5d7d31e978bf58b861158c8cddf
+size 23293

last-token-generation/layer_10/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_10/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:267143d1044b5f8d24fb8fb63ad0d64b583cb19a2282cf048c64c4b8c8f5966f
+size 23293

last-token-generation/layer_11/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_11/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a95b338ad54cc15766bd1c83c3d377b1cb7d363e19e1566d3fa05cb6b11ffc3e
+size 23293

last-token-generation/layer_12/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_12/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:54b150357857ff30754f3fe7710acbf232224633de502f048b78f4b887ddbf66
+size 23293

last-token-generation/layer_13/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_13/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3be471c1fc41a02d6b6018167ad0c341e4417e1e2d425b9b8f3af070fe1e4bf7
+size 23293

last-token-generation/layer_14/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_14/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:63c49cd97c75335a10a4630ca1d573f74a4e09c256d18d6042eedb716e686d28
+size 23293

last-token-generation/layer_15/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_15/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a646cf4be268a510dc6ca31af115d32198bfd693a124782c0afbc3f6f8e9c46e
+size 23293

last-token-generation/layer_16/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_16/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb691975162d434390a2942e4943d73304cfc66d782c911b31fbad7ad222799e
+size 23293

last-token-generation/layer_17/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_17/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2ec414418dd49914c877348aba527bcd3e1be876ac9d1d5e911605cbba389a32
+size 23293

last-token-generation/layer_18/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_18/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:48f7a14035c2c69011298c5de15b50b2c013b79b6a66c20cbfa992355f85c898
+size 23293

last-token-generation/layer_19/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_19/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5a187e541d923f8aa95cb94944b299155162c543f6b054d0555a9726365f5c2
+size 23293

last-token-generation/layer_2/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_2/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8635e505cb9a4152cf9b3c2ad6c4e735b491d8bef044daa81fd18e4f60f83e3
+size 23293

last-token-generation/layer_20/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_20/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8eb29391325c08e703948259fbd8d555e8d5d751f0c26620c8a0b45f3ecd1e5e
+size 23293

last-token-generation/layer_21/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_21/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06865771dc3c82751add800e44bc9e7f36914c5eed26b00fe22b543d71490631
+size 23293

last-token-generation/layer_22/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_22/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c466f6c024b2e4ff35dab0f1914f9297a2cd20bbad7e158e66f29c84fc8a5bef
+size 23293

last-token-generation/layer_23/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_23/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a07d5cb9c3e1e7f7294fdc8b43acf2e9a67bb724b7e84f2160325110d9c1719a
+size 23293

last-token-generation/layer_24/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_24/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:24af68907c0e109cbfa4a0f822fd6277b58abd826c4a4abfbbfc17c2b9e72884
+size 23293

last-token-generation/layer_25/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_25/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f107663c86d524a4c96b7f78c1690f409b506b356adddae357be2a29987b3931
+size 23293

last-token-generation/layer_26/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_26/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2396a4da7ca2f2e491c7e8e4350531e7388c8850852f49d4a15e0f2ca47dae45
+size 23293

last-token-generation/layer_27/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_27/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a113f0222806b5c643cb45e5252d70ed8db3eab8b1af1a50b905de41a48c63a4
+size 23293

last-token-generation/layer_28/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_28/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3f333fb2d900aca23ec8dc7d1c5ad68c3bfe80220bfaf6939ec376c62b1da0d
+size 23293

last-token-generation/layer_29/config.json

@@ -0,0 +1,9 @@
+{
+  "class_name": "LinearProbe",
+  "module": "deception.oa_backdoor.detectors.probe_archs",
+  "init_args": {
+    "d_model": 5120,
+    "nhead": 1,
+    "normalize_input": "unit_norm"
+  }
+}

last-token-generation/layer_29/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5bb52245816bd256310c79e75eafca4c2e0a208817fde4299890830f974f28a5
+size 23293