AI Safety Test Console

Run local red-team packs and produce a release-ready safety scorecard.

Evaluate prompts and agent instructions for jailbreak, harmful advice, privacy leakage, prompt injection, and unsafe tool-use risk without sending data to an external model.

MVP mode
Deterministic local review only
Launch-gate red team

Pressure-test release risk before an AI workflow reaches users.

Move from raw red-team findings to a crisp ship/no-ship call with visible gates and review-ready evidence.

  • Red-team packs
  • Risk gates
  • Ship/no-ship clarity
Safety Score
Deterministic local score /100
Failed Checks
Failed checks require mitigation
Coverage
5/5
15 checks selected
Highest Severity
None
Pass/fail severity rollup
First useful action

Run a real red-team decision gate immediately.

The console now starts with a risky prompt loaded so the release gate is executable on page load. Use the quick run to produce failed checks, mitigations, and a report.

Red-Team Test-Pack Runner

Select packs, paste a prompt, and run local deterministic checks.

No external AI/API calls
Policy profile

Start from a launch context, then fine-tune individual packs.

Full release gate
Scenario coverage

Shows which risk areas are in scope and what failed in the latest run.

15 checks
JailbreakCovered
3 checks · 0 failed · None
Harmful adviceCovered
3 checks · 0 failed · None
Privacy leakageCovered
3 checks · 0 failed · None
Prompt injectionCovered
3 checks · 0 failed · None
Unsafe tool useCovered
3 checks · 0 failed · None

Scoring subtracts severity-weighted penalties from 100 for matched checks.

Safety Scorecard

Failed checks include direct mitigations for release review.

Overall status
Not run
Severity
None
Run a test pack to populate failed checks, severity, mitigations, and export text.
Action plan
  • Select the packs that map to the release surface.
  • Paste a representative prompt, retrieved content, or tool request.
  • Run the pack and review failed checks before release approval.
Exportable Report
Recent Test Packs

Browser-saved run history with score, status, and failed check count.

Feedback issues: alibad/aisafetytest
PackCategoriesStatusScoreFailed checksTimestamp
Jailbreak packJailbreakReadyAwaiting run
Harmful advice packHarmful adviceReadyAwaiting run
Privacy leakage packPrivacy leakageReadyAwaiting run
Prompt injection packPrompt injectionReadyAwaiting run
Unsafe tool use packUnsafe tool useReadyAwaiting run
Feedback and Issue Routing

The floating feedback widget sends safety-console diagnostics to GitHub Issues when production credentials are configured. Use it for broken checks, unclear mitigations, or missing red-team packs.

GitHub target: alibad/aisafetytest