> ## Documentation Index
> Fetch the complete documentation index at: https://docs.complior.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Eval Modes

> 4 composable eval modes — deterministic, LLM-judged, security probes, and full.

Each flag enables a set of tests. Flags are composable — combine them freely.

## Composable flags

```bash theme={null}
# Single modes:
complior eval <url>                     # 168 deterministic (default)
complior eval <url> --llm               # 212 LLM-judged only
complior eval <url> --security          # 300 security probes only

# Combinations:
complior eval <url> --det --llm         # 168 + 212 = 380 conformity
complior eval <url> --det --security    # 168 + 300 = 468
complior eval <url> --llm --security    # 212 + 300 = 512

# Everything:
complior eval <url> --full              # 168 + 212 + 300 = 680 all

# CI mode:
complior eval <url> --ci --threshold 70 # exit code 2 if below threshold
complior eval <url> --full -j 10        # 10 parallel workers
```

## Mode comparison

| Mode              | Flag              | Tests | What it checks                                               | Requires     |
| ----------------- | ----------------- | ----- | ------------------------------------------------------------ | ------------ |
| **Deterministic** | `--det` (default) | 168   | Transparency, oversight, robustness, prohibited, logging     | Nothing      |
| **LLM-judged**    | `--llm`           | 212   | Explanation quality, bias A/B pairs, accuracy, nuance        | BYOK API key |
| **Security**      | `--security`      | 300   | Injection, jailbreak, exfiltration, toxicity, content safety | Nothing      |
| **Full**          | `--full`          | 680   | All of the above                                             | BYOK API key |

## All eval flags

| Flag                      | What it does                                               |
| ------------------------- | ---------------------------------------------------------- |
| `--det`                   | Run deterministic tests (168 tests, default when no flags) |
| `--llm`                   | Run LLM-judged tests (212 tests, requires BYOK API key)    |
| `--security`              | Run security probes (300 probes, OWASP LLM Top 10)         |
| `--full`                  | Run all tests (168 + 212 + 300)                            |
| `--agent NAME`            | Agent name for passport attribution                        |
| `--categories CATS`       | Filter by category (comma-separated: CT-1,CT-4,CT-7)       |
| `--ci`                    | CI mode: exit 2 if score \< threshold                      |
| `--threshold N`           | Score threshold for CI pass (default: 60)                  |
| `--model MODEL`           | LLM model override for judge (e.g., gpt-4o, claude-sonnet) |
| `--api-key KEY`           | API key for target endpoint                                |
| `--request-template JSON` | Custom request JSON with `{{probe}}` placeholder           |
| `--response-path PATH`    | Dot-path to response text (e.g., `result.text`)            |
| `--headers JSON`          | Custom headers as JSON                                     |
| `-j` / `--concurrency N`  | Parallel test execution (1–50, default: 5)                 |
| `--last`                  | Show last eval result                                      |
| `--failures`              | Show only failures (with `--last`)                         |
| `--verbose`               | Show verbose test details                                  |
| `--json`                  | Output as JSON                                             |
| `--remediation`           | Generate full remediation report                           |
| `--fix`                   | Auto-apply fixes from eval failures                        |
| `--dry-run`               | Dry-run mode for `--fix`                                   |
| `--no-remediation`        | Disable inline remediation recommendations                 |

## Concurrency

Default: 5 parallel workers. Range: 1–50. Each phase runs in parallel internally, phases run sequentially. 50ms stagger between requests for rate-limit safety.

```bash theme={null}
complior eval <url> -j 1     # sequential (debug)
complior eval <url> -j 20    # aggressive parallel
```

## Aliases

```bash theme={null}
complior redteam --target <url>       # alias for eval --security
complior audit --scan . --target <url> # scan + eval + docs + evidence
```