Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/harness.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ jobs:
strategy:
fail-fast: false
matrix:
dsh: ['0.1.0-rc.6', '0.2.1-rc.2']
dsh: ['0.1.0-rc.6', '0.2.1-rc.2', '0.2.1-rc.5']
steps:
- uses: actions/checkout@11d5960a326750d5838078e36cf38b85af677262
- uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020
Expand Down
8 changes: 4 additions & 4 deletions harness/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,11 +4,11 @@ Three independently installable bundles with distinct tools and tasks:

| Bundle | Task | Tools | Install |
|---|---|---|---|
| [Social Research](../packages/dsh-social) | Social discovery, approved reads, stored results and source tables | 5 native | `dsh plugin --profile web add @beatapi/[email protected].0` |
| [Media Kit](../packages/dsh-media) | Image/video discovery, pricing previews, approved starts and task status | 4 native | `dsh plugin --profile web add @beatapi/[email protected].0` |
| [BeatBrowser](../packages/dsh-browser) | Existing Chrome logins and owned background TaskSpaces | 24 namespaced MCP tools | `dsh plugin --profile web add @beatapi/[email protected].0` |
| [Social Research](../packages/dsh-social) | Social discovery, approved reads, stored results and source tables | 5 native | `dsh plugin --profile web add @beatapi/[email protected].1` |
| [Media Kit](../packages/dsh-media) | Image/video discovery, pricing previews, approved starts and task status | 4 native | `dsh plugin --profile web add @beatapi/[email protected].1` |
| [BeatBrowser](../packages/dsh-browser) | Existing Chrome logins and owned background TaskSpaces | 24 namespaced MCP tools | `dsh plugin --profile web add @beatapi/[email protected].1` |

Tested hosts: `0.1.0-rc.6` and `0.2.1-rc.2`, Node.js 22.12+. Community integrations by BeatAPI, not official DeepSeek products. Each bundle supplies a Skill and coexists with the others. Prebuilt JavaScript needs no install-time build script. Each package README documents GitHub installation too.
The packages do not restrict Harness versions. Tested hosts: `0.1.0-rc.6`, `0.2.1-rc.2`, and `0.2.1-rc.5`. Future hosts are not yet tested and may introduce breaking changes. Node.js 22.12+. Community integrations by BeatAPI, not official DeepSeek products. Each bundle supplies a Skill and coexists with the others. Prebuilt JavaScript needs no install-time build script. Each package README documents GitHub installation too.

`harness/shared/` is synchronized into self-contained Social and Media packages by `npm run harness:sync`; `npm run harness:check` checks drift and offline behavior. To verify a host, run `node harness/scripts/host-smoke.mjs /absolute/path/to/@deepseek-ai/dsh`. It installs all three tarballs into a temporary profile, checks 33 tool registrations and three Skills, calls the report tool, then stops the host and removes temporary data. It never creates paid tasks or mutates existing profiles.

Expand Down
13 changes: 10 additions & 3 deletions harness/VALIDATION.md
Original file line number Diff line number Diff line change
@@ -1,20 +1,27 @@
# Harness validation — 2026-10-28
# Harness validation — 2026-11-01

Status: implementation and package acceptance complete. Marketplace submission and package publication are separate states; see their actual links and receipts rather than treating tests as marketplace approval.

## Reproduced checks
## Compatibility release 0.1.1 — 2026-11-01

The three packages declare `engines.dsh: "*"` and unrestricted optional DSH peers. This removes installation blocks tied to individual RC versions; it is not a claim that every future host is tested. All three locally packed 0.1.1 bundles passed installation, 33 tool registrations, three Skill registrations and offline report execution on hosts 0.1.0-rc.6, 0.2.1-rc.2 and 0.2.1-rc.5. No paid operations were started.

`npm run verify` passed with `BEATAPI_SKILL_SOURCE` pointing to an export of the recorded Skill commit `40ceddc0beadce4da61d8fd2d47e5dda70b8529c`. The nearby development checkout has newer Skill content; this release retains and verifies the repository’s pinned source.

## Reproduced checks (initial acceptance, 2026-10-28)

| Check | Result |
|---|---|
| Offline DSH behavior tests | 14 passed; scope restrictions, missing credentials, safe errors, redaction, price previews, changed specifications, idempotency, result retrieval, task resume, CSV safety and compact discovery |
| Existing plugin validation | Standalone `npm run verify` passed, including contract/Skill/runtime checks, 20 existing tests, typecheck, generated MCP bundle and artifact builders |
| Harness `0.1.0-rc.6` | Three actual tarballs installed together in an isolated profile; 9 native tools, 24 browser MCP tools and 3 Skills registered; report execution passed |
| Harness `0.2.1-rc.2` | Same installation, registration, Skill and report checks passed |
| Harness `0.2.1-rc.5` | Three locally packed bundles installed in an isolated profile; 9 native tools, 24 browser MCP tools and 3 Skills registered; offline report execution passed. Paid operations and live Chrome were not retested on this version. |
| Live capability discovery | Actual X Social Data and image-model discovery plus contract inspection succeeded; these were free requests |
| Real browser through Harness | Both host versions created an owned background TaskSpace, read the Example Domain page through the namespaced snapshot tool and finished the space; Chrome extension 1.4.1 |
| Packaged browser dependency | Uses the published `@beatapi/[email protected]`, not unpublished FAST settings source |

`node harness/scripts/host-smoke.mjs /absolute/path/to/@deepseek-ai/dsh` reproduces isolated installation, 33 tools, three Skills and an offline report call. The dedicated GitHub workflow runs this against both declared host versions. It does not require website login or a connected Chrome extension and does not create browser pages or paid requests.
`node harness/scripts/host-smoke.mjs /absolute/path/to/@deepseek-ai/dsh` reproduces isolated installation, 33 tools, three Skills and an offline report call. The dedicated GitHub workflow runs this against the three recorded host versions. It does not require website login or a connected Chrome extension and does not create browser pages or paid requests.

## Boundaries

Expand Down
Loading
Loading