Skip to content

Changelog ​

The full history is CHANGELOG.md in the repository. This page is the recent entries. npm channels, this tree, and the hosted service are different: Versions. This release publishes npm next as 0.7.2-beta.3. latest stays 0.7.1. A registry check on 8 Nov 2026 at 10:16 IST reported latest 0.7.1 and next 0.7.2-beta.2. That observation is not a pin and not the hosted product.

Unreleased ​

  • Hosted sign-in can opt out of the egress proxy with allowHostedAuthWithoutProxy or MTAI_ALLOW_HOSTED_AUTH_WITHOUT_PROXY=true. The default is still fail closed. The opt-in warns once and sets hostedEgress to unproxied-opt-in.

0.7.2-beta.3 ​

  • Local existing-account sign-in (auth login, or env-var names for a form). The session file stays on the machine. AUTH_PROVIDER_CONTRACT is monkeytester.auth.provider.v1 for a later server pin. The hosted product does not sign in yet. npm latest stays 0.7.1.
  • Signed-in egress is default-deny for other origins. A login needs a post-login URL or selector or the run is could_not_test. Workers, shared workers, and WebRTC are disabled while a session is loaded. A saved session needs the same post-login check. Later flows may leave the post-login path.

0.7.2-beta.2 ​

  • A browser error page (chrome-error://, about:neterror, and the same kind of internal page) is never a pass. A request our guard aborted is inconclusive (request_blocked, or contact_submit_blocked for a contact form). Any other net::ERR_* is a failure and the evidence names it.
  • page_url is the last real http(s) page, never chrome-error://.
  • Live and replay share fingerprintV2 for the same bug. A test id alone is not the fingerprint. Hashes for bugs that already had a role or name on an http(s) page stay the same.
  • Replay repro steps do not repeat the same Open <url> line.
  • A button click that lands on a text or search field submits that field with Enter when it is in a form, and is inconclusive (locator_mismatch) when it is not. A bare target Search and clicking "Search" count, as do Find, Go, and Submit. Contact and sensitive guards still apply. A real button is unchanged. If that click's only miss is an unchanged URL, the flow is inconclusive, not a bug.

0.7.2-beta.1 ​

  • Contact, enquiry, feedback, support, quote, and get-in-touch forms are not submitted. The POST is aborted. The flow is inconclusive with contact_submit_blocked, not a pass and not a bug. Search and analytics beacons are unchanged. Replay uses the same guard. There is no allow flag.

0.7.1 ​

Stable release of 0.7.1-beta.1, with no code changes.

0.7.1-beta.1 ​

  • Replay of a stored plan uses the same sign-in redirect, sign-in check, sign-up check, and sensitive-submit rules as a live run. A locator that no longer matches, including a stored step with no locator, is inconclusive (automation_error), not a site bug.
  • The auth-redirect note is listed once on the flow and once across its steps.
  • Replay page checks use the same paint wait as a live check, and axe findings roll up with the same severity and fingerprints.
  • Accessibility and metadata checks run only on HTML (text/html or application/xhtml+xml, with a URL fallback for sitemaps, feeds, JSON, text, images, and PDF).
  • An unchanged URL is inconclusive unless the page shows an error, a console error, a failed request, or no DOM change.
  • A sitemap-only 404 is minor. A 404 on a link in the page is unchanged.
  • /__l5e/trackevents is an analytics beacon.

0.7.0-beta.5 ​

  • Analytics beacons (sendBeacon, keepalive, clarity, Google Analytics, /cdn-cgi/rum, and the other listed collectors) are not sensitive submits. A homepage visit is not inconclusive because a beacon body said "payment" or "reset". Real reset, OTP, newsletter, payment, and account-deletion submits stay blocked unless allowed.
  • A page visit that follows a same-origin redirect to sign-in or sign-up passes. The note is an info suggestion. The landing page counts as a public screen. Cross-origin redirects, error pages, loops, and 4xx/5xx still fail.

0.7.0-beta.4 ​

  • suggestions are a separate list (autocomplete, viewport, description, overflow without a viewport, third-party and unattributed page errors). They are not bugs and they are not part of the verdict.
  • warnings carries model errors. plan.plannerFallback is set only when the grounded plan replaced a failed model call.
  • Models that reject temperature (gpt-5*, o-series) omit it. estimateCostUsd prices each step at its own model.
  • Page checks run before sign-up, each with a real durationMs. A skipped check is budget_exhausted, not a 0ms failure.
  • Sign-up with an inbox is one flow. Password reset, OTP, newsletter, checkout, and account deletion are validation-only unless an inbox (reset and OTP) or allowSensitive allows the submit. OAuth clicks and /auth/<provider> navigations are inconclusive.
  • Sign-in and sign-up URLs are public screens. The same rendered screen is stored once.
  • A missing invented success sentence does not fail a flow. An empty field after fill is an automation error.
  • A wrong password that the site rejects with an auth HTTP 4xx, or with wording such as "correct login details", is not a bug. Page-check durations are the measured time, including 0.

0.7.0-beta.3 ​

  • A flow is passed only when its outcome check verifies. No check is inconclusive with no_assertion. A check that cannot be decided is assertion_unverifiable.
  • The runner does not submit a completed sign-up unless you passed an InboxProvider. Without one, signup_status is not_tested and signup_reason is no_inbox.
  • CLI --inbox <module> and --inbox-http <url>. No default host. createHttpInbox and loadInboxProvider are exported.

0.7.0-beta.2 ​

  • Deterministic page checks, ids check-*, outside the LLM flow budget: console, HTTP and broken links, axe-core WCAG A/AA, mobile at 375px, and title / description / lang / viewport / h1.
  • BASIC_PRESET: 6 pages, 5 LLM flows, caps of 5 checks and 6 auth-negative flows, and a 120 second budget. Past the budget, remaining page checks are skipped.
  • --planner-model sets the planner only. Page summaries stay on the cheap model.

0.7.0-beta.1 ​

  • Auth-negative checks for a crawled password field (auth-neg-*): empty submit, invalid email, one wrong password, password visibility, forgot-password link, sign-up link. Sign-up and reset forms are not submitted.
  • Login-only runs set outcome_reason to login_required when public_screens is 0, including when outcome is clean or bugs_found.
  • ENGINE_VERSION is copied onto RunResult.engine_version.
  • Pre-release tags v*.*.*-beta.* publish to npm dist-tag next. Stable tags stay on latest.

0.6.1 ​

  • An unlabeled number input no longer waits out locator.fill.
  • Optional bug fields: impact, page_url, step_index, flow_id, element. None of them change the fingerprint.
  • SiteMapPage.inputs records fillable controls that are not inside a form.

0.6.0 ​

  • outcome, outcome_reason, and outcome_detail on RunResult.
  • Playwright and selector failures are inconclusive, not confirmed bugs.
  • Quick pass added as --depth basic (at this version: 6 pages and 4 flows). 0.7.0-beta.2 raises the LLM flow cap to 5 and adds page checks.

Older notes, including the 0.4.0 loop (init, run, rerun, diff, report) and the 0.5.0 rename to @monkeytestai/monkeytester, are in the repository changelog.

AGPL-3.0-only