Changelog
The full history is CHANGELOG.md in the repository. This page is the recent entries. npm channels, this tree, and the hosted service are different: Versions. This release publishes npm next as 0.7.2-beta.3. latest stays 0.7.1. A registry check on 8 Nov 2026 at 10:16 IST reported latest 0.7.1 and next 0.7.2-beta.2. That observation is not a pin and not the hosted product.
Unreleased
- Hosted sign-in can opt out of the egress proxy with
allowHostedAuthWithoutProxyorMTAI_ALLOW_HOSTED_AUTH_WITHOUT_PROXY=true. The default is still fail closed. The opt-in warns once and setshostedEgresstounproxied-opt-in.
0.7.2-beta.3
- Local existing-account sign-in (
auth login, or env-var names for a form). The session file stays on the machine.AUTH_PROVIDER_CONTRACTismonkeytester.auth.provider.v1for a later server pin. The hosted product does not sign in yet. npmlateststays 0.7.1. - Signed-in egress is default-deny for other origins. A login needs a post-login URL or selector or the run is
could_not_test. Workers, shared workers, and WebRTC are disabled while a session is loaded. A saved session needs the same post-login check. Later flows may leave the post-login path.
0.7.2-beta.2
- A browser error page (
chrome-error://,about:neterror, and the same kind of internal page) is never a pass. A request our guard aborted is inconclusive (request_blocked, orcontact_submit_blockedfor a contact form). Any othernet::ERR_*is a failure and the evidence names it. page_urlis the last real http(s) page, neverchrome-error://.- Live and replay share
fingerprintV2for the same bug. A test id alone is not the fingerprint. Hashes for bugs that already had a role or name on an http(s) page stay the same. - Replay repro steps do not repeat the same
Open <url>line. - A button click that lands on a text or search field submits that field with Enter when it is in a form, and is inconclusive (
locator_mismatch) when it is not. A bare targetSearchandclicking "Search"count, as do Find, Go, and Submit. Contact and sensitive guards still apply. A real button is unchanged. If that click's only miss is an unchanged URL, the flow is inconclusive, not a bug.
0.7.2-beta.1
- Contact, enquiry, feedback, support, quote, and get-in-touch forms are not submitted. The POST is aborted. The flow is inconclusive with
contact_submit_blocked, not a pass and not a bug. Search and analytics beacons are unchanged. Replay uses the same guard. There is no allow flag.
0.7.1
Stable release of 0.7.1-beta.1, with no code changes.
0.7.1-beta.1
- Replay of a stored plan uses the same sign-in redirect, sign-in check, sign-up check, and sensitive-submit rules as a live run. A locator that no longer matches, including a stored step with no locator, is inconclusive (
automation_error), not a site bug. - The
auth-redirectnote is listed once on the flow and once across its steps. - Replay page checks use the same paint wait as a live check, and axe findings roll up with the same severity and fingerprints.
- Accessibility and metadata checks run only on HTML (
text/htmlorapplication/xhtml+xml, with a URL fallback for sitemaps, feeds, JSON, text, images, and PDF). - An unchanged URL is inconclusive unless the page shows an error, a console error, a failed request, or no DOM change.
- A sitemap-only 404 is minor. A 404 on a link in the page is unchanged.
/__l5e/trackeventsis an analytics beacon.
0.7.0-beta.5
- Analytics beacons (
sendBeacon, keepalive, clarity, Google Analytics,/cdn-cgi/rum, and the other listed collectors) are not sensitive submits. A homepage visit is not inconclusive because a beacon body said "payment" or "reset". Real reset, OTP, newsletter, payment, and account-deletion submits stay blocked unless allowed. - A page visit that follows a same-origin redirect to sign-in or sign-up passes. The note is an info suggestion. The landing page counts as a public screen. Cross-origin redirects, error pages, loops, and 4xx/5xx still fail.
0.7.0-beta.4
suggestionsare a separate list (autocomplete, viewport, description, overflow without a viewport, third-party and unattributed page errors). They are not bugs and they are not part of the verdict.warningscarries model errors.plan.plannerFallbackis set only when the grounded plan replaced a failed model call.- Models that reject
temperature(gpt-5*, o-series) omit it.estimateCostUsdprices each step at its own model. - Page checks run before sign-up, each with a real
durationMs. A skipped check isbudget_exhausted, not a 0ms failure. - Sign-up with an inbox is one flow. Password reset, OTP, newsletter, checkout, and account deletion are validation-only unless an inbox (reset and OTP) or
allowSensitiveallows the submit. OAuth clicks and/auth/<provider>navigations are inconclusive. - Sign-in and sign-up URLs are public screens. The same rendered screen is stored once.
- A missing invented success sentence does not fail a flow. An empty field after fill is an automation error.
- A wrong password that the site rejects with an auth HTTP 4xx, or with wording such as "correct login details", is not a bug. Page-check durations are the measured time, including 0.
0.7.0-beta.3
- A flow is
passedonly when its outcome check verifies. No check isinconclusivewithno_assertion. A check that cannot be decided isassertion_unverifiable. - The runner does not submit a completed sign-up unless you passed an
InboxProvider. Without one,signup_statusisnot_testedandsignup_reasonisno_inbox. - CLI
--inbox <module>and--inbox-http <url>. No default host.createHttpInboxandloadInboxProviderare exported.
0.7.0-beta.2
- Deterministic page checks, ids
check-*, outside the LLM flow budget: console, HTTP and broken links, axe-core WCAG A/AA, mobile at 375px, and title / description / lang / viewport / h1. BASIC_PRESET: 6 pages, 5 LLM flows, caps of 5 checks and 6 auth-negative flows, and a 120 second budget. Past the budget, remaining page checks are skipped.--planner-modelsets the planner only. Page summaries stay on the cheap model.
0.7.0-beta.1
- Auth-negative checks for a crawled password field (
auth-neg-*): empty submit, invalid email, one wrong password, password visibility, forgot-password link, sign-up link. Sign-up and reset forms are not submitted. - Login-only runs set
outcome_reasontologin_requiredwhenpublic_screensis0, including whenoutcomeiscleanorbugs_found. ENGINE_VERSIONis copied ontoRunResult.engine_version.- Pre-release tags
v*.*.*-beta.*publish to npm dist-tagnext. Stable tags stay onlatest.
0.6.1
- An unlabeled number input no longer waits out
locator.fill. - Optional bug fields:
impact,page_url,step_index,flow_id,element. None of them change the fingerprint. SiteMapPage.inputsrecords fillable controls that are not inside a form.
0.6.0
outcome,outcome_reason, andoutcome_detailonRunResult.- Playwright and selector failures are inconclusive, not confirmed bugs.
- Quick pass added as
--depth basic(at this version: 6 pages and 4 flows). 0.7.0-beta.2 raises the LLM flow cap to 5 and adds page checks.
Older notes, including the 0.4.0 loop (init, run, rerun, diff, report) and the 0.5.0 rename to @monkeytestai/monkeytester, are in the repository changelog.