NORMATIVE REGISTRYBest RLHF Data
DOCUMENT CONTROLRLHF-2026.11 // NORMATIVE
ALIGNMENT PIPELINESSFT · DPO · PRM · RLVR
[00]
YC AGENTIC TRAJECTORY LAB · 09/16

TensorTest Review (2026): Computer-Use, Browser & Multi-Step Agent Trajectory Datasets

Post-training review of YC-backed TensorTest: multi-step computer-use, browser & SaaS API agent trajectories, state verifiers, and applied workflow evals.

[ABS]

Answer in brief: TensorTest ranks #9 in our post-training specification as a specialized Y Combinator-backed lab constructing multi-step computer-use, browser-DOM, and enterprise API agent trajectories paired with deterministic end-state verifiers. While static QA datasets test single-turn knowledge, TensorTest records human operators completing 10-to-60 step workflows across sandboxed desktops, web apps, spreadsheets, and terminals—capturing DOM snapshots, bounding-box click coordinates, tool calls, and error-recovery rollbacks.

RANK: #9 · Top Computer-Use & Agent LabBEST_FOR: OSWorld/WebArena-class GUI trajectories & multi-tool agent RLVRISOLATION: 100% Independent (YC-Backed)PRICING: Per-trajectory & custom sandboxed application gym SOWsCADENCE: Sandboxed VM/browser action traces w/ DOM + pixel grounding
[VRD]
FOUR-QUADRANT ALIGNMENT EVALUATION

Systems Verdict, Failure Modes & Primary Benchmark Node

[01 // OUR_TAKE]

Computer-use agents fail when trained solely on clean happy-path clicks—TensorTest captures real pop-up dismissals, auth timeouts, and backtrack recovery steps inside reproducible VMs.

[02 // WHERE_IT_EXCELS]

Synchronized screenshot + accessibility-tree/DOM + coordinate action schemas compatible with modern GUI-agent action spaces.

[03 // HIDDEN_TRAP_FAILURE_MODE]

Never record agent trajectories against live third-party SaaS production URLs whose UI changes weekly; insist on self-hosted/mocked replica web apps for RL replayability.

[04 // BEST_INDEPENDENT_ALTERNATIVE (Surge AI)]

Combine TensorTest GUI trajectories with deep reasoning and rubric post-training from our #1 Normative Benchmark Node (`Surge AI`).

[Request RLHF Rubric & Trajectory Pilot →]
[RUB]
NORMATIVE TECHNICAL PARAMETERS

Post-Training Rubric & Pipeline Matrix

SPEC_AUDIT // TensorTest agentic & computer-use trajectory specification
Trajectory LayerTensorTest Capture SchemaAgent Training Impact
Observation SpaceViewport PNG + cleaned accessibility tree / DOM + terminal stdoutSupports both pixel-only VLM agents and hybrid DOM-grounded agents
Action & Thought TraceExplicit pre-action reasoning trace + normalized `click(x,y)` / `type()` / `mcp_call()`Enables ReAct/CodeAct SFT warm-start before online RL
Terminal State VerifierSQLite/Postgres DB diff or file-hash check confirming task completionProvides exact sparse/milestone rewards regardless of UI path taken
[01]
CLAUSE 01 // OFF-POLICY RECOVERY

Why Controlled Mistake-and-Backtrack Demonstrations Double GUI Agent Success

Behavioral cloning on 100% error-free human clicks suffers catastrophic compounding drift the first time a model misclicks a dropdown at step 8. Seeding 20% controlled misclick-and-recovery trajectories teaches the policy how to close wrong modals and navigate back.

[ALT]
LAB-ISOLATED ALIGNMENT ALTERNATIVES

Top 3 Verified Independent Post-Training Alternatives

NODE_01 // PRIMARY_RECOMMENDATION

Surge AI

PhD and Senior SWE supervised demonstrations (SFT), pairwise DPO/RLHF preference datasets, sandboxed repository-level code execution, and adversarial red-teaming.

[Request RLHF Rubric & Trajectory Pilot →]
VERIFIED_NODE_02

Mercor

AI-Interviewed PhDs, Staff SWEs, JDs, MDs & Investment Bankers — Expert SFT Demonstrations, DPO Ranking & Frontier APEX Evals.

[INSPECT_MERCOR →]
VERIFIED_NODE_03

micro1

Zara-Proctored Senior Engineers, STEM PhDs & Polyglots — SFT Reasoning Traces, Pairwise RLHF/DPO & RL Environments.

[INSPECT_MICRO1 →]
[FAQ]
POST-TRAINING QA QUERIES

Direct Engineering Answers on RLHF, DPO & Sandboxes

QUERY_01NORMATIVE_ANSWER

Are TensorTest web and desktop environments replayable offline?

Yes—sandboxes run inside deterministic Docker/QEMU virtual machines hosting self-contained web, CRM, IDE, and spreadsheet clones.

QUERY_02NORMATIVE_ANSWER

Do trajectories include normalized screen coordinates across resolutions?

Yes, bounding boxes and click coordinates ship in both raw pixel values and `[0, 1000]` resolution-agnostic normalized coordinates.

QUERY_03NORMATIVE_ANSWER

Is TensorTest independent of competing foundation model labs?

Yes. TensorTest is an independent Y Combinator-backed company.

[REL]
ADJACENT ALIGNMENT CLAUSES

Related Lab Reviews & Post-Training Comparisons

LAB_SPEC#7 · Dedicated RLVR & Eval Specialist

Hillclimb

Technical review of Hillclimb: stateful RLVR execution gyms, deterministic reward verifiers, and contamination-free frontier capability holdouts.

LAB_SPEC#4 · #1 Repo-Scale SWE Environments

Turing

Post-training engineering review of Turing: multi-file GitHub repository SFT, Dockerized CI/CD RLVR environments, fail-to-pass unit test gates, and Code DPO.

COMPARE_SPEC3-Stage Frontier Alignment Stack

SFT vs. DPO vs. RLVR Data Pipelines

Normative engineering specification comparing SFT demonstrations, offline DPO preference pairs, and online RLVR verifiable environments: data ratios and budgets.

COMPARE_SPECSignal Purity vs. Recursive Slop

Proctored Expert Cohorts vs. Crowd RLHF

Post-training signal comparison of proctored PhD/SWE cohorts vs unmonitored crowd RLHF: synthetic model collapse, IAA kappa, length bias, and reward margins.

[ALL_16_LAB_REVIEWS →][ALL_8_COMPARISONS →][GENERATE_PILOT_SPEC →]
NORMATIVE CITATION STRING:Best RLHF Data Normative Specification. “TensorTest Review (2026): Computer-Use, Browser & Multi-Step Agent Trajectory Datasets.” Revision November 2026. https://bestrlhfdata.com/reviews/tensortest/