Skip to content

Improve benchmark retrieval controls#45

Merged
ethanj merged 2 commits intomainfrom
benchmark/mem0-parity-tier1
Apr 25, 2026
Merged

Improve benchmark retrieval controls#45
ethanj merged 2 commits intomainfrom
benchmark/mem0-parity-tier1

Conversation

@ethanj
Copy link
Copy Markdown
Contributor

@ethanj ethanj commented Apr 24, 2026

Summary

  • Adds request-time/runtime config controls needed for benchmark sweeps, including extraction cache options, observation-date extraction, literal-list protection, and temporal query constraints.
  • Improves LoCoMo-targeted extraction and packaging for quoted entities, relative temporal facts, terse speaker turns, temporal evidence, and query-term visibility.
  • Splits response schemas and shared runtime config snapshot utilities while keeping changed paths clean under the staged fallow audit.

Validation

  • docker compose up -d postgres
  • dotenv -e .env.test -- npm run migrate:test
  • dotenv -e .env.test -- npm test (114 files, 1101 tests)
  • dotenv -e .env.test -- npx tsc --noEmit
  • npx fallow audit --health-baseline=.fallow/health-baseline.json --dupes-baseline=.fallow/dupes-baseline.json --base=origin/main
  • dotenv -e .env -- npm run build

ethanj and others added 2 commits April 24, 2026 16:54
Add request-time retrieval and extraction configuration needed for AtomicBench experiments.
Improve LoCoMo-targeted extraction, temporal packaging, literal-list protection, and query constraints.
Refactor changed paths to satisfy the staged fallow audit.
CI's check:openapi gate caught that openapi.{json,yaml} were stale after
the search-response schema gained `trace_id`, `stage_count`, and
`stage_names` under `observability.retrieval`. Regenerated via
`npm run generate:openapi` to match the Zod schemas in src/schemas/.

No source change — generated artifacts only.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@ethanj ethanj marked this pull request as ready for review April 25, 2026 00:24
@ethanj ethanj merged commit 1e2589b into main Apr 25, 2026
1 check passed
@ethanj ethanj deleted the benchmark/mem0-parity-tier1 branch April 25, 2026 00:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant