SYNTHETIC STUDYMP
MEMORY · EXPERIENCE · RETURN

When an assistant remembers,
what changes for the user?

Follow memory from a relevant moment in a conversation to what the assistant says, what the user signals, and whether they return.

M
CONTEXT
RESPONSE
LEARNING
THE QUESTION

Does memory quality relate to users coming back?

We compare people with similar prior activity and similar memory opportunities. This helps separate a memory signal from the simple fact that highly engaged people tend to return.

i
How to read this demo

This is a synthetic model of a ChatGPT-style assistant. It does not measure ChatGPT’s internal memory or real users. In the default scenario, retrieval has zero simulated effect on return.

Fixed seed20261026
01
OpportunityA moment where past context may help
→
02
RetrieveWhich memory segment is queried?
→
03
Use & respondDoes useful context reach the answer?
→
04
User signalHelpful, wrong, or unwanted?
→
05
ReturnDoes a new session follow?
COHORT SNAPSHOT

Start with the size and shape of the evidence

The controls filter the cohort snapshot, example, and return views. Segment cards and the opportunity catalog stay on the full cohort; pending follow-up and unknown telemetry remain visible.

ONE ANCHOR PER USER
QUICK READWhat the snapshot can tell you
1 · Exposure

How often memory was retrieved at an eligible moment.

2 · Experience

Whether retrieved items were relevant, current, and used appropriately.

3 · Return

Whether users came back later. The pattern can reflect prior engagement or other causes, so it is not proof memory caused a return.

01 · MEMORY PATHWAYS

Different memory, different job

Each card shows the full synthetic cohort, even when an opportunity filter is selected. A user can be eligible for multiple segments.

FULL COHORT · SYNTHETIC
↳
Working memory is the active workspace.

Episodic, semantic, and procedural memory are long-term stores. Retrieval brings information from those stores into working memory; it does not mean the assistant used it well.

02 · DEFINE THE OPPORTUNITY

Decide what could benefit from memory before checking for a pull

These example rules are set before retrieval or return is examined. The table shows the full synthetic cohort as a reference catalog.

PRE-DEFINED ELIGIBILITY
03 · ONE SYNTHETIC CASE

Walk through a memory journey

This example makes the event labels concrete. It illustrates the measurement; it is not evidence about actual users.

04 · QUALITY & USER EXPERIENCE

A pull is not the same as a good memory moment

Review what was returned, whether it reached the response, and what the user explicitly signaled.

SYNTHETIC REVIEW LABELS
✓

Retrieved information

Among observed non-empty retrievals
Relevance and correctness are reviewed labels in this simulation. In a real study, publish the rubric and annotation coverage.
↳

From retrieval to response

Was information available and appropriately used?
Context inclusion and appropriate use are different steps. A retrieved item may never enter the active response context.
!

Explicit memory complaints

Counted in the anchor session, not only among returners
“No complaint label” is not proof of satisfaction. Unknown telemetry is kept separate from no observed retrieval.
05 · SUBSEQUENT USER RETURN

Could engaged users have returned anyway?

Compare raw return rates, then standardize across prior engagement and opportunity type. Return is an activity measure, not a memory-quality score.

ASSOCIATION ≠ CAUSATION
!
Why the crude comparison can mislead

Already-active users may be more likely to encounter retrieval and more likely to return. If so, a raw gap gives memory credit for behavior that may have happened anyway.

7-day return by retrieval status

Only users with known telemetry and complete follow-up
95% intervals shown

The selection pattern

Prior activity before the anchor opportunity
If both retrieval and return rise with prior activity, that is a warning that the raw gap is confounded.

How memory frequency relates to user return

Full synthetic cohort · opportunity filter does not change this view

Keep the denominator in view

Counts and rates by observed retrieval state
06 · METHOD & WHAT NEXT

What can this project conclude?

It can demonstrate an analysis framework and teach the limits of observational retention comparisons. It cannot establish ChatGPT product findings.

Read the measurement contract ↗
A

Grounding

The assistant interacts with the user or another external environment. We measure observable response support and user feedback.

B

Retrieval

The system reads long-term memory into the active workspace. We record segment, result status, relevance, and freshness.

C

Reasoning

The assistant combines current and retrieved information. We evaluate the visible answer; we do not collect private chain-of-thought.

D

Learning

The system writes, updates, or deletes long-term memory. We check correction persistence and forget compliance.

NEXT IN THE RESEARCH

From a synthetic demo to credible evidence

  1. Publish the opportunity rules, event schema, review rubric, and generator assumptions.
  2. Stress-test missing telemetry, small segment groups, overlapping retrieval, and incomplete follow-up.
  3. For real product evidence, instrument exact turn-to-memory links and memory writes in a system you are authorized to study.
  4. For a causal retention claim, design a safe experiment among eligible opportunities and track quality, complaints, privacy, and user control as guardrails.
ⓘ

Portfolio disclosure: all records and example conversations are synthetic. The site does not connect to ChatGPT, any company system, database, or external data service.