Prototypes: Navigating back to the last swapped overlay

In a proto, say at some point you swap overlays. For instance a view with left tab enabled (A) vs the same view with right tab enabled (B). From both (A) and (B) states, allow the user to navigate to the next same view (C).

Problem: When user navigates back - via a Back interaction - from (C), he always ends up on (A), even if he came from (B).

Would it make more sense to remember in the view history the last state visited? This would enable more realistic simulation.

Current behaviour (awkward):
A swap B
nav to C
nav back ==> A

Expected behavior (more natural):
A swap B
nav to C
nav back ==> B