There are 3 reasons why the MiniVAN list you are looking at no longer shows the people you talked to previously:

1) If you re-load the list (download a new one, relog, etc)

2) If the turf is refreshed

3) After 7 days

Keep in mind that as long as you properly synced and committed your data it is saved in VAN.