Sharon, I reckon I'd put EITHER 'I'd come.... here...' or 'I'd gone.... there'. The first is much closer in, in terms of your charcater's POV, the latter perhaps more traditional and formally corrcet.
I have the same problem with whether to say, for example, 'tomorrow' or 'the next day' (e.g. 'Esmerelda wondered whether she ought to come back tomorrow' or 'Esmerelda wondered whether she ought to come back the next day'
. Or 'she'd been up late every night this week' versus '...every night
that week'. In both cases the second sounds more correct, but the first brings you closer into your character's personal POV. It's a choice, depending on the effect you want, but you need to be consistent.
Well, that's what I think, anyway.
Rosy.