When I search I feel that it’s intuitive to return to the location where you initiated the search (cmd+f). Both a button so you can stay and work (X) and a button for returning back (<-)
This is how it looks right now.