EOS R5 face / eye tracking

I left Canon years ago.... went to Fuji for mirrorless and back to Canon now with this R5.
I had a question about the face and eye tracking. In both photo and video modes: If you lose an object you are tracking or the camera does not lock on to something to track it seems that I have to hit the Set button to get it back in the mode to search for a face, eye or animal to track. Do i have a setting wrong or is this accurate? Thanks for any help. Love the camera. I have never used a tracking feature before. I have always shot everything in manual.