Based on my understanding:
The glasses would send data to the user’s phone, which would maintain the local end of a bank of faces, and relay that to a central server for full id.

Similar to how Facebook builds profiles on you across the web on connected sites regardless of whether you are logged into Facebook.