CrowdFaceDB: Database and benchmarking for face verification in crowd

Face recognition research has benefited from the availability of challenging face databases and benchmark results on popular databases show very high performance on single-person per image/video databases. However, in real world surveillance scenarios, the environment is unconstrained and the videos are likely to record multiple subjects within the field of view. In such crowd surveillance videos, both face detection and recognition are still considered as onerous tasks. One of the key factors for limited research in this direction is unavailability of benchmark databases. This paper presents CrowdFaceDB video face database that fills the gap in unconstrained face recognition for crowd surveillance. The two fold contributions are: (1) developing an unconstrained crowd video face database of over 250 subjects, and (2) creating a benchmark protocol and performing baseline experiments for both face detection and verification. The experimental results showcase the exigent nature of crowd surveillance and limitations of existing algorithms/systems.