In this paper, various algorithms have been referred for face detection and recognition for security purpose in smartphones. Different types of algorithms such as template matching, color code segmentation using the K-mean clustering algorithm, etc. for face detection and KLT for face recognition have been used. In any of the face recognition system, the first step is face detection. The mentioned algorithms have first been constructed in MATLAB and then later it is implemented in SMARTPHONES phones. After the implementation of the mentioned algorithms, we have recognized certain pros and cons while implementing the face recognition system on a mobile phone with limited hardware capabilities.