Foreground detection is a task for detecting the moving objects in the scene like in video surveillance. Several basic background models are often used due to their high efficiency. However, their results are not good when there exists noisy information generated by the bad weather, camera jitter, etc. Neutrosophic set (NS) is as a new branch of philosophy dealing with the origin, nature and scope of neutralities. It has an inherent ability to handle the indeterminant information like the noise included in images and video sequences.