Video thumbnail feature is missing in default installation from MATE’s file manager, Caja. You can install the dependency easily and have video thumbnails enabled. Execute the following in terminal:
sudo apt-get install ffmpegthumbnailer
Open Caja and see the result. Close it and re-open if it’s already open.