All JPEGs can contain their own thumbnail, yes.
Unless you specifically don't store it.

You can use the EXIF viewer add-on for Firefox to view jpg data, and as well as the exif it's also able to extract the preview thumbnail from inside the file.