"MPG" is a carry-over from the DOS 8x3 file name convention, where file extensions were three characters long (ie. "FILENAME.EXT").
You should technically be able to rename a file from ".MPG" to ".MPEG" and have it play just the same.
As Earnest points out, it's really the internal compression that determines the difference (like Mpeg1, Mpeg2).