To delete a file, first make sure that the option "Extended view" is active, then click the trash can icon to delete the file. (Img. 2.4.1)
Note that it is not possible to delete files that linked/used in content elements. In these cases you will need to first unlink the files from the content elements, and then remove them from the Filelist.