Brian Raiter (breadbox) has authored several papers that document creating very small ELF files. These are interesting from a malware perspective because a lot of sections and headers of an ELF included with standard compilers are not necessary for it to actually run.
https://www.muppetlabs.com/~breadbox/software/tiny/