In this case you can't delete it - the publish service's underlying code does not allow it.
If you put nothing in it, it won't be created as a hard drive folder in the folder to which stuff is published, and it won't do any harm other than looking ugly.
