You can delete a folder or an object from the Library by selecting it then pressing the Delete key.