If you are swiping to delete from the list page, then it is a known bug that that doesn't work. The only way currently to delete a book is to go into the book and tap the trash icon, which should delete it permanently.