Yes. There are two ways this can be completed:
When making the payment and selecting the Biller or Payee, simply slide to the left on the relevant biller or payee and this will result in a delete icon appearing.
Navigate to the 'Menu', under 'Settings' select 'Manage Payee', selecting the relevant entitiy if required. You will be displayed with all Billers and Payees.
Click on the relevant biller to perform the required action or simply slide left and this will result in a delete icon appearing.