You can delete a task from either the Day View or the Task View.
Right-click the task you want to delete and select Delete Task.
Creating a task
Modifying a task