It should be possible to navigate through the UI with keyboard (arrow keys etc), without loosing focus. Right now, when you enter into a task (enter) you need to use cmd-b to go back (escape would be natural), but then you have no focus and cannot move around with keys anymore.