To edit or delete a saved caption:

- Click on a Media

- Click on Add caption

- Click on the little grey window in the bottom right corner of your caption section

- Select the caption you want to edit or delete
- Click on the pen icon to edit it, or on the bin icon to delete it

The whole process is described step by step in the screencast below.