You can see the Video.js Playlist Ui plugin in action below. Look at the source of this page to see how to use it with your videos.