You add chapters within the description section. You just have to setup the time stamps with the chapter name starting with 0:00 example:
3:00 Chapter 1
4:00 Chapter 2
This will auto add the chapters in the video and show the chapter name when someone hovers over it.