Check the following item in order to get page titles and headings in the navigation bar in OneNote Online.

1. Verify that page capitalize the titles correctly.
2. Check that you have headings on your pages.
3. Make sure that your headings cover the full-width of the page.
4. Ensure that your titles are in H1 format.