Like others have said, just trust me when I say use Audiobookshelf.

I had to redo my Plex library a little, but it is so much better suited for audiobooks than Plex or Jellyfin.