My friends and I use syncplay + mpv for this. It works well, and even though it’s designed around local file playback, you can add https URLs to the playlist. So this with nginx serving the files has been a great solution.

You can even play YouTube videos by adding yt-dlp to mpv, but that doesn’t reliably work right now as far as I can tell.