Is it the lack of variety in the fantasy environment--it's always the same Grassy Field, Dark Forest, Evil Volcano, populated by the same tall slender Elves, short drunk Dwarves, and horny gray-skinned Demons?
Is it the lack of forethought put into a world that literally runs on RPG mechanics? Questions that are never answered like: Can I break my neck by falling and still be fine as long as my HP isn't zero? Are people with spinal injuries permanently under the Paralysis status condition? Does raising the Strength stat increase muscle mass?
Is it the society or government of the fantasy world? Discrepancies in the presentation of a monarchy or questions around what all these nobles actually do? Or why all the peasantry seem to own their own homes instead of sleeping 6 families to a dung-cottage on a share-crop?
Of course, things like this always reach a point where "muh worldbuilding" is just pointless fluff that doesn't impact the plot or the characters. Maybe that's where it fails the hardest, the lack of impact the world itself has on the story--it could happen anywhere, or it doesn't even need to be an isekai, and so on. I'm interested in other's thoughts on the subject.