Dungeon XP and the 12-Level Cutoff
International official news

The group loses kill XP when a party member is more than 12 levels above the enemy.
Compare the highest-level party member with each enemy. A level 40 player facing a level 28 enemy is within the limit. Against a level 27 enemy, that player causes the whole party to receive zero kill XP.
Blizzard revised the November 13 rule. Instances already in progress when the revision went live kept the earlier rule for that run.
Source: Dungeon XP level difference update
Summarized from official announcements; refer to the original for full details.