My displacer DM, who for the time being is gonna be named Sarah, may have been mistaken when she thought the Displacer beast was gone. It may have just been asleep. And it may wake up if it thinks there's danger nearby.

Doesn't have to actually be danger nearby, it just has to think there is.