Whose to say the gems haven't conquered a planet of fungus people? They are a galaxy spanning empire you know.

Geo-Kinesis and the Grave-digger Motif make his function fairly obvious, he's meant to take shattered gems much like the Crystal Gems, except for the fact the he encases them in stone and buries them deep underground