Lyric discussion by Juluii 

Cover art for Small Fish lyrics by Porcupine Tree

Seems more to me that this is a song about the Greek/Roman underworld. "The fisherman" is Charon, and the "empty people" are the dead entering the underworld. The references to time and the burning sky are descriptions of what it's like to inhabit the underworld.