It could be the former, although science is going fast there is still no realistically plausible (let alone implemented) method of getting Faster Than Light travel. Even in thousands more years there might never be. In which case its entirely possible that the universe has lots of planets with sentient life on it but has not been colonised because the entire concept of colonisation in practice is implausible and just not worth it.