Yeah, temperature is a characteristic of matter, and space has very little matter for how vast it is, so it really depends on how you want to look at it. On average, it's all barely above absolute zero, but given how fuckin' big space is that doesn't mean all that much in regards to a given object.