Can a Byte object be cast to a double value?

No, an object cannot be cast to a primitive value.