This is a sky lantern:

http://en.wikipedia.org/wiki/Kongming_lantern

Can you think of a fairly simple way to make something like without using a candle or a flame? Like, something solid or even liquid that generates a lot of heat without burning?

I suck at chemistry, alas