To get the raw data? fread() or istream::read, depending on whether you prefer <cstdio> or <iostream>.

To interpret the data? Mostly casting is fine, but if endian-ness is a potential problem (if this data file may be used by programs on multiple platforms), you may need to do some byte-swapping.

Incidentally, people will think you're talking about something else if you refer to this as a "memory stack".