Yes, they're pretty much vector by definition. Post Script is the "vector language" most fonts use for infinite scalability. So, yes EPS files are vector based. It is possible however (tho rare) to embed raster (bitmap) images within an EPS. In that case, any vector portions of the file maintain perfect scalability while raster portions get pixelated and jaggy when scaled. Same goes for Illustrator.
Does that help?