Where the average house goes for $4 million, making it one of the richest towns in America. The residents seem a tad paranoid.