Where the average house goes for $4 million, making it one of the richest towns in America.