Virtu executives underestimated the firestorm that would surround a new book on high-frequency trading and engulf virtually everyone affiliated with the industry.