The reason Crafty is not in the new Spec version is somewhat funny. When the new version was first being planned, one of my contacts at Intel wanted to move crafty to the threaded/parallel part of SPEC. I explained to him very carefully exactly WHY this was a bad idea (chess is too non-deterministic). But he forged ahead saying that wasn't a problem.
Here's the glitch. When you submit a code to SPEC, you have to submit several sets of test data, and one set of production data. You have to also submit output for each test set and the production set. The test data is usually used for PGO compiling, but the final data can only be run after the compiler tweaks have been completed (IE you can't PGO using the final data, only the test data) The various manufacturers are free to use whatever compiler options/versions they have to maximize performance. But the output has to match the output provided by the program author. And anyone that has used a parallel chess program knows this fails. Node counts never match, and it is quite common for even the scores or principal variations to not be perfect matches.
So, a few months later, I got a call from Intel, again, telling me that they were going to remove Crafty because of its non-deterministic behavior. They had apparently already decided to use Sjeng for the non-threaded SPECINT, so Crafty was left out. Didn't bother me at all as it was a lot of work to help manufacturers debug their compilers (I spent a ton of time on the phone with Sun, when Crafty was in, because they had a few quirks in their brand new library. I didn't miss losing that.
