I got 51 problems but a #2 pencil ain’t one.我得到51个问题，但一＃ 2铅笔，是不是一。

Booz Allen Hamilton has a funny name but they’re all about serious business. Booz Allen Hamilton进行有一个有趣的名称，但他们都是严重的业务。 The “global strategy and technology “全球策略与技术 consulting firm咨询公司 ” was contracted by the College Board in the fallout of the SAT scoring mistakes from last October. “签订合同，由该学院董事会，在尘的SAT考试得分的失误，从去年10月。 They audited the testing process and made a report, which was hidden away.他们审计的测试过程，并提出了报告，这是隐藏的距离。 At least until Senator LaValle used subpoena powers and至少直到参议员拉瓦使用传票的权力和 demanded the report要求报告 be made public–they were required to do so by New York’s “truth in testing” state laws but the College Board stated that they were “exempt from state law.” I love this choice quote: “Once again The College Board’s approach to problems is to shroud them in secrecy,” Senator LaValle said in a July 13 news release.公诸于众，他们被要求这样做，纽约的“真理在测试”国家的法律，但大学理事会指出，他们“免于国家的法律。 ”我爱这个选择引述： “再次大学委员会』 s的做法，问题是笼罩在他们保密， “参议员拉瓦说，在7月13日新闻稿。 “ Their attitude gives rise to greater questions as to their true purpose .” What do you mean, Senator LaValle? “ 他们的态度会引起更大的问题，以他们的真正目的 ”是什么意思，参议员拉瓦？ Is there still a problem?还有一个问题呢？

“The board’s lack of accountability in this matter goes to the heart of the arrogance that exists when an organization basically holds a monopoly in a certain market,” LaValle said in a statement following the release of the report. “委员会的缺乏问责制，在这件事去心的嚣张气焰，存在时，一个组织，基本上拥有垄断在某一个市场， ”拉瓦列在一份声明中说以下释放的报告。 “This report still does not answer why such a large number of testing errors occurred on the October 2005 SAT. “这份报告仍然没有答案，为什么如此众多的测试错误发生在2005年10月的星期六。 In addition, the board has not provided an explanation of why it took several months to inform over 4,000 students of inaccurate test scores.”此外，董事会还没有提供一个解释为什么花了数个月告知超过4000的学生不准确的考试成绩“ 。

Additionally, The National Center for Fair and Open Testing responded to the report by releasing a list of questions that the study did not answer.此外，代表National Center for公平和公开的测试作出回应，该报告公布一份问题清单，该项研究并没有回答。 Among them: What was the root cause of the problem?其中包括：什么是问题的根源？ When did The College Board receive the first request for hand scoring of the October SAT?什么时候大学委员会收到的第一项要求为手得分10月星期六？ How many weeks did it take for the board to respond to that request?有多少周没有采取该委员会作出回应这一要求？ When did The College Board first discover a broad problem?什么时候大学理事会首次发现一个广泛的问题呢？ Why was there a delay between that time and when test takers and others were informed of the problem?为什么有延迟之间的时间和时，考生和其他被告知这个问题呢？

[thanks, [感谢， Daily Stanford每日斯坦福 ]

Now, I went into that report (it’sa powerpoint presentation) and picked out some of the most fun parts of it.现在，我走进该报告（这是PowerPoint简报）和挑选出的一些最有趣的部分。 Actually, it’s more a case of me fearmongering by promoting potentially frightening sections of a report which just goes to show how flimsy the SAT is as part of a situation which just demonstrates how much that not-for-profit status is bullshit.实际上，它的更是一个案件我fearmongering ，促进潜在的可怕的第一份报告，刚刚正好说明如何站不住脚的SAT考试是作为一个组成部分，这种情况只是表明了多少不牟利的地位是布尔什特。

The report was released July 26 and has since been buried from the public as best the College Board can manage.该报告公布的7月26日至今已被埋葬，从市民的最佳大学委员会可以管理。 It’s available on their website它的可在其网站上 here这里 ; I’m not making this stuff up. ;我不会作出这种东西了。 Booz Allen Hamilton placed each of the 51 identified error-risk-locations into one of these categories: Booz Allen Hamilton进行放在每51确定错误风险的地点之一，这几类：

There were some really cute flowcharts and diagrams, too–even little pie charts of “overall rating” for the likelihood a particular flaw in the testing chain could fail.有一些真正可爱的流程图和图表，太，甚至小馅饼图表的“总体评价”的可能性，某一缺陷在测试链可能失败。 There were several charts–one titled “Prioritization of Risk” (on slide 54 for those reading along) shows the killzone.有几个图表-一本名为“优先次序的风险” （对幻灯片54对于那些读沿）显示killzone 。 These 4 were both of “higher impact” (ie “affects large part or whole answer sheet”) and “high likelihood,” remember the color scheme:这4个都是“高影响” （即“影响大的部分或全部的答卷” ）和“高的可能性， ”记得配色方案：

7. Scanner reading variation due to erasure 7 。 扫描器读的变化，由于擦除

3. 3 。 Scanner variation on marginal marks 扫描变化对边际马克

4. 4 。 Scanner reading variation due to alternative writing implement扫描仪读的变化，由于替代书面实施

26. 26 。 Answer sheets left in test books答卷留在测试的书籍

Don’t worry, they provide partial solutions on slide 56.不用担心，他们提供部分解决方案的幻灯片56 。 For instance, pesky #7 can be solved by…举例来说，讨厌的7号便可以解决…

1. Continue double scan继续双扫描
2. Supply pencils/erasers at test centers供应铅笔/橡皮擦，在测试中心

Wait, that’s it?等待，就是这样？ That’s how they solve it?这就是他们如何解决呢？ What about the blank spaces under “medium-term improvements” and “major future changes” or “follow-on analysis”?对于空白下的“中期改进”和“重大的变化，未来”或“后续的分析” ？ Why is there even the “follow-on analysis” table if there is nothing in it on that entire slide?为什么会出现，甚至“后续的分析”表，如果有没有在这对整个幻灯片呢？ Okay, whatever.好吧，不管。 How do we solve “ Scanner reading variation due to alternative writing implement ” ?我们如何解决“ 扫描仪读的变化，由于替代写作落实 ” ？ We… supply pencils and erasers at test centers.我们… …供应铅笔及橡皮擦，在测试中心。 Oh.哦。 And that finishes it?并完成它呢？ Oh, we can “Investigate software upgrades for consistent readings (color scanning, wavelength, etc.)” also?哦，我们可以“调查软件升级为一致读（彩色扫描，波长等） ”也？ That’s great.说的伟大。 And then eventually have an online test?然后终于有一个在线测试？ That sounds stupid but I’ll take your word for it.听起来很愚蠢，但我会考虑您的字。 Hmm, those problems sound easier to fix than some of the other ones, though. HMM的，这些问题的健全更容易修复，比其他一些，虽然。 Error 51, Errors in deleting items from database –that sounds nasty.错误51 ， 错误，删去项目从数据库听起来很讨厌。 You would have to ” Ensure DB backup and rollback procedures in place” to solve that one.你会要“确保数据库的备份和复原程序，在地方” ，以解决其中一个。

Oh well, I’ll trust that stuff.哦，我会相信的东西。 I’ll just skip to the appendix and see if there is anything else of interest…Oh, look, here are some of those things that were of lower likelihood!我将刚才跳到附录和，看看是否有任何其他的利益…哦，看看，这里有一些，这些事情都是较低的可能性！ These can’t be very important.这些不能非常重要的。 Hang on, they could have “higher” impact?坑上，他们可以有“较高”的影响？ Okay, what happens if there is “Scanner variation due to smeared pencil marks.” That can’t be that bad.好了，会发生什么，如果有“扫描仪的变化，由于涂铅笔马克。 ”不能说不好。 Smeared pencil marks due to manual handling–I can see that happening, I guess.涂铅笔马克因体力处理操作的-我可以看到发生的事情，我猜想。 And what’s the result? Inaccurate scores ?和什么样的结果呢？ 不准确的分数呢？ Say it ain’t so!说它是并非如此！ Well, at least there are now protections for that.那么，至少有现在的保护。 Wait, there are “none” now or in the foreseeable future?等待，有“无”现在或在可预见的将来呢？ Dang.党。 Too bad there are several other ways for that to happen, too–not least among them a PEM database corruption which results in data storage failure and then… inaccurate scores.太差，有几个其他方式为实现这一目标，在不久的并非最不重要的，其中一质子交换膜的数据库腐败的结果，在数据存储失败，然后…不准确的分数。 And which again has “none” ways against happening right now.并一再“无”的方法，对现在发生的事情的权利。 Glad to see you have it all under control, College Board, but I’m still seeing a little too much red .很高兴看到你有这一切受到控制，大学理事会，但我看到的仍然是有点太多的红色 。 Not you, though–all you see is green, green, cash.你不是，虽然所有你看到的是绿色，绿色，现金。 Good thing you still manage to keep the best interests of the students your balance books in mind.是一件好事，你还有管理，以保持最佳的以学生的利益为您的余额的书籍主意。

Finish with more from the Daily Stanford article…完成更多的从每日斯坦福大学的文章…

In the long run, the report makes the recommendation of offering the SAT online as a way to minimize scoring problems due to mechanical malfunctions, though the prospect of an online SAT raises many security questions.在长远来说，报告书提出的建议，提供国家税务总局在线的一种方式，以尽量减少得分的问题，由于机械故障，虽然前景在线坐在提出了许多安全问题。 Certainly, the amount of weight given to SAT scores in college admissions necessitates that the process be carefully scrutinized for error.当然，金额重量给坐在分数，在大学入学需要，这一进程受到仔细的审查，为的错误。

Although The College Board insists that the mistakes that led to last fall’s incorrect exams will be fixed, and the problem was an isolated incident, the organization’s reputation as a supposedly non-profit, fair institution has been damaged by the mistake and its initial refusal to cooperate with the Senate Higher Education Committee.虽然大学委员会坚持认为，错误，导致去年秋天的不正确考试将固定的，问题是一个孤立的事件，该组织的声誉，理应作为一个非盈利性，公平的机构已损坏的错误和其最初拒绝合作与参议院高等教育委员会。 Moreover, this gives rise to the question of whether the SAT should continue to be used in college admissions.此外，这带来的问题，国家税务总局是否应继续使用，在大学入学。

Wooooo. wooooo 。

Oh, for dessert: here are all 51 problem areas:哦，甜点：这里是所有51个问题的地方：