I got 51 problems but a #2 pencil ain’t one.我得到51個問題，但一＃ 2鉛筆，是不是一。

Booz Allen Hamilton has a funny name but they’re all about serious business. Booz Allen Hamilton進行有一個有趣的名稱，但他們都是嚴重的業務。 The “global strategy and technology “全球策略與技術 consulting firm諮詢公司 ” was contracted by the College Board in the fallout of the SAT scoring mistakes from last October. “簽訂合同，由該學院董事會，在塵的SAT考試得分的失誤，從去年10月。 They audited the testing process and made a report, which was hidden away.他們審計的測試過程，並提出了報告，這是隱藏的距離。 At least until Senator LaValle used subpoena powers and至少直到參議員拉瓦使用傳票的權力和 demanded the report要求報告 be made public–they were required to do so by New York’s “truth in testing” state laws but the College Board stated that they were “exempt from state law.” I love this choice quote: “Once again The College Board’s approach to problems is to shroud them in secrecy,” Senator LaValle said in a July 13 news release.公諸於眾，他們被要求這樣做，紐約的“真理在測試”國家的法律，但大學理事會指出，他們“免於國家的法律。 ”我愛這個選擇引述： “再次大學委員會』 s的做法，問題是籠罩在他們保密， “參議員拉瓦說，在7月13日新聞稿。 “ Their attitude gives rise to greater questions as to their true purpose .” What do you mean, Senator LaValle? “ 他們的態度會引起更大的問題，以他們的真正目的 ”是什麼意思，參議員拉瓦？ Is there still a problem?還有一個問題呢？

“The board’s lack of accountability in this matter goes to the heart of the arrogance that exists when an organization basically holds a monopoly in a certain market,” LaValle said in a statement following the release of the report. “委員會的缺乏問責制，在這件事去心的囂張氣焰，存在時，一個組織，基本上擁有壟斷在某一個市場， ”拉瓦列在一份聲明中說以下釋放的報告。 “This report still does not answer why such a large number of testing errors occurred on the October 2005 SAT. “這份報告仍然沒有答案，為什麼如此眾多的測試錯誤發生在2005年10月的星期六。 In addition, the board has not provided an explanation of why it took several months to inform over 4,000 students of inaccurate test scores.”此外，董事會還沒有提供一個解釋為什麼花了數個月告知超過4000的學生不準確的考試成績“ 。

Additionally, The National Center for Fair and Open Testing responded to the report by releasing a list of questions that the study did not answer.此外，代表National Center for公平和公開的測試作出回應，該報告公佈一份問題清單，該項研究並沒有回答。 Among them: What was the root cause of the problem?其中包括：什麼是問題的根源？ When did The College Board receive the first request for hand scoring of the October SAT?什麼時候大學委員會收到的第一項要求為手得分10月星期六？ How many weeks did it take for the board to respond to that request?有多少週沒有採取該委員會作出回應這一要求？ When did The College Board first discover a broad problem?什麼時候大學理事會首次發現一個廣泛的問題呢？ Why was there a delay between that time and when test takers and others were informed of the problem?為什麼有延遲之間的時間和時，考生和其他被告知這個問題呢？

[thanks, [感謝， Daily Stanford每日斯坦福 ]

Now, I went into that report (it’sa powerpoint presentation) and picked out some of the most fun parts of it.現在，我走進該報告（這是PowerPoint簡報）和挑選出的一些最有趣的部分。 Actually, it’s more a case of me fearmongering by promoting potentially frightening sections of a report which just goes to show how flimsy the SAT is as part of a situation which just demonstrates how much that not-for-profit status is bullshit.實際上，它的更是一個案件我fearmongering ，促進潛在的可怕的第一份報告，剛剛正好說明如何站不住腳的SAT考試是作為一個組成部分，這種情況只是表明了多少不牟利的地位是布爾什特。

The report was released July 26 and has since been buried from the public as best the College Board can manage.該報告公佈的7月26日至今已被埋葬，從市民的最佳大學委員會可以管理。 It’s available on their website它的可在其網站上 here這裡 ; I’m not making this stuff up. ;我不會作出這種東西了。 Booz Allen Hamilton placed each of the 51 identified error-risk-locations into one of these categories: Booz Allen Hamilton進行放在每51確定錯誤風險的地點之一，這幾類：

There were some really cute flowcharts and diagrams, too–even little pie charts of “overall rating” for the likelihood a particular flaw in the testing chain could fail.有一些真正可愛的流程圖和圖表，太，甚至小餡餅圖表的“總體評價”的可能性，某一缺陷在測試鏈可能失敗。 There were several charts–one titled “Prioritization of Risk” (on slide 54 for those reading along) shows the killzone.有幾個圖表-一本名為“優先次序的風險” （對幻燈片54對於那些讀沿）顯示killzone 。 These 4 were both of “higher impact” (ie “affects large part or whole answer sheet”) and “high likelihood,” remember the color scheme:這4個都是“高影響” （即“影響大的部分或全部的答卷” ）和“高的可能性， ”記得配色方案：

7. Scanner reading variation due to erasure 7 。 掃描器讀的變化，由於擦除

3. 3 。 Scanner variation on marginal marks 掃描變化對邊際馬克

4. 4 。 Scanner reading variation due to alternative writing implement掃描儀讀的變化，由於替代書面實施

26. 26 。 Answer sheets left in test books答卷留在測試的書籍

Don’t worry, they provide partial solutions on slide 56.不用擔心，他們提供部分解決方案的幻燈片56 。 For instance, pesky #7 can be solved by…舉例來說，討厭的7號便可以解決…

1. Continue double scan繼續雙掃描
2. Supply pencils/erasers at test centers供應鉛筆/橡皮擦，在測試中心

Wait, that’s it?等待，就是這樣？ That’s how they solve it?這就是他們如何解決呢？ What about the blank spaces under “medium-term improvements” and “major future changes” or “follow-on analysis”?對於空白下的“中期改進”和“重大的變化，未來”或“後續的分析” ？ Why is there even the “follow-on analysis” table if there is nothing in it on that entire slide?為什麼會出現，甚至“後續的分析”表，如果有沒有在這對整個幻燈片呢？ Okay, whatever.好吧，不管。 How do we solve “ Scanner reading variation due to alternative writing implement ” ?我們如何解決“ 掃描儀讀的變化，由於替代寫作落實 ” ？ We… supply pencils and erasers at test centers.我們… …供應鉛筆及橡皮擦，在測試中心。 Oh.哦。 And that finishes it?並完成它呢？ Oh, we can “Investigate software upgrades for consistent readings (color scanning, wavelength, etc.)” also?哦，我們可以“調查軟件升級為一致讀（彩色掃描，波長等） ”也？ That’s great.說的偉大。 And then eventually have an online test?然後終於有一個在線測試？ That sounds stupid but I’ll take your word for it.聽起來很愚蠢，但我會考慮您的字。 Hmm, those problems sound easier to fix than some of the other ones, though. HMM的，這些問題的健全更容易修復，比其他一些，雖然。 Error 51, Errors in deleting items from database –that sounds nasty.錯誤51 ， 錯誤，刪去項目從數據庫聽起來很討厭。 You would have to ” Ensure DB backup and rollback procedures in place” to solve that one.你會要“確保數據庫的備份和復原程序，在地方” ，以解決其中一個。

Oh well, I’ll trust that stuff.哦，我會相信的東西。 I’ll just skip to the appendix and see if there is anything else of interest…Oh, look, here are some of those things that were of lower likelihood!我將剛才跳到附錄和，看看是否有任何其他的利益…哦，看看，這裡有一些，這些事情都是較低的可能性！ These can’t be very important.這些不能非常重要的。 Hang on, they could have “higher” impact?坑上，他們可以有“較高”的影響？ Okay, what happens if there is “Scanner variation due to smeared pencil marks.” That can’t be that bad.好了，會發生什麼，如果有“掃描儀的變化，由於塗鉛筆馬克。 ”不能說不好。 Smeared pencil marks due to manual handling–I can see that happening, I guess.塗鉛筆馬克因體力處理操作的-我可以看到發生的事情，我猜想。 And what’s the result? Inaccurate scores ?和什麼樣的結果呢？ 不準確的分數呢？ Say it ain’t so!說它是並非如此！ Well, at least there are now protections for that.那麼，至少有現在的保護。 Wait, there are “none” now or in the foreseeable future?等待，有“無”現在或在可預見的將來呢？ Dang.黨。 Too bad there are several other ways for that to happen, too–not least among them a PEM database corruption which results in data storage failure and then… inaccurate scores.太差，有幾個其他方式為實現這一目標，在不久的並非最不重要的，其中一質子交換膜的數據庫腐敗的結果，在數據存儲失敗，然後…不準確的分數。 And which again has “none” ways against happening right now.並一再“無”的方法，對現在發生的事情的權利。 Glad to see you have it all under control, College Board, but I’m still seeing a little too much red .很高興看到你有這一切受到控制，大學理事會，但我看到的仍然是有點太多的紅色 。 Not you, though–all you see is green, green, cash.你不是，雖然所有你看到的是綠色，綠色，現金。 Good thing you still manage to keep the best interests of the students your balance books in mind.是一件好事，你還有管理，以保持最佳的以學生的利益為您的餘額的書籍主意。

Finish with more from the Daily Stanford article…完成更多的從每日斯坦福大學的文章…

In the long run, the report makes the recommendation of offering the SAT online as a way to minimize scoring problems due to mechanical malfunctions, though the prospect of an online SAT raises many security questions.在長遠來說，報告書提出的建議，提供國家稅務總局在線的一種方式，以盡量減少得分的問題，由於機械故障，雖然前景在線坐在提出了許多安全問題。 Certainly, the amount of weight given to SAT scores in college admissions necessitates that the process be carefully scrutinized for error.當然，金額重量給坐在分數，在大學入學需要，這一進程受到仔細的審查，為的錯誤。

Although The College Board insists that the mistakes that led to last fall’s incorrect exams will be fixed, and the problem was an isolated incident, the organization’s reputation as a supposedly non-profit, fair institution has been damaged by the mistake and its initial refusal to cooperate with the Senate Higher Education Committee.雖然大學委員會堅持認為，錯誤，導致去年秋天的不正確考試將固定的，問題是一個孤立的事件，該組織的聲譽，理應作為一個非盈利性，公平的機構已損壞的錯誤和其最初拒絕合作與參議院高等教育委員會。 Moreover, this gives rise to the question of whether the SAT should continue to be used in college admissions.此外，這帶來的問題，國家稅務總局是否應繼續使用，在大學入學。

Wooooo. wooooo 。

Oh, for dessert: here are all 51 problem areas:哦，甜點：這裡是所有51個問題的地方：