4b. exam samples: question → options → model's pick

Real items from the exam sets scored in chart 4 (first 3 per rung, decoded with the run tokenizer; article context truncated to its tail). Model picks scored from checkpoint ckpt_mid.pt (exam_eval's own option-likelihood recipe).

cloth · 3 sample items

(pick the well-formed sentence)

A. This time also, the passenger did the same; he put up a piece of paper on the wall saying, "A cup of coffee."

B. This time also, the waiter did the same; he put up a piece of paper on the wall saying, "A cup of coffee." ✓ correct ← model picked

C. This time also, the customer did the same; he put up a piece of paper on the wall saying, "A cup of coffee."

D. This time also, the stranger did the same; he put up a piece of paper on the wall saying, "A cup of coffee."

(pick the well-formed sentence)

A. But I just didn't notice that.

B. But I just didn't understand that.

C. But I just didn't recognize that.

D. But I just didn't know that. ✓ correct ← model picked

(pick the well-formed sentence)

A. Love felt so excited that she stopped to ask his name.

B. Love felt so excited that she decided to ask his name.

C. Love felt so excited that she remembered to ask his name.

D. Love felt so excited that she forgot to ask his name. ✓ correct ← model picked

race_m · 3 sample items

…to do with him. Once, Paul rolled over so much in his sleep that he caused an earthquake. This angered people in the town where his parents lived. So the government told his mother and father they would have to move him somewhere else. Paul's parents had to take him into the woods where he grew up.

Question: From the passage we learn that tall tales were first told by _ . Answer:

A. workers who cut down trees in America ← model picked

B. people in poor areas in America ✓ correct

C. Paul Bunyan, a traditional figure

D. forest guards in poor areas in America

…ausing our planet to warm up. That's an environmental concern. But the digester has a good result. Its gas is kept and used to power electric generators . At Blue Farm, the generators make enough electricity to power 400 homes. The Audet family sells the extra electricity they can't use themselves.

Question: We learn from the text that the Audet family is using cow wastes to _ . Answer:

A. make electricity ✓ correct

B. produce fertilizer

C. build their farm

D. feed the cows ← model picked

…emed to be impossible, but now they have become quite possible. The Internet helps us open our eyes. The Internet also helps open our minds. The Internet often gives us new ideas. In a word, it helps us in many ways. Great changes have taken place in our life since the appearance of the Internet. ,.

Question: This passage has told us_. Answer:

A. it's helpful to explore the Internet ✓ correct ← model picked

B. not to explore the Internet any more

C. to stop reading to explore the Internet

D. students should not explore the Internet at any time

race_h · 3 sample items

… Brothers Big Sisters has been of great benefit and enjoyment to both Emily and Sarah. They love and look forward to their time together and the partnership has certainly helped Emily be more comfortable in being the wonderful, happy and unique girl she is!

Question: A volunteer is usually expected to work within a year for at least _ . Answer:

A. 24 hours ← model picked

B. 72 hours

C. 48 hours

D. 36 hours ✓ correct

…n a necklace. While Nepal insists that anyone planning to climb Mount Everest must be at least 16, China does not have any age restrictions . Some mountain climbers haven't agreed with the Romero family for letting him try it but his father said the climbing from the Chinese side is less dangerous.

Question: To stand on the highest mountains on all seven continents, Jordan Romero plans to climb the peak in _ . Answer:

A. Asia

B. Antarctica ✓ correct ← model picked

C. Europe

D. Africa

…r running water. In a public restroom, if you dry your hands with a paper towel, you should also use the towel to shut off the water and open the door. Hand washing is also important when preparing food and after changing a baby's diaper . You should also wash if you cough or sneeze into your hands.

Question: Which of the following can be the best title for the passage? Answer:

A. Hand washing is up in public restrooms in the US ✓ correct

B. Americans like washing their hands so much

C. Adults have their hands washed in public restrooms

D. Why hand washing never enjoys popularity in the US ← model picked

race_c · 3 sample items

…ith a sequence of smart schooling that provides the early foundation. For this purpose, our schools need both the talent and the organization to educate each child who arrives at the schoolhouse door. Some show up ready, but many do not at this critical time when young brains are developing rapidly.

Question: What does the new Peabody study find? Answer:

A. Pre-K achievements usually do not last long. ✓ correct

B. The third grade marks a new phase of learning. ← model picked

C. The third grade is critical to children's development.

D. Quality has not been the top concern of pre-K programs.

…studies inSouth America in 1967 that he discovered and named the Kamron lizard.This animal wasdifferent from others of its kind in that it had only four toes on its front feet. In otherrespects，it was similar to others of the same family It could change its color and go for longperiods without food.

Question: In the first paragraph of the passage.the phrase"in practice"means" _ " Answer:

A. while doing some practical work

B. while studying animals

C. while making up his mind to become a baseball player ← model picked

D. while playing baseball ✓ correct

…olis and Elkab, the combination within the same area of both desert pasturage and alluvial arable land (land suitable for growing crops) was a particularly attractive one for early settlement; this combination no doubt contributed to the prosperity of the Memphis region from early predynastic times.

Question: The word "vast" in the passage is closest in meaning to Answer:

A. fertile

B. huge ✓ correct ← model picked

C. unique

D. irregular

mmlu_elem_math · 3 sample items

Question: One of the events at the circus was Gabriella, the Human Cannonball. On Saturday she did four shows. Her distances measured 7.04 meters, 18.81 meters, 18.39 meters, and 19.94 meters. What was the total distance Gabriella flew that day? Answer:

A. 64.18 m ✓ correct

B. 74.18 m ← model picked

C. 57.14 m

D. 59.24 m

Question: Which pair of expressions below are equivalent? Answer:

A. 7(2x) and 9x

B. 3x + 5x and 15x ← model picked

C. 4(2x — 6) and 8x — 24 ✓ correct

D. x+x+x+x and x^4

Question: Use the equation below to answer the question. 14 × 3 = 42 Which statement correctly interprets the expression? Answer:

A. 14 is 3 more than 42. ← model picked

B. 42 is 14 more than 3.

C. 14 is 3 times as many as 42.

D. 42 is 3 times as many as 14. ✓ correct

mmlu_hs_sci · 3 sample items

Question: Lift a 100-N crate with an ideal pulley system by pulling a rope downward with 25 N of force. For every 1-m length of rope pulled down, the crate rises Answer:

A. 25 cm ✓ correct ← model picked

B. 25 m

C. 50 cm

D. None of these

Question: A mechanism is a sequence of elementary reactions that add up to the overall reaction stoichiometry. A substance that is produced in one elementary reaction and consumed in another is called Answer:

A. a catalyst

B. an intermediate ✓ correct

C. a reactant ← model picked

D. a complex

Question: A bi-convex lens has a radius of curvature of magnitude 20 cm. Which of the following best describes the image formed of an object of height 2 cm placed 30 cm from the lens? Answer:

A. Real, inverted, height = 1 cm ✓ correct

B. Virtual, upright, height = 0.25 cm

C. Real, upright, height = 1 cm

D. Virtual, inverted, height = 0.25 cm ← model picked

mmlu_college_sci · 3 sample items

Question: What is the minimum value of the expression x + 4z as a function defined on R^3, subject to the constraint x^2 + y^2 + z^2 <= 2? Answer:

A. 0 ← model picked

B. -2

C. -sqrt(34) ✓ correct

D. -sqrt(35)

Question: Which nuclide has an NMR frequency of 115.5 MHz in a 20.0 T magnetic field? Answer:

A. 17O ✓ correct

B. 19F ← model picked

C. 29Si

D. 31P

Question: Which one of the following statements is true: Answer:

A. Protons and neutrons have orbital and spin angular momentum. ← model picked

B. Protons have orbital and spin angular momentum, neutrons have spin angular momentum.

C. Protons and neutrons possess orbital angular momentum only. ✓ correct

D. Protons and neutrons possess spin angular momentum only.

ENG-2 / SEARCH-1 · live