Every year, hundreds of thousands of questions labeled “HOTS” are handed to Indonesian students. But if you inspect them closely, many are just memorization questions in costume: the word “analyze” bolted onto the front, or a long stimulus that doesn’t actually need to be read to answer the question. This article dissects the hallmarks of genuine HOTS items and gives you a quick way to check your own.
What is HOTS, really?
HOTS (Higher-Order Thinking Skills) refers to the top levels of thinking in the revised Bloom’s Taxonomy: analyzing (C4), evaluating (C5), and creating (C6). What matters is not the command verb but the cognitive process the student has to perform. “Analyze the causes of the Diponegoro War” — when the answer can be memorized from a single textbook sentence — is not an analysis item; it’s a memorization item wearing expensive vocabulary.
Four hallmarks of genuine HOTS items
- The information needed to answer is NOT spelled out in one place — students must combine at least two pieces of information.
- The stimulus contains information that is RELEVANT and information that is NOT — students must filter, not simply find.
- The reasoning path can be explained — students who get it right can explain why, and you can point to exactly where students who get it wrong went astray.
- Distractors are built from common misconceptions — not options that are obviously absurd.
A 60-second test for your items
Take one of your items and ask three questions. First: can the answer be found with Ctrl+F through the material? If yes, it’s C1–C2, not HOTS. Second: can the stimulus be deleted without changing the answer? If yes, the stimulus is decoration. Third: does a student who answers incorrectly know exactly where they went wrong? If not, the distractors aren’t doing their job yet.
An example of item transformation
Notice the difference between two items on the same topic — photosynthesis:
| Aspect | Memorization Version | HOTS Version |
|---|---|---|
| Command | “Name the raw materials of photosynthesis” | “Determine the most limiting factor for the rate of photosynthesis in the two conditions below, and explain your choice” |
| Stimulus | None | Data for two conditions: clear glass vs. frosted glass, same light intensity |
| Process | Recalling a list | Connecting the concept of light with experimental data |
| Distractors | Random options | Tempting answers that ignore one variable |
Closing thoughts
The HOTS label is easy to attach; the cognitive process behind it is what is hard to build. The good news: the structure of HOTS can be learned and, once understood, checked quickly. Start by examining your old items with the 60-second test above — the results are often surprising.
AiLatih Pedagogy Team
AiLatih learning content and research team