[Opinion Card] Human creates with a large context window

Introduction #

People often complain that the context window is too small (or too large?). For fixing small bugs, a small context is enough; but for doing creations, larger context window is beneficial.

Operational work needs precise context #

For problems with a certain answer, the context doesn't have to be large: human finds out the answer from existing knowledge (and documentations). Knowledge and experience also help reducing the search space.

Creative work needs large context #

For tasks without a certain answer, human may need to compose the answer by searching the map for components of an (not the) answer. The human's knowledge and experience determine the size and shape of the map. Because answer generating requires multiple components, the search space is usually much larger.

There is a difference for creative work searches from operation work search: the search space expands, not shrinks, as the human finds more potentially useful components.

Larger context allows for wilder imaginations #

Since the task is a search, a bigger map allows for more diverse answers. Needless to say, the complexity, difficulty, and scope of the search also expand as the map enlarges.

Unlike parameters, the link is dynamic #

Reader may think human's experience is not like the context, but more of the parameters in a model. I don't think it's true. Human's observation of their experience is not fixed. One may love a song in one day and hate the same song in another.