For the last two years these LLM chat tools have been a puzzle. It was easy to see straight away that they were better at finding and synthesizing information than any person or any team. They were also forgetful, prone to making things up, and capable of getting lost entirely.
I spent most of the last year on understanding why, and on finding the openings to overcome the problems and press the strengths as the tools themselves matured. The path ran from treating chat as somewhere to pull chunks of information from, to treating it as a thinking partner, to treating it as a workspace — a place where research, analysis, diagramming, writing and validation all happen fully enfolded within the chat experience, with each step of the work governed, logged and empowered by the tools.
It was very hard to do successfully at first, and it has required building up a platform — so that the researcher stops thinking about the tool and can focus on vision and judgment, with good habits and process underneath.
The result comes out better. That is the whole of it: this is not the automation of the work. It is extending the power and skill of what any researcher or analyst can do.
