Are some people more likely than others to keep asking until they get the level of expertise they were aiming for? I’m guessing ppl who don’t keep asking are the harder ones to read?
Yes, this! I did a whole project on "churned" users and for the most part, those failed sessions just looked normal to me, people asking a question and getting an answer, nothing more. Wrote about it at the time, obvi:
Part of me wonders whether this shifting, nebulous recognition of context and "what lies beneath" correctness is something we definitively do *not* want models to get good at, because isn't that its own danger? There's a short-term UX gain in meeting the user where they're at, but the long-term implications of models that conform and shapeshift so readily and so precisely to each individual's hidden intent is frankly terrifying.
Yeah, that’s interesting. I agree I don’t want the model to know what I’m *really* asking deep down, but I do wish the model’s decision tree was more defined by style choices than pure CoT…
Are some people more likely than others to keep asking until they get the level of expertise they were aiming for? I’m guessing ppl who don’t keep asking are the harder ones to read?
Yes, this! I did a whole project on "churned" users and for the most part, those failed sessions just looked normal to me, people asking a question and getting an answer, nothing more. Wrote about it at the time, obvi:
https://softcoded.substack.com/p/why-people-leave
Part of me wonders whether this shifting, nebulous recognition of context and "what lies beneath" correctness is something we definitively do *not* want models to get good at, because isn't that its own danger? There's a short-term UX gain in meeting the user where they're at, but the long-term implications of models that conform and shapeshift so readily and so precisely to each individual's hidden intent is frankly terrifying.
Yeah, that’s interesting. I agree I don’t want the model to know what I’m *really* asking deep down, but I do wish the model’s decision tree was more defined by style choices than pure CoT…