I feel like this still understates that prompt tracking can be useful. Yes, they’re probabilistic and not a precise science. But they can be incredibly helpful for understanding the overall direction of your AI appearance. Both are counter arguments to the source you cite *(Spark Toro)
1. The very source you cite *(Spark Toro) shows that top brands appear in 55 to 77% of responses regardless of how the prompt was phrased. They state that it takes 60-100 runs to start seeing this pattern. So prompt tracking can be effective if sampled correctly at scale.
2. query fan outs. Even if you write prompts you’re thinking about instead of your consumer, AI will run many related queries anyways. 142 different human phrasings of the same headphone question, the models still captured the core intent and returned a relatively consistent brand set.
Thanks for the comment! I agree that prompt tracking can be useful. Maybe it was an oversight on my end. I just wanted to focus the piece more on what's wrong with how most companies/individuals are approaching it. In general, I agree with your points, though.
I feel like this still understates that prompt tracking can be useful. Yes, they’re probabilistic and not a precise science. But they can be incredibly helpful for understanding the overall direction of your AI appearance. Both are counter arguments to the source you cite *(Spark Toro)
1. The very source you cite *(Spark Toro) shows that top brands appear in 55 to 77% of responses regardless of how the prompt was phrased. They state that it takes 60-100 runs to start seeing this pattern. So prompt tracking can be effective if sampled correctly at scale.
2. query fan outs. Even if you write prompts you’re thinking about instead of your consumer, AI will run many related queries anyways. 142 different human phrasings of the same headphone question, the models still captured the core intent and returned a relatively consistent brand set.
Thanks for the comment! I agree that prompt tracking can be useful. Maybe it was an oversight on my end. I just wanted to focus the piece more on what's wrong with how most companies/individuals are approaching it. In general, I agree with your points, though.