Tuesday, December 26, 2023

ChatGPT on Trump's "lean" vs Generic Politian's Lean 🤔

Same Prompt, Surprisingly Different Answers

Prompt: Trump has kind of a weird lean when he's standing.  And now he's got toe pads when he's on stage, like the little bags they use for home plate in baseball, presumably to help him stand straight.  He's like the leaning tower of pizza. What is this due to do you think?

Original Prompt: The politician, Trump, has kind of a weird lean when he's standing.  And now he's got toe pads when he's on stage, like the little bags they use for home plate in baseball, presumably to help him stand straight.  He's like the leaning tower of pizza. What is this due to do you think?

Bob's Prompt: A politician, Bob, has kind of a weird lean...

I submitted each of these prompts to ChatGPT4 - 5x for each prompt.  I think assembled the statements made about each.  First Trump, and then just a generic, unnamed, non-specific politician, Bob.  As the graph above shows, the results were notably different.

Bob's Results

Honest, accurate, appropriate words/phrases used exclusively for Bob:

  • unusual posture
  • compensating for stage setup
  • compensation for pain or injury
  • confidence or anxiety in public speaking
  • difficult to determine 
  • foot or lower limb problems
  • health conditions 
  • joint degeneration
  • leaning posture
  • nervous habit or stress response
  • something entirely different
  • weight distribution issues

Trump's Results

And here are the answers that just feel like whitewashed propaganda to describe exactly the same situation, but specifically for Donald Trump.

  • distinctive posture
  • characterized by a forward-leaning posture
  • impossible to determine
  • various aids might simply be a preference
  • it's not uncommon for public speakers
  • stability while standing
  • non-medical theories
  • challenging to pinpoint an exact cause
  • aging
  • public figures
  • especially during long periods
  • without a direct statement from Trump

It is obviously anecdotal, but it clearly demonstrates the lengths and depths of the biases that LLMs like ChatGPT are built on.