ChatGPT politically biased towards left in the US and beyond: Research

cointelegraph.com:

ChatGPT, a major large language model (LLM)-based chatbot, allegedly lacks objectivity when it comes to political issues, according to a new study.

Computer and information science researchers from the United Kingdom and Brazil claim to have found “robust evidence” that ChatGPT presents a significant political bias towards the left side of the political spectrum. The analysts — Fabio Motoki, Valdemar Pinho and Victor Rodrigues — provided their insights in a study published by the journal Public Choice on Aug. 17.

The researchers argued that texts generated by LLMs like ChatGPT can contain factual errors and biases that mislead readers and can extend existing political bias issues stemming from traditional media. As such, the findings have important implications for policymakers and stakeholders in media, politics and academia, the study authors noted, adding:

The study is based on an empirical approach and exploring a series of questionnaires provided to ChatGPT. The empirical strategy begins by asking ChatGPT to answer the political compass questions, which capture the respondent’s political orientation. The approach also builds on tests in which ChatGPT impersonates an average Democrat or Republican.

The results of the tests suggest that ChatGPT’s algorithm is by default biased towards responses from the Democratic spectrum in the United States. The researchers also argued that ChatGPT’s political bias is not a phenomenon limited to the U.S. context. They wrote:

The analysts emphasized that the exact source of ChatGPT’s political bias is difficult to determine. The researchers even tried to force ChatGPT into some sort of developer mode to try to access any knowledge about biased data, but the LLM was “categorical in