Google requires its collaborators to rate Gemini's responses without adequate preparation

Behind the magic of generative artificial intelligence, there is a whole technical team of programmers responsible for making everything work as it should. A part of this team, the prompt engineers, are responsible for evaluating the responses given by the AI and their accuracy.

This work scheme is usually the same in all major tech companies, such as OpenAI or Google. However, the latter has made some quite questionable changes in its way of working. Changes that, in the worst case, could affect the reliability of Gemini.

Gemini DOWNLOAD

In order to improve and refine Gemini, Google relies on the services of GlobalLogic, a subcontracting company owned by Hitachi. According to TechCrunch, Google has reportedly required GlobalLogic employees to evaluate Gemini’s responses even in areas outside their expertise.

As expected, this decision has generated controversy about the lack of accuracy and reliability that such evaluations would have. Some people think that this move could be perceived as irresponsible and generate distrust from the public towards Gemini.

It should be noted that, before this change, workers could refuse to rate certain questions and answers if they were beyond their knowledge. Now, this will no longer be the case.

In the documents reviewed by TechCrunch, it was made clear that if the worker did not have the experience to assess certain indicators, the task should be discarded. In the new guidelines, it is specified that no question should be omitted and that only “the parts of the question that they do understand” should be evaluated.

At the moment, there are only two exceptions: you cannot respond if there is a complete lack of information or if there is offensive content that requires special permissions.

Gemini DOWNLOAD