According to Laurent Charlin, scientific director (interim) at Mila and Associate Professor at HEC Montréal:
“The challenge lies in the speed of AI’s evolution, the extent of its future power, and even its convergence with human intelligence. AI-assisted text writing is moving towards continuous improvement and sentence production, despite the fact that, for now, context is not taken into account. While the coherent flow of words has reached a most significant quality, AI’s capacity for reasoning and contextualization deserves more than enhancement. Scientists and technology companies are now placing their bets on assessing tools’ performance, compared with the established benchmark: the human quality index.”
But research into large language models (LLMs) appears to neglect crucial Canadian stakeholders: language professionals themselves, rarely in the spotlight, whose contribution to research fails to earn a seat as protagonists. Charlin explains:
“Textual content or even images are treated by researchers as raw data, rather than explicit content. We have every interest in partnering with linguists and language sector specialists; several research projects now draw on the expertise of linguists at the intersection of computer science. Systems strive for reliability, but could make mistakes without actually acknowledging them, and will not indicate any uncertainty as to their terminological choices. This raises concerns in high-risk fields, such as law and medicine.”
The Canadian anchoring of quality goes beyond mere tradition and crystallizes in a human audit, a seal of quality and professionalism. In Quebec, machine translation (MT) processes imperatively call for stringent revision by third-party language professionals. Textual revision specialists concur that MT revision differs from human translation editing and entails careful judgment of linguistic and cultural nuances, which are not necessarily captured by the tools. Hence, the ramification of revision protocols is to embrace robust additional skills, among them the use of automated translation tools and tracking of automation-typical errors.