French AI expert Benoît Raphaël conducted a set of tests: he input chapters from two, later four, Haitian novels into Pangram, and all were correctly identified as human-written; he then input Orélien's poems, short prose and reviews published before 2023, and these too were identified as human-written. These results point to a possibility: Pangram may not systematically misjudge non-standard, highly colloquial French texts.
But Raphaël himself is not a neutral skeptic. He says that before the scandal broke, he had written to another AI expert, suspecting Orélien's novel was written with AI assistance, and pointed out that its prose has typical signs of AI-generated writing, such as over-reliance on certain rhetorical structures. His test samples were chapters and pre-2023 works, not the full text of the novel in question. Therefore, this set of tests can neither prove the novel was written by AI nor prove it was not.