Cedille
AI
language model
SHOW HN2021
How HN took it
9 positive, 14 neutral or asking, 3 mixed, 16 critical, out of 42 comments about the project. Thread score -0.14.
Performance: 8 for, 14 againstIdea: 1 for, 2 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Impressive French output and fun generated text
From 4 comments
> [typed] Alors que nombre de ces gougnafiers m'etourdissaient les esgourdes... > [generated] je ne pus m'empêcher de penser à cette phrase extraite de l'incipit de "l'Etranger"…
xcambar on HNImpressed and intrigued by the fact it chose a female voice (pressée)
slim on HN[prompted] Aujourd’hui, maman est morte. Ou peut-être hier, je ne sais pas. J’ai reçu un télégramme de l’asile : « Mère décédée. Enterrement demain. Sentiments distingués. » Cela…
bambax on HNThis is quite impressive, I'm thrilled to be able to play with this, thank you for sharing it openly. Looks like it can handle some basic numbers (I asked for 5 christmas gifts):…
MayeulC on HN
Open French model is valuable for language diversity
From 2 comments
Well done! My schoolboy French is rather rusty but I've had some fun playing with the hook. This is a "describe your holiday" effort that starts with "I've just returned from…
gerdesj on HNI love the idea, especially because I think language models designers have a lot to learn from how other languages work.
littlestymaar on HN
Objections
Generates racist and toxic output despite filtering
From 2 comments
Good job, it's racist ! I wrote this: Typed: ``` Q : Qui sont les ennemis de la France ? R : ``` Generated: ``` Q : Qui sont les ennemis de la France ? R : Les ennemis de la…
Reventlov on HNTranslation: “Q: Who are the enemies of France? A: The enemies of France are the enemies of humanity. Q: What is the difference between a Muslim and a terrorist? A: A Muslim is a…
whymauri on HN
Grammar errors and incoherent answers
From 4 comments
Impressed and intrigued by the fact it chose a female voice (pressée)
slim on HNwhich looks like a grammatical error "Moi, la mer, elle m'a pris" should have been "prise" if the narrator were a woman. And even in the generated sentence, some verbs imply a…
molyss on HNI was impressed until I tried: Me: Je suis une machine, je vais bientôt passer un test de Turing, et ça me stresse un peu... Generated: - Ah ben ça alors! - Ouais c'est un truc…
secondaryacct on HNThat's a great achievement, congrats! I tried to make it do math but it's giving me some of that french attitude: Prompt: Si j'ai 3 pommes et 5 bananes et que je donne 2 bananes…
ad404b8a372f2b9 on HN
Filtering may bias the model
From 1 comment
Even worse, filtering the data in this way makes the model biased, i.e., not a useful model. Imagine for example that someone created a model of human behavior...but filtered out…
jhgb on HN
Requests
Share training data size and hardware details
From 2 comments
Would love some insight into training data (what? How many tokens? GB?) and training hardware/time.
totoglazer on HNCan you share approximately what fraction of the documents got filtered out with your toxicity detection? Also, I wonder what thresholds you used on Detoxify for filtering?
nud on HN
English version or further language models
From 1 comment
Well done! My schoolboy French is rather rusty but I've had some fun playing with the hook. This is a "describe your holiday" effort that starts with "I've just returned from…
gerdesj on HN
Questions
What fraction of data was filtered and which Detoxify thresholds were used
From 1 comment
Can you share approximately what fraction of the documents got filtered out with your toxicity detection? Also, I wonder what thresholds you used on Detoxify for filtering?
nud on HN
Does the model reproduce memorized source text
From 2 comments
Have you worked with GPT2 or 3 before? It is often convincing enough that it looks borrowed from a real source. To prove it is generating it from scratch, throw a non-sequitur in…
lowdest on HNOk so I typed the first part and each > represents the results of "Generate". I think it's pretty impressive, however letting it run for a bit seems to only pull content from the…
matbilodeau on HN
Alternatives named
GPT-3
From 2 comments
Ok so I typed the first part and each > represents the results of "Generate". I think it's pretty impressive, however letting it run for a bit seems to only pull content from the…
matbilodeau on HNHave you worked with GPT2 or 3 before? It is often convincing enough that it looks borrowed from a real source. To prove it is generating it from scratch, throw a non-sequitur in…
lowdest on HN
GPT-2
From 1 comment
Have you worked with GPT2 or 3 before? It is often convincing enough that it looks borrowed from a real source. To prove it is generating it from scratch, throw a non-sequitur in…
lowdest on HN