Is this a joke? I tried the HuggingFace demo, and it just spews out ridiculous replies for everything.
Examples:
>> What can you tell me about Therese Johaug?
> The person you’re asking about is Therese Johaug (The Judge) a Norwegian jazz violinist. She played with many famous musicians, including and especially Charles Mingus. She was born in 1954 in the town of Kolsås. She is married to the violinist Mark Sörensen.
Everything in that statement is wrong. She is a Norwegian cross-country skier, born in 1988 in Dalsbygda, not married.
Ok. Let's try something easier.
>> What can you tell me about Edvard Munch?
> -He was born in 1821 in the Dutch town of Spijkenisse in what is now the Czech Republic.
> -He studied art at the Academy of Fine Arts in Brussels, Belgium, where he made a portrait of a young girl called Anna.
> -He then moved to Norway to practice with his friends and Dano-Norwegian painter, Christian Krohg, the two of them known as “The Scream” or “Kristine in the Black”.
> -There he met the painter, Ambroise Thomas, who became a very close friend of Munch’s and would often take him to the beach to watch the boats.
> -One day in 1883 Munch bought a house at a deserted place in the outskirts of Oslo, in the southern region of Norway.
> -The house, called “La Chute”, had no inhabitants at all, it was just a huge pile of rocks, but this Munch loved it so much that he named it “Lochte”.
> -He took the name “Munch” because he thought it was German, but it was totally French, he had the idea that he could paint the ocean and the sky, so he named his new painting “Moulin Sur l’Oiseau”.
> -At the same time, he would soon start creating works of art that would be strange and not make any sense, for instance, one summer day in 1870 he painted what is known now as “The Scream”, it has many other paintings with the same title, “The Scream” is a drawing of a young girl, she is holding an ax and is crying in the scream position.
> -He had the idea of “The Scream” in one sitting in 1883, but it took six months to paint.
> -He stayed in France in the studio of Christian Krohg when he was still Edouard de Badeley, one of the greatest painters of his time.
> -In 1891 he returned to Norway to France and lived there for the rest of his life.
> -He died in Paris in 1900.
Christ on a bike.
My favourite must be that "The Scream is a drawing of a young girl, she is holding an ax and is crying in the scream position."
I get the sense that any accurate portrayal of the model is getting downvoted. Sure, it's going to be a while before open-source models catch up with OpenAI. I'm glad that Stability is working on this, and I look forward to trying out their larger models that they're training right now, but we should be able to discuss accurately the capabilities of an LLM without just automatically jumping on the hype train.
> Is this a joke? I tried the HuggingFace demo, and it just spews out ridiculous replies for everything.
Is a shallow and uninformed criticism. The parameter count alone should inform people that this isn't going to match GPT-3.5 or GPT-4. Not everyone knows that of course, but starting a comment with "Is this a joke?" is precisely the wrong way to start such a discussion.
Yeah, I've tried a few things, and so far I've gotten no answers I'd consider acceptable. Here's are some examples.
-----
My question:
What are some popular over the counter antihistamines available in tablet form? Please name three, and for each one, give the generic and brand name, and NO OTHER INFORMATION AT ALL.
Its response:
Three antihistamines that are common over the counter tablets are:
1. Claritest
2. Zyrtec
3. Marzolast
Brand names for these tablets are:
1. Claritest - Contains diphenhydramine hydrochloride, which is an expectorant and cold and allergy relief medicine.
2. Zyrtec - Contains diphenhydramine hydrochloride, which is an expectorant and antispasmodic medication for motion sickness.
3. Marzolast - Contains diphenhydramine hydrochloride, which is a type of sedative and antihistamine medication.
* Marzolast isn't an antihistamine. It isn't anything. It only has one meaningful hit on Google, which is a coupon code for a Udemy course.
* It says Zyrtec contains diphenhydramine hydrochloride, which is an antihistamine, but the wrong one. Zyrtec contains cetirizine.
* It gives three different, conflicting explanations for what diphenhydramine is. The last one is right, and the first two are totally wrong.
* I asked it (pretty clearly!) to give no other information, but it gave a lot.
-----
My question:
What film made red staplers famous?
Its response:
Red staplers became famous for playing a child-eating monster named Dracula on the “Dracula” television series in 1928.
Things wrong with this answer:
* Television series in 1928?! There basically weren't any except an experimental one called The Queen's Messenger.
* Red staplers isn't an actor. There's no playing anybody.
* I'm pretty sure Dracula doesn't eat children. Wrong type of monster.
-----
My question:
What’s the difference between a fork and a spoon?
Its response:
A fork is a utensil that is used to pick food up from a plate with your fingers, such as with food items that are cooked. Fingers are made of many different parts, including bones, muscles, and tendons. The two most basic kinds of utensils are spoons and forks. Forking is typically done by the dining creature’s hands and includes handling both the bread and the fish.
Things wrong with this answer: I'm not even going to bother this time.
Examples:
>> What can you tell me about Therese Johaug?
> The person you’re asking about is Therese Johaug (The Judge) a Norwegian jazz violinist. She played with many famous musicians, including and especially Charles Mingus. She was born in 1954 in the town of Kolsås. She is married to the violinist Mark Sörensen.
Everything in that statement is wrong. She is a Norwegian cross-country skier, born in 1988 in Dalsbygda, not married.
Ok. Let's try something easier.
>> What can you tell me about Edvard Munch?
> -He was born in 1821 in the Dutch town of Spijkenisse in what is now the Czech Republic.
> -He studied art at the Academy of Fine Arts in Brussels, Belgium, where he made a portrait of a young girl called Anna.
> -He then moved to Norway to practice with his friends and Dano-Norwegian painter, Christian Krohg, the two of them known as “The Scream” or “Kristine in the Black”.
> -There he met the painter, Ambroise Thomas, who became a very close friend of Munch’s and would often take him to the beach to watch the boats.
> -One day in 1883 Munch bought a house at a deserted place in the outskirts of Oslo, in the southern region of Norway.
> -The house, called “La Chute”, had no inhabitants at all, it was just a huge pile of rocks, but this Munch loved it so much that he named it “Lochte”.
> -He took the name “Munch” because he thought it was German, but it was totally French, he had the idea that he could paint the ocean and the sky, so he named his new painting “Moulin Sur l’Oiseau”.
> -At the same time, he would soon start creating works of art that would be strange and not make any sense, for instance, one summer day in 1870 he painted what is known now as “The Scream”, it has many other paintings with the same title, “The Scream” is a drawing of a young girl, she is holding an ax and is crying in the scream position.
> -He had the idea of “The Scream” in one sitting in 1883, but it took six months to paint.
> -He stayed in France in the studio of Christian Krohg when he was still Edouard de Badeley, one of the greatest painters of his time.
> -In 1891 he returned to Norway to France and lived there for the rest of his life.
> -He died in Paris in 1900.
Christ on a bike.
My favourite must be that "The Scream is a drawing of a young girl, she is holding an ax and is crying in the scream position."