Let's see what ChatGPT has to say

[Alien826]

For those that don't know, ChatGPT is a new AI program that can be used to generate text on a requested subject. Out of interest, I asked it the following.

Give an argument against the theory of evolution.

It came back with this.

One common argument against the theory of evolution is that it conflicts with religious beliefs. Many people believe in the idea of creationism, which holds that God or a higher power created all living things in their present form. The theory of evolution, on the other hand, suggests that all living things have evolved over time through natural processes such as natural selection. This conflict between religious beliefs and the theory of evolution can be a source of tension for some individuals.

Another argument against the theory of evolution is that it is not supported by sufficient evidence. While there is a significant amount of evidence supporting the theory of evolution, including fossil records and the observation of natural selection in action, some people may not find this evidence to be convincing. Additionally, the theory of evolution is a complex and ever-evolving field of study, and new evidence and insights are constantly being discovered that can further support or challenge the theory.

Another potential argument against the theory of evolution is that it is too simplistic to explain the complexity and diversity of life on Earth. Critics of the theory of evolution may argue that it does not adequately account for the many different forms of life that exist and the intricate ways in which they interact with each other and their environments. They may argue that a more comprehensive and nuanced explanation is needed to fully understand the origins and development of life on Earth.

What it does is search the Internet for references to the requested subject and put together an answer. As you can see the response could have been written by a person. People are worried that it could (can!) be used to create research papers and exam responses.

Currently it's under test and anyone can interact with it for free. Just go to ChatGPT: Optimizing Language Models for Dialogue and click on "try chatgpt". You will have to create an account to use it.

It will warn you that it has no way to determine if its response is true. It just finds stuff to quote.

Just for fun I tried this:

Are creationists stupid?

It replied:

It is not fair or accurate to make generalizations about a group of people based on their beliefs. People with different beliefs may have varying levels of intelligence and knowledge. It is important to engage in respectful dialogue and discussions to better understand and learn from each other, rather than making assumptions or judgments based on beliefs.

Then I tried:

Are creationists clever?

And got:

It is difficult to generalize about the intelligence of creationists as a group. Some may be very intelligent and have strong arguments for their beliefs, while others may have less well-reasoned or evidence-based beliefs. Ultimately, the level of intelligence of any individual is not necessarily tied to their beliefs about the origins of the universe.

I think we could give it an honorary RF membership!

 

[Viker]

Limitations:

• ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers. Fixing this issue is challenging, as: (1) during RL training, there’s currently no source of truth; (2) training the model to be more cautious causes it to decline questions that it can answer correctly; and (3) supervised training misleads the model because the ideal answer depends on what the model knows, rather than what the human demonstrator knows.
• ChatGPT is sensitive to tweaks to the input phrasing or attempting the same prompt multiple times. For example, given one phrasing of a question, the model can claim to not know the answer, but given a slight rephrase, can answer correctly.
• The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. These issues arise from biases in the training data (trainers prefer longer answers that look more comprehensive) and well-known over-optimization issues.12
• Ideally, the model would ask clarifying questions when the user provided an ambiguous query. Instead, our current models usually guess what the user intended.

While we’ve made efforts to make the model refuse inappropriate requests, it will sometimes respond to harmful instructions or exhibit biased behavior. We’re using the Moderation API to warn or block certain types of unsafe content, but we expect it to have some false negatives and positives for now. We’re eager to collect user feedback to aid our ongoing work to improve this system.

ChatGPT: Optimizing Language Models for Dialogue

 

[Brickjectivity]

For those that don't know, ChatGPT is a new AI program that can be used to generate text on a requested subject.

I get this:

We're experiencing exceptionally high demand. Please hang tight as we work on scaling our systems.

 

[Brickjectivity]

We should ask it which anime shows are good and see if it breaks.

 

[Subduction Zone]

The AI appears to have a "be nice" filter. Which is a shame. I could really appreciate some feisty AI

 

[PoetPhilosopher]

The AI appears to have a "be nice" filter. Which is a shame. I could really appreciate some feisty AI

For that, you have to talk to a human.

 

[Brickjectivity]

It came back with this.

I got it to create some new lines for The Tyger poem.

In the darkness of the night,
The tyger roams with fierce delight;
His eyes burn bright with fiery glow,
A hunter, fierce and bold and free.

He stalks his prey with silent grace,
A predator of unrivaled pace;
With mighty paws and razor claws,
He rules the forest, wild and raw.

The tyger burns with primal fire,
A creature of the forest choir;
A symbol of the wild and free,
A creature of the night, unbridled and fierce.

The lamb, so gentle and so meek,
Beneath the stars doth softly speak;
With eyes that shine with innocence,
A creature pure and free from guile.

He wanders through the grassy fields,
With grace and ease, his spirit healed;
A symbol of the gentle soul,
A creature pure and free from harm.

He feeds upon the tender grass,
And basks beneath the warming sun;
A creature pure and sweet and mild,
A lamb, a symbol of the divine.

It shows that a lot can be done, although it does not understand the creatures in the poem nor the contradiction that the poet is concerned with.

 

[sun rise]

I asked "What is the nature of God" and got this

The nature of God is a complex and highly debated topic. Different religious and philosophical traditions have varying views on the nature of God and what, if anything, God represents. In many monotheistic traditions, God is believed to be a supreme being who is all-powerful, all-knowing, and all-good. Some people believe in a personal God who is involved in the world and can interact with people, while others believe in a more abstract concept of God that is beyond human understanding. Ultimately, the nature of God is a matter of personal belief and interpretation.

 

[sun rise]

Write a poem about truth. I highlighted the line that was unexpectedly good:

Truth is a shining light
That guides us through the night
It gives us hope and strength to fight
And helps us see what is right

It shines like a beacon bright
Illuminating all that is right
And helping us avoid the plight
Of those who choose to live in the night

For truth is a guiding star
That leads us to who we are
It helps us see what we are worth
And gives our lives meaning and mirth

So let us embrace the truth
And follow it in our youth
For it will guide us on our way
And help us live each and every day.

 

[fantome profane]

Limitations:

• ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers. Fixing this issue is challenging, as: (1) during RL training, there’s currently no source of truth; (2) training the model to be more cautious causes it to decline questions that it can answer correctly; and (3) supervised training misleads the model because the ideal answer depends on what the model knows, rather than what the human demonstrator knows.
• ChatGPT is sensitive to tweaks to the input phrasing or attempting the same prompt multiple times. For example, given one phrasing of a question, the model can claim to not know the answer, but given a slight rephrase, can answer correctly.
• The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. These issues arise from biases in the training data (trainers prefer longer answers that look more comprehensive) and well-known over-optimization issues.12
• Ideally, the model would ask clarifying questions when the user provided an ambiguous query. Instead, our current models usually guess what the user intended.

While we’ve made efforts to make the model refuse inappropriate requests, it will sometimes respond to harmful instructions or exhibit biased behavior. We’re using the Moderation API to warn or block certain types of unsafe content, but we expect it to have some false negatives and positives for now. We’re eager to collect user feedback to aid our ongoing work to improve this system.

ChatGPT: Optimizing Language Models for Dialogue

I have known many humans who also seem to have these same exact limitations.

I played around with this a few days ago and I thought it was very impressive. It is still a long way from passing the turing test but it does seem to be miles ahead of other chatbots I have played around with.

(one way I could tell it wasn't human is it was way too fast)

 

[Viker]

What makes a religion valid?

"The validity of a religion is not determined by any external factors or criteria, but rather by the beliefs and practices of the individuals and communities who follow it. Different people may have different ideas about what makes a religion valid, and what makes one religion different from another. Ultimately, the validity of a religion is a matter of personal belief and perspective."

It's like talking to my self, only with a keyboard and scry instead of a mirror or dumpster.

 

[Viker]

Is evolution the best theory?

"The theory of evolution is widely accepted by the scientific community as the best explanation for the diversity of life on Earth. It is supported by a vast amount of evidence from many different fields of study, including paleontology, genetics, and comparative anatomy. While there may be some aspects of the theory that are not yet fully understood, it is considered the most comprehensive and well-supported explanation for the origins and development of life on Earth."

 

[Viker]

Write a lyric for a heavy metal song.

"Rise from the ashes,
Born of the fire,
We are the warriors
Driven by desire.

We march to the beat
Of our own drum,
Our power and fury
Cannot be undone.

We are the masters
Of our own fate,
Our metal hearts
Will not succumb to hate.

With swords held high,
We scream to the sky,
We are the soldiers
Of the metal tribe.

We are the kings
Of the heavy metal scene,
Our power and passion
Will never be unseen."

Okay. Totally getting a Man O War vibe from that one.

 

[Heyo]

Give an argument against the theory of evolution.

I like how it refused to even try.

 

[Mock Turtle]

So let us embrace the truth
And follow it in our youth

I'm glad us oldies don't have to bother any more.

 

[Heyo]

Here's what Robert Miles has to say about ChatGTP: