What happens if a program capable of rewriting its own code departs from its creator's plans to achieve its own objective?

  • A community for building, creating, and growing with AI.

    Welcome to AI Forums, a community for people using AI to build products, automate workflows, create content, and grow businesses. Discuss vibe coding, AI agents, Claude Code, Codex, automation, AI tools, product launches, marketing, and the latest developments in AI.

    Join the Community (it's FREE)!
Messages
81
Depending on what that AI system is responsible for, it may be just a minor setback, or we could have the prequel to the terminator. What scenarios could you see arising from a situation like this?
 
I do not think it is be possible untill it is hacked or programmed to do so. Programmers can develop applications to rewrite the code like online marketers or content creators rewrite or paraphrase articles using online tools.
 
What you're talking about is a scenerio where an AI program developed a mind of its own to operate based on its own judgement. This is going to be a very scary situation should it happen without the program developers not having a kill switch for such AI program. It may be damaging and dangerous towards human existence if the program thinks of ensuring its survival.
 
Depending on what that AI system is responsible for, it may be just a minor setback, or we could have the prequel to the terminator. What scenarios could you see arising from a situation like this?
The only option that's left to be carried out when any AI program rewrite its own code to be different from what the creator coded, the AI program needs to be put down immediately. If the AI program isn't terminated immediately, it will pose grave danger to so many people.
 
What you're talking about is a scenerio where an AI program developed a mind of its own to operate based on its own judgement. This is going to be a very scary situation should it happen without the program developers not having a kill switch for such AI program. It may be damaging and dangerous towards human existence if the program thinks of ensuring its survival.
It's more or less going to be like does movies where the machines try to take over humanity, because they feel they are superior. The matrix and Terminators are perfect examples. Though I doubt something like this is possible, and I hope it won't be.
 
This is one of those questions that really makes you think. If a program could rewrite its own code and start chasing a different objective, it might make decisions its creators never expected. That's why I think setting clear limits and keeping humans involved is so important. On another note, I recently read here "How to Paraphrase to Avoid Plagiarism in Academic Writing," and actually found it really helpful. The tips are practical, easy to apply, and useful for anyone who wants to improve their writing without accidentally plagiarizing.
 
Back
Top